Bazaarvoice Hosted Display CWV Performance Testing Methodology
July 2025
Trailing 3-month performance data are in Appendix B
Introduction
Bazaarvoice Hosted Display V2 performance is critical to the success of consumer interactions with eCommerce web pages and their conversion.
Google's Web Vitals (and Web Vitals) initiative provides unified industry guidance on quality signals essential to delivering a great user experience on both mobile and desktop devices. Google’s initiative is intended to simplify the landscape and help sites focus on the metrics that matter most: the Core Web Vitals (CWV).
Core Web Vitals (CWV)
Core Web Vitals are the subset of Web Vitals that apply to all web pages. Each of the Core Web Vitals represents a distinct facet of the user experience, is measurable in the field, and reflects the real-world experience of a critical user-centric outcome.
The metrics that make up Core Web Vitals will evolve. The current set focuses on three aspects of the user experience—loading, interactivity, and visual stability—and includes the following metrics (and their respective thresholds):
Metrics
- Largest Contentful Paint (LCP) - Measures the time it takes for the page to load. For a good user experience, LCP should be within 2.5 seconds of the page starting to load.
- Interaction to Next Paint (INP) - Measures a web page's responsiveness by tracking how quickly it reacts to user interactions like clicks or key presses. For a smooth, responsive experience, a good INP score should be under 200 milliseconds.
- Cumulative Layout Shift (CLS) - Measures the page's visual stability. For a good user experience, CLS should be less than 0.1.
- Total Blocking Time (TBT) measures when a page is unresponsive due to long tasks, affecting interactivity. For optimal performance, a good TBT score should be under 300 milliseconds.


Objective
Bazaarvoice’s Hosted Display team’s objective is to ensure CWV metrics (LCP, INP, CLS, and TBT) for desktop, Android, and IOS are all maintained at "good" levels.
Frequency of Testing and Remediation of Issues
- The Hosted Display V2 performs testing on a monthly cadence.
- For any CWV result that is not "Good," a JIRA defect ticket is opened and addressed as high priority.
Testing Tools
The Hosted Display team employs Lighthouse and PageSpeed Insights for performance testing.
Performance Baseline & Testing
- Hosted Display V2's performance is baselined on Pixel 4XL (for Android devices), iPhone 10 (for iOS devices), and Google Chrome V137.0.
- When calculating the Largest Contentful Paint (LCP) for Hosted Display V2, only the loading, execution, and rendering of the Hosted Display V2 components are considered. (The client’s HTML page load time will be removed from the Hosted Display LCP calculation.)
Mobile Devices used for baselining Hosted Display V2's performance
The Hosted Display team analyzed the actual production traffic inbound to Bazaarvoice systems and concluded the following:
- 68% of mobile traffic to Bazaarvoice originates from iOS devices, with 99% of those using iOS version 16 or newer. iPhone 10 is the oldest device that still supports that iOS version.
- 32% of mobile traffic to BV originates from Android devices, with 97% of Android devices that access Hosted Display using Android version 10 or higher. Hence, the LCP measurement for Android devices will be on Pixel 4XL (the oldest supported device on that Android version).
Appendix - A
The rationale for choosing the Pixel 4XL and iPhone X for mobile testing
The Moto G4 was previously used for mobile performance testing because Google used it for mobile testing in tools like Lighthouse and PageSpeed Insights. However, this device should no longer be used because it is obsolete, and its limited CPU performance makes it unsuitable for loading the rich content found in today's web applications.
Analysis of Bazaarvoice’s Black Friday/Cyber (BFCM) 2024 traffic data revealed that 68% of traffic originated from iOS devices, with 99% of those using iOS version 16 or higher (the most recent version of iOS is V18). 32% of traffic came from Android devices, with 97% using Android version 10 or higher (the most recent version of Android OS is version 14). Based on this data, the team uses Pixel 4XL for Android testing and iPhone X for iOS testing.
Adopting the baseline platforms ensures that Hosted Display V2 is tested on devices currently used by actual users, providing a more accurate representation of the user experience.
Use of iOS versions during BFCM 2024

Use of Android versions during BFCM 2024

Appendix B - Hosted Display V2 Monthly Performance Status
CWV for Hosted Display V2 R&R (v6.45.0)
Test date: Jul 31, 2025
Following the recent deployment, we are observing the expected improvement in LCP. It also included a fix for a minor UI issue: the rating summary section would sometimes visually "shift" or "jump" as its data was loading. The section will now wait for all its data to be available before rendering, ensuring a more stable and consistent user experience.



CWV for Hosted Display V2 R&R (v6.43.11)
Test date: 19 June 2025
We saw a slight, expected increase in LCP in release v6.43.11. This was due to a necessary bug fix for correctly rendering pages with no reviews. The LCP is still below our 2.5s threshold. The next release is expected to improve the LCP.



CWV for Hosted Display V2 R&R (v6.43.10)
Test date: 3 June, 2025



CWV for Hosted Display V2 R&R (v6.42.3)
Test date: 29 April 2025



Updated 5 days ago