A/B testing impact Shopify sites

Performance impact by ab_testing provider.

Field data PhoneDesktopAll Scope All sites October 2026 edition · Desktop field outcomes · Shopify sites only
Metric LCP INP CLS
Shopify Scoped to 8,248 sites out of 203,892 analyzed (cms) Compare with all sites →
1

At a glance the headline numbers for A/B testing impact

Performance impact by ab_testing provider.

1
Providers ranked
After min-sites filter
219
Sites in sample
Combined across all items
1.9s
Best LCP (p75)
Google Optimize
The State of Web Vitals · October 2026 · Shopify sites (8,248) · desktop field datacorewebvitals.io/state-of-cwv
2

The ranking sorted by LCP at p75, fastest first

# Provider LCP p75 Passing Sites
1 Google Optimize 1.9s 90.5%
219
The State of Web Vitals · October 2026 · Shopify sites (8,248) · desktop field datacorewebvitals.io/state-of-cwv
3

Passing LCP per provider which group passes the LCP most often

ProviderSitesPassing LCPp75
VWO 0.3% 23 94% 1.9s
Google Optimize 2.7% 219 91% 1.9s
Convert 0.4% 36 88% 2.2s
Kameleoon 0.1% 6 83% 2.1s
Good Needs Improvement Poor Sorted best-passing first · median colored by its own rating · pass = good LCP (2.5s at p75) · one value per site
The State of Web Vitals · October 2026 · Shopify sites (8,248) · desktop field datacorewebvitals.io/state-of-cwv
4

All five vitals at once the whole category without toggling - cell is the pass rate, small number the p75

LCP
INP
CLS
FCP
TTFB
Google Optimize 2.7%
911.9s
9984ms
850.07
901.1s
90491ms
Convert 0.4%
882.2s
100110ms
750.11
841.4s
97539ms
VWO 0.3%
941.9s
100114ms
720.10
891.3s
100499ms
Kameleoon 0.1%
832.1s
10078ms
830.08
1001.5s
67739ms
60%95%+ passing Cell: pass rate, small number = p75 · faded rows: under 100 sites

One row per provider, one column per vital - the cell is the share of sites passing, the small number the p75. No toggling needed to see where the category actually differs.

The State of Web Vitals · October 2026 · Shopify sites (8,248) · desktop field datacorewebvitals.io/state-of-cwv
Related signals Maps (4) → CDN (16) → Chat & messaging (17) → Bot detection (8) → 203,892 crawled sites with Chrome field data, representing millions of real page loads · How we measured