A/B testing impact Shopify sites

Performance impact by ab_testing provider.

Field data PhoneDesktopAll Scope All sites October 2026 edition · Phone field outcomes · Shopify sites only
Metric LCP INP CLS
Shopify Scoped to 8,248 sites out of 203,892 analyzed (cms) Compare with all sites →
1

At a glance the headline numbers for A/B testing impact

Performance impact by ab_testing provider.

1
Providers ranked
After min-sites filter
219
Sites in sample
Combined across all items
0.03
Best CLS (p75)
Google Optimize
The State of Web Vitals · October 2026 · Shopify sites (8,248) · phone field datacorewebvitals.io/state-of-cwv
2

The ranking sorted by CLS at p75, fastest first

# Provider CLS p75 Passing Sites
1 Google Optimize 0.03 90.3%
219
The State of Web Vitals · October 2026 · Shopify sites (8,248) · phone field datacorewebvitals.io/state-of-cwv
3

Passing CLS per provider which group passes the CLS most often

ProviderSitesPassing CLSp75
VWO 0.3% 23 95% 0.05
Google Optimize 2.7% 219 90% 0.03
Convert 0.4% 36 85% 0.05
Kameleoon 0.1% 6 83% 0.06
Good Needs Improvement Poor Sorted best-passing first · median colored by its own rating · pass = good CLS (0.1 at p75) · one value per site
The State of Web Vitals · October 2026 · Shopify sites (8,248) · phone field datacorewebvitals.io/state-of-cwv
4

All five vitals at once the whole category without toggling - cell is the pass rate, small number the p75

LCP
INP
CLS
FCP
TTFB
Google Optimize 2.7%
872.1s
87150ms
900.03
871.4s
89561ms
Convert 0.4%
792.4s
76198ms
850.05
851.7s
85572ms
VWO 0.3%
952.1s
74201ms
950.05
901.5s
100510ms
Kameleoon 0.1%
1002.0s
83177ms
830.06
1001.4s
83588ms
60%95%+ passing Cell: pass rate, small number = p75 · faded rows: under 100 sites

One row per provider, one column per vital - the cell is the share of sites passing, the small number the p75. No toggling needed to see where the category actually differs.

The State of Web Vitals · October 2026 · Shopify sites (8,248) · phone field datacorewebvitals.io/state-of-cwv
Related signals Maps (4) → CDN (16) → Chat & messaging (17) → Bot detection (8) → 203,892 crawled sites with Chrome field data, representing millions of real page loads · How we measured