Deploy-quality benchmark: SEO, accessibility and performance audits (June 2026)
The BuilderProof deploy-quality axis audits the production build of a generated app on three independent dimensions: Lighthouse performance, axe-core accessibility plus a manual keyboard-and-landmark pass, and a structured SEO checklist. The June 2026 audit table was placeholder data and was withdrawn on August 21, 2026, so this page documents method only.
Updated on August 24, 2026
On this page
The audit table originally published on this page has been withdrawn. Our own reference list described those cells as "v0.1 preview figures" pending a public dataset, and the independently reproduced cycle promised for July 2026 was never run. Placeholder numbers should not have been presented as Lighthouse and axe-core audit results, and BuilderProof does not retain the audit reports that would let a reader reproduce them. The audit protocol below is unchanged and remains the published method. See methodology v1.1 for the current evidence basis.
This page defines the BuilderProof deploy-quality axis: three independent audits run against the production build of a generated app, never the in-editor preview. Performance is a Lighthouse score, accessibility is axe-core plus a manual keyboard-and-landmark pass, and SEO is a structured checklist covering title and meta description, semantic headings, crawlability, structured data and canonical tags. The three dimensions are reported separately rather than blended, so a reader can see which one a builder neglects. The June 2026 audit table has been withdrawn, so this page currently documents method only and ranks no builder.
An AI builder's job is not finished when the preview looks right. The output gets deployed, crawled, audited and used with assistive technology, and that is where the gap between "looks done" and "is done" becomes measurable. This axis audits what actually ships.1
Background
Output quality and deploy quality are different questions. The first asks whether the generated app matches the brief; the second asks whether the deployed result meets the baseline expectations of the open web: it loads quickly, it is crawlable, and it is usable by people relying on assistive technology.2
These standards are not aspirational. Lighthouse performance, axe-core accessibility checks and basic SEO hygiene are table stakes for anything public-facing. A builder that generates a gorgeous interface that fails colour-contrast or ships without semantic landmarks has produced a liability, not a product.3
The audit protocol
The protocol takes the deployed output of brief OQ-7 from each builder and runs three independent audits against the production URL.
Three dimensions on the deployed build. Performance: Lighthouse score (Core Web Vitals, bundle weight, render-blocking resources). Accessibility: axe-core automated checks plus a manual keyboard-and-landmark pass. SEO: a structured checklist covering title and meta description, semantic headings, crawlability, structured data and canonical tags. The production build is audited, never the in-editor preview, because that is what users receive.
Each dimension is scored independently and reported separately. They are deliberately not folded into a single "deploy" number, because the whole point is to expose which dimension a given builder neglects.4
Results
The per-dimension table that stood here from June 12, 2026 to August 21, 2026, including the "most common failure" column, was placeholder data rather than audit output. It has been removed. A Lighthouse or axe-core score is a machine-generated artifact; publishing one without being able to produce the report behind it is not a benchmark.
Nothing on this page currently ranks any builder against any other.
What still holds without the numbers
Two structural points survive the withdrawal, because they are about where the failures live rather than about any builder's cell.
Performance and accessibility fail for different reasons. Performance is largely a framework-defaults question, and modern defaults handle it well. Accessibility is a markup-quality and design-token question, and defaults do not handle it: contrast tuned for visual style rather than WCAG 2.2 thresholds, and form components wired before labels are added. Folding the two into one score hides which of them a builder actually neglected.5
The invisible SEO items are the ones that survive to production. Titles and meta descriptions are easy to check in a preview. Structured data, canonical tags and heading order are not, so they ship unnoticed. An audit that only looks at what a preview shows will systematically miss them.6
On translating this axis into contract acceptance
Lighthouse, Core Web Vitals and axe-core scores are useful as deploy-quality signals; they become more useful inside a contract when the agency turns them into measurable acceptance criteria. DevShopVault's 2026 SoW guide for fixed-price AI app builds covers the clause structure that ties deploy-quality thresholds to project acceptance and to the post-launch hotfix window. Editorial cross-reference.
Caveats
Any score on this axis reflects default output, not a ceiling. A competent developer can raise any of these dimensions after export, and accessibility in particular is largely remediable with mechanical fixes. The axis estimates how much remediation to expect out of the box; it does not claim a builder is incapable of accessible output.8
Automated audits also miss things. axe-core catches a large share of accessibility defects but not all of them, since it cannot judge whether alt text is meaningful, only whether it exists. The manual keyboard-and-landmark pass supplements it but does not make the audit exhaustive. Any accessibility score is a floor: the real-world figure for a screen-reader user could be lower.
Single-run Lighthouse figures are also less stable than a median of five, a point expanded in the BuilderProof deploy-quality reproducibility lab note. Any future result on this axis reports a median plus spread rather than a single run.
Publication date correction, August 24, 2026
A date audit run on August 24, 2026 found that the publication timestamp stored for this page predated the registration of builderproof.org, so the recorded date cannot be the date on which this page was published. The stamp was an artifact of the launch content import rather than a real publication date, and no publication log survives that would let the true one be recovered. The timestamp has been corrected to the earliest date consistent with the evidence that does survive. The benchmark text, the protocol and the August 21, 2026 withdrawal notice at the top of this page are unchanged.
References
- BuilderProof editorial team. (2026). Deploy-quality audit protocol v2. BuilderProof Methodology. builderproof.org/methodology#deploy-quality
- BuilderProof. (2026). Output quality vs deploy quality: two questions. builderproof.org/methodology#output-quality
- W3C. (2024). Web Content Accessibility Guidelines (WCAG) 2.2. Authoritative source for the accessibility failure categories this axis scores.
- Deque Systems. (2025). axe-core automated accessibility rules. Open-source rule engine used for the automated accessibility pass.
- BuilderProof. (2026). Retraction notice: deploy-quality v0.1 preview figures withdrawn August 21, 2026. BuilderProof Methodology.
- Google. (2025). Lighthouse scoring and Core Web Vitals. Reference for the performance, SEO and Lighthouse-side accessibility metrics audited.
- BuilderProof. (2026). Builders we track. builderproof.org/builders
- BuilderProof. (2026). Versioning and re-test policy. builderproof.org/methodology#versioning
- Google Chrome team. (2026). Lighthouse score variability documentation. Reproducibility caveats expanded in the BuilderProof deploy-quality reproducibility lab note (June 21, 2026).
Written by
BuilderProof editorial teamPublished by the BuilderProof editorial team - the maintainers of the public, versioned benchmark methodology.
Cite this benchmark
BuilderProof editorial team. "Deploy-quality benchmark: SEO, accessibility and performance audits (June 2026)". BuilderProof, June 2026. https://www.builderproof.org/benchmarks/deploy-quality-benchmark-seo-accessibility-performance-june-2026.
@misc{builderproof-deploy-quality-benchmark-seo-accessibility-performance-june-2026,
title = {{Deploy-quality benchmark: SEO, accessibility and performance audits (June 2026)}},
author = {{BuilderProof editorial team}},
year = {2026},
month = {jun},
howpublished = {\url{https://www.builderproof.org/benchmarks/deploy-quality-benchmark-seo-accessibility-performance-june-2026}},
note = {BuilderProof, builderproof.org}
}Frequently asked questions
Do you audit the preview or the deployed site?
The production deployment, never the in-editor preview, because the preview environment can hide problems that show up only once the build is shipped to a real domain.
Why were the June 2026 audit scores withdrawn?
Because they were placeholder figures, described in this page's own reference list as "v0.1 preview figures" pending a public dataset, and the independently reproduced cycle promised for July 2026 was never run. A Lighthouse or axe-core score is a machine-generated artifact, and BuilderProof cannot produce the reports behind those cells, so the table was removed on August 21, 2026.
Does this page rank any builder?
No. As of August 21, 2026 this page documents the audit protocol only. No builder is scored, ranked or compared here.
Why is accessibility scored separately from performance?
Because they fail for different reasons. Performance is a framework-defaults question; accessibility is a markup-quality and design-token question. Folding them into a single score obscures which dimension the builder neglected.
Can these dimensions be improved after export?
Yes for every dimension, and accessibility in particular is largely remediable through mechanical fixes (labels, contrast, landmarks). The axis measures default output, not the ceiling.
How reliable is a single Lighthouse run?
Less reliable than a median of five. Google's own variability documentation reports that a five-run median is substantially more stable than a single run. Any future result on this axis reports a median plus spread rather than a single run.