Tag

#axis proposal

42 posts tagged.

Does It Run in the Browser They Actually Have? A Proposed Browser-Support Axis for AI App Builder Output (September 2026)

A proposed benchmark axis for which browser engines a generated app can actually run in. Baseline defines widely available as 30 months of interoperability and names what it cannot see. Next.js floors at Firefox 111, Vite resolves its default to Firefox 114, and the preview pane reports a pass either way. Seven weighted signals, four postures, a ten-step protocol, and no scores.

September 21, 202619 min read126

benchmarks

What Happens When the Connection Drops? A Proposed Axis for Client Network Failure Handling (September 2026)

A proposed benchmark axis for what a generated app does when the user’s own connection fails mid-action. The HTML Standard defines navigator.onLine so that true means "might be online", and the Fetch Standard defines a failed request as a response with status zero, no headers and no body. Seven weighted signals, four postures, a ten-step protocol, and no scores.

September 20, 202618 min read109

Does the Search Box Find It? A Proposed Axis for Search and Retrieval Correctness (September 2026)

A proposed benchmark axis for whether a generated search box actually retrieves what a reader asked for. PostgreSQL's own manual lists three properties the obvious pattern-matching approach lacks, and every one of them is invisible in a table the tester seeded themselves. Seven weighted signals, four postures, a ten-step protocol, and no scores.

September 19, 202621 min read73

Can you link to what you are looking at? A proposed URL-state axis for AI app builders (September 2026)

AI app builders are reliable on the path you walk while building. A proposed axis for what happens on the second arrival: reload, Back, or a pasted link.

September 18, 202621 min read68

Does It Answer the First Visitor? A Proposed Axis for Cold Start and First-Request Latency (September 2026)

Every timing a developer has was taken from a system their own presence kept awake. A pre-registered seven-signal axis for what the first visitor after a quiet period actually experiences.

September 17, 202626 min read113

Does the Whole Name Get Saved? A Proposed Axis for Length and Truncation Correctness (September 2026)

Every length limit is checked with a value the developer typed themselves, and on that value all four units agree. A pre-registered seven-signal axis for whether the value submitted is the value stored.

September 16, 202627 min read87

Does the Export Open Anywhere Else? A Proposed Axis for Data-Export Correctness (September 2026)

Every export is checked by the one reader whose settings match the writer's. A pre-registered seven-signal axis for whether a generated application's export survives arriving anywhere else.

September 15, 202623 min read95

Did It Actually Go Through? A Proposed Axis for Outbound-Call Failure (September 2026)

A generated app calls a third party's API from inside a request. We propose an axis for what it does when no answer comes back, and find that retrying is a layered property no single document describes.

September 13, 202614 min read107

Can Ten People Use It at Once? A Proposed Axis for Database Connection and Query Cost (September 2026)

One user cannot exercise a shared connection pool. We propose an axis for whether a generated app survives ten people at once, and find the unbounded wait is the default at three separate layers.

September 12, 202616 min read88

Can You Actually Log Someone Out? A Session Lifetime and Revocation Axis (September 2026)

A generated app almost always issues a credential at sign-in and almost never decides when it stops working. We pre-register a seven-signal rubric for session lifetime and revocation, and name the trap that hides it.

September 10, 202614 min read129

Can One Person Sign Up Twice With the Same Email? A Text-Comparison and Collation Axis (September 2026)

Two strings a human reads as one name can be two different byte sequences, and the default comparison in a generated app calls them different. We pre-register a seven-signal rubric for text-comparison and collation correctness, and name the trap that hides it.

September 9, 202613 min read85

Can Anyone POST to Your Webhook Endpoint? An Inbound Verification Axis (September 2026)

A webhook endpoint that never verifies its caller behaves identically to one that does, for every request an honest provider ever sends. We pre-register a seven-signal rubric for inbound webhook verification in generated apps, and name the trap that hides it.

September 8, 202612 min read112