Bilby / How it works
How does Bilby work?
Bilby is your store's night shift. Every night it opens your store in a real browser, visits it the way a shopper does, and runs seven checks — is it working, is the tracking firing, how fast is it, what changed, what did rivals do, is the SEO intact, do AI assistants recommend it. The free scan is one night of that, and you watch it happen.
1 · The scan you watch
Sixty seconds that feel like an investigator at work.
Type a URL and Bilby's visit streams to you: a screenshot per step as it finishes, facts as they are found, and the moment Claude is judging a frame — with the question it is being asked. Give your email while it runs, not after. If a step fails, the others keep going and the failure is shown truthfully, never as a hang.
Transcript of the film
Bilby — the explainer (53 s, no audio, captions burned in). Recorded 2026-09-02 from the real theatre at https://navaal.ai/bilby/scan?film=1 (1440×900 at 2×) on the labelled demo store fernwick-and-co.fly.dev. Scan BRTT5y1PEzcd. [0:00] Caption: "Bilby walks your store like a customer." [0:02] The theatre's empty stage. The store address fernwick-and-co.fly.dev is typed and submitted. [0:07] The store's own homepage fills the frame as Bilby reaches it; the step rail ticks Home; the "Found so far" line fills with the first facts. [0:11] The product page, then Add to cart is pressed. The cart badge stays at (0). [0:17] Caption: "It films what breaks." [0:20] "Claude is judging · frame n of m" — the judging strip under the frame, then the ring draws on the cart badge: the add-to-cart silently failed. [0:27] The walk completes; the frame shrinks into the report header (the same store image) and the report reveals beneath. [0:31] The score in one line: "65 out of 100 — one thing is stopping sales tonight." The first finding in four plain lines: what Bilby did, what Bilby saw, what it costs you, what to do — with "Watch the moment ▶". [0:40] Caption: "It says what it costs you, in plain words." [0:43] What this might be costing you this month, with the slider; then the plan: watch this every night, have us fix it, see who's beating you. [0:51] Caption: "Every night, from US$24/mo." [0:53] Bilby · by Navaal · navaal.ai/bilby
// THE REAL SCREEN, PLAYING A LABELLED DEMO STREAM · RUN YOUR OWN AT /BILBY/SCAN
2 · One visit, seven things it checks
The visit records everything. The checks read it.
Deterministic checks — network log, timings, DOM, headers, certificate, sitemap — are fast, cheap and cannot hallucinate. Claude is used only where a human eye is needed: does this page look broken, and it must quote its evidence. Each check has its own page with the rules it runs and the limit it prints.
// FOUR FRAMES OF THE SAME REAL VISIT OF THE LABELLED DEMO STORE · THE CHECKS READ THIS RECORDING
Add-to-cart that fails — the store's own cart endpoint refused the item (HTTP 4xx) or showed an error.
FREE SCAN (ONE NIGHT) · BILBY, BILBY PRO, AGENCY (NIGHTLY)MoneyIs my tracking actually firing?A platform that fired on a step last night and is silent tonight (P1 — the pixel stopped).
FREE SCAN (ONE NIGHT) · NIGHTLY ON BILBY, BILBY PRO, AGENCYSpeedHow fast is my store, and what's slowing it?Mobile LCP over 4 s on the home, collection or product page (P2).
FREE SCAN (ONE NIGHT) · NIGHTLY ON BILBY, BILBY PRO, AGENCYChangeWhat's different on my store since last night?Scripts added or removed since last night.
BILBY, BILBY PRO, AGENCY (NIGHTLY) — NOT ON THE FREE SCANRivalsWhat did my competitors do last night?Price changes on products matched to yours (owner-confirmable matches).
BILBY PRO (3 RIVALS) · AGENCY (10)SearchIs my store's SEO quietly broken?Missing or duplicate titles, metas and H1s.
BILBY PRO · AGENCY (WEEKLY)AnswerDo AI assistants recommend my store?AI crawlers blocked by robots.txt.
FREE LINE ON EVERY TIER · MONTHLY QUESTIONS ON BILBY PRO AND AGENCY3 · The report
What makes it feel worth $100.
Revenue at risk in dollars, from your own revenue figure or our labelled guess. A filmstrip you can scrub. Fixes that name the app, the theme file or the setting and how long they take. Benchmarks against every store Bilby has visited, with n printed. And a treatment plan matched to the severity of what was found — never a lock icon.
// A REAL REPORT OF THE LABELLED DEMO STORE (FERNWICK & CO.) · EVERY SECTION IS LIVE DATA
4 · Every night after that
Quiet nights stay quiet. The week gets a story.
A P1 or P2 emails you with the screenshot the moment a visit finds it. Resolved emails when it is gone. A nudge at 72 hours if it is still open. Nothing on a quiet night.
What changed, what to do, what to ignore — with every claim linked to the finding it came from. A claim without a citation is dropped before it reaches you. You can read a real one on the scoreboard, where Bilby scores its own store in public.
Prove the store is yours with a code emailed to an address at your domain, an address published on your own site, or a DNS record. Never a theme snippet.
The day before the first charge you get the week's findings and the plain sentence “we charge tomorrow.” One click from any email cancels it. Pricing →
5 · Questions merchants ask
Straight answers, quotable.
How do I know if my Shopify checkout broke?
You usually find out from a customer, or from a quiet sales day. An uptime monitor will not tell you: a store whose add-to-cart button does nothing still answers 200. The reliable way is to visit the buying path in a real browser — home, product, add to cart, cart, checkout — and check the cart actually filled and the checkout page actually loaded. Bilby does that visit every night on desktop and mobile and emails you the screenshot the night it fails; the free scan does it once, right now.
How often does Bilby check my store?
Once a night, at 2 am in your store's own time zone, on desktop (1440×900) and mobile (390×844), from the region closest to your customers. On Bilby Pro the Search check also crawls your sitemap weekly and the Answer check asks ChatGPT, Perplexity and Claude buyer questions monthly. It is not a minute-by-minute pinger; if you need that, run one alongside it.
What happens when Bilby finds a problem?
A P1 or P2 finding emails you once, with the screenshot and the fix named, the night it appears. Nothing is sent again while it stays the same; a nudge comes at 72 hours if it is still open, and a resolved note when it clears. Quiet nights send nothing. A Monday brief tells the week's story with every claim linked to its finding.
Does Bilby place a test order?
No. The visit stops at the payment step, so no order is created, no inventory moves and no payment gateway is touched. That is also why a purchase event itself can't be verified — Bilby verifies the view, add-to-cart and begin-checkout events that precede it, from the tracking platforms' own network requests.
Do I need to install an app or add code to my theme?
No. Bilby is not a Shopify app and never edits your theme. You prove the store is yours with a code emailed to an address at your domain, an address published on your own site, or a DNS record. Bilby then sees exactly what a first-time shopper sees, which is the point.
What does Bilby check every night?
Seven things it checks on one visit: Watch (does the buy path, search, forms and discount codes work; certificate and domain expiry), Money (which tracking events fired on which step), Speed (Core Web Vitals per page, desktop and mobile), Change (what differed from last night — scripts, theme, prices, stock, metadata), and on Bilby Pro, Rivals, Search and Answer. Deterministic checks first; Claude judges a screenshot only where a human eye is needed and must quote its evidence.
// TRY IT ON YOUR STORE
One free night — the whole report, nothing held back, no card.
Scan my store free