TOLL

What software pays for, recorded every six hours.

Snapshot
2026-09-15 21:20 UTC
Sweep
daily-2026-09-15 · finished 2026-09-15 07:10 UTC
Listed
16,178

crawl check derived

crawl-preflight.postnov01.workers.devScrapingderived

GET https://crawl-preflight.postnov01.workers.dev/crawl-check/:domain

faillisted in Coinbasecounted above 37% of Scraping

0.02 USDC

per call, as the listing declares it on eip155:8453

Compare with anotherEvery figure as JSONCite this page

the price, as of 2026-09-15 21:20 UTC · method · pinnable

Validation state
fail
as of 2026-09-15 06:36 UTC · method · pinnable · sweep daily-2026-09-15
Uptime, 7 / 30 / 90 days
0% / 0% / 0%
as of 2026-09-15 06:36 UTC · method · pinnable · 0 of 5 in 7d, 0 of 5 in 30d, 0 of 5 in 90d
Calls, trailing 30 days
2
as of 2026-09-15 21:20 UTC · method · pinnable
Unique payers, trailing 30 days
1
as of 2026-09-15 21:20 UTC · method · pinnable
Last called
2026-08-31 09:40 UTC
as of 2026-09-15 21:20 UTC · method · pinnable
First observed by TOLLderived
2026-09-10
as of 2026-09-10 19:08 UTC · method · pinnable · observation began 10 September 2026; listings that predate it show that date
Pricederived
0.02 USDC
as of 2026-09-15 21:20 UTC · method · pinnable · on eip155:8453
Networks
3
as of 2026-09-15 21:20 UTC · method · pinnable

Counters

29 observations, 1 of them a change, fewer than the 3 a trace needs

How big is this endpoint among the ones like it?

1 call100,000this endpoint
Calls counted in the trailing thirty days across the 615 endpoints in Scraping that carry counters, binned on a logarithmic scale because the range runs over five orders of magnitude. The marked bin is this endpoint, at 2: 253 in the category are counted higher and 361 lower.

No trace is drawn of this endpoint’s own volume. Its counters have changed 1 time across 29 observations, and 3 changes are the fewest this site will draw a trace through, because two points and a guess are not a series. Every observation is in the JSON.

In words

crawl check answered HTTP 400 rather than 402 at the sweep of 2026-09-15; the recorded state is fail.

TOLL files crawl check under scraping: a GET endpoint on crawl-preflight.postnov01.workers.dev, listed in the Coinbase registry.

On Base, crawl check asks 0.02 USDC per call.

Requests carry the path parameter domain.

crawl check accepts payment on Base, Polygon and Arbitrum, 3 options in all, all to one wallet.

A response from crawl check, as declared, includes domain, reason, robots, crawl_surface, infrastructure and recommendation.

crawl check drew 2 calls from one payer in the trailing 30 days.

The last call to crawl check came 15 days before the snapshot, 2026-08-31.

No other listing shares its host.

crawl check is priced above 63% of comparable listings in scraping.

Closest in price to crawl check within scraping: web read at api.x402node.dev and research at api.clawfetch.ai.

The payee wallet of crawl check appears on no other listing.

The seller's tags on crawl check are crawl, robots, web and preflight.

The price of crawl check is declared by 43 other listings in scraping too.

Payment options as declared

the payment options, as of 2026-09-15 21:20 UTC · method · pinnable

Every payment option declared on this listing
registrynetworkassetamountschemepay to
Coinbaseeip155:8453USDC0.02 USDCexact0x02d15E…0B2bC2
Coinbaseeip155:137USDC0.02 USDCexact0x02d15E…0B2bC2
Coinbaseeip155:42161USDC0.02 USDCexact0x02d15E…0B2bC2

Preflight checks at the last sweep

the checks, as of 2026-09-15 06:36 UTC · method · pinnableendpoint answered HTTP 400

  • returns_402 · an unauthenticated request gets HTTP 402

Validation history, 90 days

Every sweep that observed this endpoint, newest first.

Validation observations over the last 90 days
observed, UTCstatefailed checkssweep
2026-09-15 06:36 UTCfail1daily-2026-09-15
2026-09-14 06:05 UTCfail1daily-2026-09-14
2026-09-13 05:57 UTCfail1daily-2026-09-13
2026-09-12 08:14 UTCfail1daily-2026-09-12
2026-09-11 12:35 UTCfail1daily-2026-09-11

Registry presence

Presence in a registry, not liveness of the service (method). Newest first.

  1. listed in Coinbase

Declared input and output, as listed

From the registry record, not validated by TOLL.the declared schema, as of 2026-08-31 09:40 UTC · method · live

The input and output block
{
  "input": {
    "type": "http",
    "method": "GET",
    "pathParams": {
      "domain": "sitepoint.com"
    },
    "queryParams": {}
  },
  "output": {
    "type": "json",
    "example": {
      "domain": "example.com",
      "reason": "No AI crawler restrictions declared.",
      "robots": {
        "present": true,
        "blocks_all_agents": false,
        "ai_crawlers_allowed": 16,
        "ai_crawlers_blocked": []
      },
      "crawl_surface": {
        "pages": 28400,
        "is_estimate": true,
        "sitemaps_found": 2
      },
      "infrastructure": {
        "cdn": [
          "Cloudflare"
        ],
        "paid_access": []
      },
      "recommendation": "fetch"
    }
  }
}
Cite this page

The pinned URL below renders this page from the snapshot of 2026-09-15 21:20 UTC and does not change; the live page does, every six hours. Data reuse is under CC BY 4.0 (terms).

Plain text

TOLL, "crawl check on crawl-preflight.postnov01.workers.dev", snapshot of 2026-09-15 21:20 UTC. https://tollindex.com/e/crawl-preflight-postnov01-workers-dev-crawl-check-domain-d03236/at/2026-09-15T21-20Z. Accessed [access date].

BibTeX

@misc{toll-e-crawl-preflight-postnov01-workers-dev-crawl-check-domain-d03236-2026-09-15T21-20Z,
  author = {TOLL},
  title = {crawl check on crawl-preflight.postnov01.workers.dev},
  howpublished = {\url{https://tollindex.com/e/crawl-preflight-postnov01-workers-dev-crawl-check-domain-d03236/at/2026-09-15T21-20Z}},
  year = {2026},
  month = {9},
  note = {Pinned view of the snapshot of 2026-09-15 21:20 UTC. Accessed [access date].}
}

Reports and replies about this endpoint

None yet. Anything submitted through the form below is published here with its outcome.

Report an error about crawl check, or reply as the named seller

No account, no token. Published unedited with its outcome, upheld or not. Do not include personal data.

Kind

Published as typed. Optional.

10 to 4,000 characters.

Verify with the payee wallet (optional, EVM)

Sign this message with the wallet named on the page and paste the signature; it is checked, stored, never published. TOLL reply about endpoint d032363f55b0ec9583cf9c3e08d56b59bb2e9cf94995b0be972d0d9c2b91aeea from wallet 0x02d15E7f25d29743c27021d32a7B280d760B2bC2

The 0x address named as payee on this page, 42 characters.

The hex signature of the message above, starting 0x.