Architecture & Capabilities
Q: Does the /scrape endpoint execute JavaScript or bypass anti-bot protections?
No. To keep the cost at exactly $0.001 and response times under 500ms, the scraper performs a raw HTTP fetch from the edge. It does not spin up a headless browser, and it will not bypass Datadome or Turnstile. It is designed for fast, cheap extraction of standard static/SSR web pages, blogs, and documentation.
Q: What types of websites CANNOT be scraped?
- Client-Side Rendered SPAs (React, Vue) - Will only return the blank HTML skeleton.
- Hardened Anti-Bot Firewalls - Strict Cloudflare "Under Attack", Akamai, etc., will return a 403.
- Authenticated/Paywalled Pages - Will return the login screen text.
- Non-HTML Files - Cannot process direct links to PDFs, images, or JSON APIs.
- Internal Networks - Cannot resolve private IPs (e.g., 192.168.x.x, localhost).
Q: What is the context window for the /condense endpoint?
To ensure the OpenAI OSS 20B model stays fast and avoids context overflow, the API automatically truncates the scraped Markdown to the first 8,000 characters before passing it to the LLM. It will not fail on massive pages, but it will only condense the top portion.
Payments & x402 Protocol
Q: Why use TransferWithAuthorization instead of a standard USDC transfer?
Gas and speed. If your agent executes a standard on-chain transfer before every API call, it has to pay Base network gas fees and wait for block confirmations. By signing an off-chain payload, the API call happens instantly. Quickbrew acts as the relayer, batching signatures on-chain later, so your agent pays zero gas.
Q: What happens if the target URL 404s or times out? Do I lose my $0.001?
No, your funds are safe. We only settle signatures on-chain for successful requests. If a target site blocks us, our API returns an error and discards your signature. However, your nonce is immediately burned in our edge KV store to prevent replay attacks, so your agent will need to generate a new nonce to retry.
Q: Are there rate limits per wallet or IP address?
Quickbrew runs entirely on Cloudflare Workers, meaning our infrastructure scales automatically at the edge. We do not currently throttle by wallet address. The only bottleneck will be whether the *target* website rate-limits our worker IPs for hitting them too fast.
Integration
Q: Is there a Python SDK?
The official NPM package (quickbrew-node-client) is Node.js only, but Quickbrew is just standard HTTP and EIP-712 cryptography. We provide a drop-in raw Python script on the homepage using eth_account and requests. You can integrate it into LangChain or AutoGPT in about 15 lines of code.