Simon Willison · · 1 min read

datasette-ip-rate-limit 0.1a0

Mirrored from Simon Willison for archival readability. Support the source by reading on the original site.

14th May 2026

Release datasette-ip-rate-limit 0.1a0 — Rate limit Datasette requests by client IP address

The datasette.io site was being hammered by poorly-behaved crawlers, so I had Codex (GPT-5.5 xhigh) build a configurable rate limiting plugin to block IPs that were hammering specific areas of the site too quickly.

Here's the production configuration I'm using on that site for the new plugin:

  datasette-ip-rate-limit:
    header: Fly-Client-IP
    max_keys: 10000
    exempt_paths:
    - "/static/*"
    - "/-/turnstile*"
    rules:
    - name: public-demo-multi-parameter-table-pages
      paths:
      - "/global-power-plants/*"
      - "/legislators/*"
      window_seconds: 60
      max_requests: 60
      block_seconds: 20
Posted 14th May 2026 at 4:10 am

Recent articles

This is a beat by Simon Willison, posted on 14th May 2026.

rate-limiting 11 datasette 1483 codex 48

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from Simon Willison