Skip to main content

​
How It Works

Siftly intercepts AI bot requests at the edge of your infrastructure — before they even reach your origin server — and logs them for analysis. 
Your Website / CDN
      │
      ▼
  Integration                ┌────────────────-─────────┐
  (Worker / Plugin)    ───▶  │  traffic-ingest-service  │
                             └────────────--────────────┘
AI bots are identified by User-Agent strings. The integration is fire-and-forget — it never adds latency to real user page loads.

​
Prerequisites

Before setting up any integration you need your Organisation ID. Find it in the Siftly dashboard under Settings → Organisation.
Your Organisation ID looks like a UUID: 550e8400-e29b-41d4-a716-446655440000

​
Choose Your Integration

WordPress Plugin

For self-hosted WordPress sites. Upload a ZIP, fill in two fields — done.

Vercel / Netlify Middleware

One file added to any Next.js, SvelteKit, or Astro project.

Cloudflare Worker

Runs at the edge in front of any website regardless of stack.

​
Detected Bots

The following AI crawlers are tracked automatically:
BotCompany
GPTBotOpenAI
ChatGPT-UserOpenAI
ClaudeBotAnthropic
Claude-WebAnthropic
anthropic-aiAnthropic
GooglebotGoogle
bingbotMicrosoft
PerplexityBotPerplexity
YouBotYou.com
CCBotCommon Crawl
BytespiderByteDance
FacebookBotMeta
ApplebotApple
DuckDuckBotDuckDuckGo
BaiduspiderBaidu