Setup
To start tracking crawler traffic, install the Superlines tracking script on your website. The Crawler Traffic tab on the Overview Dashboard provides setup instructions with platform-specific guides for:- Standard websites — JavaScript snippet
- Webflow, WordPress, Shopify, Next.js — platform-specific instructions
- Netlify, Vercel — Edge Functions setup
For detailed setup instructions, see the AI Crawler Analytics documentation.
Crawlers tab
KPI cards
| Card | What it shows |
|---|---|
| Top Crawler | The most active bot visiting your site |
| Top URL | The page receiving the most bot traffic |
| Top Category | The most common bot category |
| Top Country | Where most bot traffic originates |
Charts and tables
- Bot Traffic Trend — total bot traffic over time, or broken down by individual bot
- Top Bots — ranked table of bots with name, label, category, visit count, and percentage share
- Top Crawled Pages — which pages bots visit most, with both bot and human visit counts
- Bot Categories — pie chart and table showing the distribution of bot types
- Bots by Country — geographic distribution of crawler traffic
Visitors tab
Human traffic analytics for comparison with bot activity:KPI cards
| Card | What it shows |
|---|---|
| Visitors | Unique visitors (by IP) |
| Pageviews | Total page views |
| Top Country | Where most human traffic originates |
| Top Referral | Most common referral source |
Charts and tables
- Traffic Trend — visitors and pageviews over time
- Top Pages — most visited pages
- Top Referrers — where your visitors come from
- Visitors by Country — geographic breakdown
- Visitors by Device — Mobile, Tablet, Desktop distribution
- Visitors by Browser — Chrome, Safari, Firefox, Edge, etc.
Human vs Bot tab
A direct comparison view showing:- Total Visits — combined human and bot visits
- Bot Visits — absolute bot visit count
- Human Visits — absolute human visit count
- Bot Percentage and Human Percentage — relative shares
- Human vs Bot Trend — chart comparing traffic over time
- Top Bots — ranked list of most active bots
AI Bot Data tab
Focused specifically on AI-related bot activity:Citation stats
Cards showing activity from specific AI bots:- ChatGPT Citations
- Perplexity Bot activity
- Claude Bot activity
- Copilot activity
AI-specific analytics
- Top Pages — pages most visited by AI bots
- Citation Sources — which AI services are citing your content
- AI Bot Traffic Trend — traffic split between training bots and search bots
- AI Crawlers — individual bot activity (OAI-SearchBot, GPTBot, ClaudeBot, PerplexityBot, etc.)
- Traffic Split — visualization of training vs. search bot proportions
Filters
Each tab has relevant filters:- Crawlers tab — filter by Bot, Country, Page
- Visitors tab — filter by Page, Referrer, Device, Browser, Country
- Human vs Bot tab — filter by Bot, Country
Exporting data
All tables support CSV and JSON export via the export dropdown.Related pages
AI Crawler Analytics
Conceptual guide to AI crawler tracking.
GA4 AI Traffic
Track AI traffic using Google Analytics data.
Site Health
Monitor page-level health and AI readiness.
Overview Dashboard
Crawler traffic summary in the Overview.