AI Bot Log Analyzer
What GPTBot, ClaudeBot and PerplexityBot read on your site, from your server log.
20+ bots·Log read in your browser·No sign-up
Per bot
| Bot | Requests | Status codes |
|---|
Most requested addresses
| Address | Requests | Errors |
|---|
- Requests per bot
- Status codes
- Most requested addresses
- CSV
Is your site visited by AI bots?
Systems such as ChatGPT, Claude and Perplexity read pages on the web with their own bots. The only firm record of these visits is the server’s access log: every line holds the requested address, the status code and the requester’s user agent.
This tool reads the log lines in your browser and picks out AI bots by user agent: which bot came how often, which addresses it requested and how many requests failed. You can set the bots’ access with the Robots.txt Generator and measure whether your brand is named in answers with the AI Visibility Checker.
Which bots the tool recognises.
The tool recognises the user agent names published by AI companies and also counts search engine bots for comparison. Google-Extended is a permission token, so it never appears as its own line in the log; Google’s visits arrive as Googlebot.
A user agent can be faked. For firm verification, the request’s IP address is compared with the ranges the company publishes (Google, Bing, OpenAI and Perplexity publish these lists).
| Type | Bots |
|---|---|
| Training | GPTBot, ClaudeBot, anthropic-ai, CCBot, Bytespider, meta-externalagent |
| AI search | OAI-SearchBot, Claude-SearchBot, PerplexityBot, DuckAssistBot |
| User request | ChatGPT-User, Claude-User, Perplexity-User, MistralAI-User, meta-externalfetcher |
| Other AI | Amazonbot, cohere-ai |
| Search engine | Googlebot, Bingbot, YandexBot, Applebot |
Three things to look for in the log.
- 01
If there are no AI bots
First check robots.txt and the firewall (WAF, CDN bot protection); some services block AI bots by default.
- 02
4xx and 5xx responses
Bot requests that hit errors mean pages that could be cited are not being read; broken addresses are redirected.
- 03
The most requested pages
The pages bots read most are the closest to being cited in AI answers; they are kept current and clear.
More free tools.
- SEO CheckerSEO + GEO Readiness Score, 303 rules
- Google Rank CheckerRank and address, top 100
- Keyword AnalysisVolume, difficulty, ideas and package
- AI Visibility CheckerYour brand in ChatGPT, Gemini and Claude answers
- Schema CheckerJSON-LD gaps, per type
- llms.txt GeneratorAI bots and an llms.txt draft
- DA PA CheckerDA, PA and Spam Score
- SERP Preview ToolTitle and description, by pixel width
- Meta Tag GeneratorTitle, description, Open Graph and X
- Robots.txt GeneratorAI bots included, with a rule tester
- Schema GeneratorFAQ, organisation, local business, article, breadcrumb
- Word CounterWords, characters, reading time, readability
- Keyword Density CheckerOne, two and three-word phrases
- UTM BuilderCampaign links, GA4-ready
- KDV CalculatorKDV inclusive, exclusive, base and withholding
- Discount CalculatorPercent off, rate, reverse and chained discounts
- Percentage CalculatorPercent of, what percent, change and raise
- SEO ROI CalculatorA return-on-investment scenario with your own figures
- ROAS CalculatorROAS, CPA, CPC, CTR and conversion rate
- WhatsApp Link Generatorwa.me link with a message, and a QR code
The bots are coming. Next, getting cited.
GEO work shapes the pages bots read so they become sources in AI answers: clear answers, structured data, trust signals and authority. GEO is part of all our SEO packages.
- AI access
- Quotable content
- GEO in every package
AI bots, what people ask.
The most asked questions about bot visits, access logs and privacy.
Back to the ToolLook in the server’s access log for lines with the user agents GPTBot (training), OAI-SearchBot (ChatGPT search) or ChatGPT-User (user request). The tool counts these lines and shows which addresses they requested.
No. The file and pasted lines are read in your browser and not sent to our server or anywhere else. This matters because logs contain visitors’ IP addresses.
The common Apache and Nginx “combined” format and similar formats that carry the user agent in quotes are read. If a line has no request or status code, it is counted for bot detection only.
It depends on how you want your content used. Blocking training bots does not affect search visibility; blocking AI search bots lowers the chance of being cited in answers.
Yes; anyone can write a user agent. Whether a suspicious visit is genuine is checked by seeing if the IP address falls within the ranges the company publishes.
The tool reads plain text files up to 50 MB. Larger logs are split by date range; compressed files are unpacked first.
Need help?
Reach out, we are here 24/7.
For your questions, project or ideas, our expert team is with you 24/7. The relevant team reviews your request and gets back to you.