Skip to content

AI crawlers

The machines reading your site

AI services fetch, index and train on websites every day. Record those requests from your server and see who is reading your site and why, kept apart from your human visitors.

  • Requests by provider
  • Training, indexing and fetches
  • Kept out of visitor counts

See the machines reading your site

AI services visit websites to answer questions, build search indexes and train their models. Record those requests from your server and WebTrack shows which providers came, what they read and how often.

Know why they came

Each request is filed by its purpose: a fetch to answer someone’s question, indexing for search, training, or general crawling. The difference matters when you decide what to allow.

Kept out of your visitor numbers

Crawler requests sit on their own page and never count as visitors, page views or sessions, so your human figures stay human.

Why does this need my server?

Most crawlers do not run the script in a web page, so a browser can never see them. Your server or hosting edge sees every request, and your developer sends WebTrack the ones that come from AI services.

Works closely with

Acquisition counts the people AI assistants send you, and Installation covers the server side that records crawlers.

See it on your own website

WebTrack comes with your website. Sign in to see AI crawlers with your own numbers, or ask us to set it up for your site.

Sign inAsk about WebTrack