User agent category
Filter observability data by the user agent category to understand where your project’s web requests are coming from.
Netlify organizes user-agent request headers into the following categories to help you make sense of where requests to your site are coming from at a high level.
To learn how the User-Agent request header is used to identify browsers, operating systems, and device types, check out the WebMDN docs on the User-Agent header.
| Category | Request header value | Description |
|---|---|---|
| Browser | browser | Mostly human visitors using common browsers. |
| AI Agent | ai-agent | AI chat services (for example, ChatGPT) and other AI tools providing on-demand answers to questions. Typically not high-volume. AI agents are only those that browse a site on demand to answer a user question (for example, when you ask ChatGPT a question and it performs a web search and links back to relevant sources). |
| Page Preview | page-preview | Social networks, chat apps, and other tools fetching links for in-app preview. |
| Crawler | crawler | Bulk indexing and scraping of content by self-declared bots (search engines, AI services, feed generators, and similar). Crawlers read a site in bulk for later searches; some are classic search engines, and some are used by AI providers (for example, OpenAI has both a crawler and separate on-demand fetching of specific pages). |
| Tooling | tooling | CURL requests, monitoring tools, custom scripts, and other automated programs. |
| Not provided | TBD | Not all requests include a user agent request header. |
| Other | other | Unique user-agents that Netlify hasn’t categorized, typically from specialized browsers or mobile apps. Rare for most customers. |
For more information, check out Netlify’s docs on User-Agent header value categories.
Did you find this doc useful?
Your feedback helps us improve our docs.