For the complete Netlify documentation index, see llms.txt. Markdown versions of this page are available by appending .md to the URL. Filter observability data by the user agent category to understand where your project’s web requests are coming from.
Netlify organizes user-agent request headers into the following categories to help you make sense of where requests to your site are coming from at a high level.
To learn how the User-Agent request header is used to identify browsers, operating systems, and device types, check out the WebMDN docs on the User-Agent header.
| Category | Request header value | Description |
|---|---|---|
| Browser | browser | Mostly human visitors using common browsers. |
| AI Agent | ai-agent | AI chat services (for example, ChatGPT) and other AI tools providing on-demand answers to questions. Typically not high-volume. AI agents are only those that browse a site on demand to answer a user question (for example, when you ask ChatGPT a question and it performs a web search and links back to relevant sources). |
| Page Preview | page-preview | Social networks, chat apps, and other tools fetching links for in-app preview. |
| Crawler | crawler | Bulk indexing and scraping of content by self-declared bots (search engines, AI services, feed generators, and similar). Crawlers read a site in bulk for later searches; some are classic search engines, and some are used by AI providers (for example, OpenAI has both a crawler and separate on-demand fetching of specific pages). |
| Tooling | tooling | CURL requests, monitoring tools, custom scripts, and other automated programs. |
| Not provided | TBD | Not all requests include a user agent request header. |
| Other | other | Unique user-agents that Netlify hasn’t categorized, typically from specialized browsers or mobile apps. Rare for most customers. |
For more information, check out Netlify’s docs on User-Agent header value categories.
Did you find this doc useful?
Your feedback helps us improve our docs.