Skip to content

User agent category

Filter observability data by the user agent category to understand where your project’s web requests are coming from.

Netlify organizes user-agent request headers into the following categories to help you make sense of where requests to your site are coming from at a high level.

To learn how the User-Agent request header is used to identify browsers, operating systems, and device types, check out the WebMDN docs on the User-Agent header.

CategoryRequest header valueDescription
BrowserbrowserMostly human visitors using common browsers.
AI Agentai-agentAI chat services (for example, ChatGPT) and other AI tools providing on-demand answers to questions. Typically not high-volume. AI agents are only those that browse a site on demand to answer a user question (for example, when you ask ChatGPT a question and it performs a web search and links back to relevant sources).
Page Previewpage-previewSocial networks, chat apps, and other tools fetching links for in-app preview.
CrawlercrawlerBulk indexing and scraping of content by self-declared bots (search engines, AI services, feed generators, and similar). Crawlers read a site in bulk for later searches; some are classic search engines, and some are used by AI providers (for example, OpenAI has both a crawler and separate on-demand fetching of specific pages).
ToolingtoolingCURL requests, monitoring tools, custom scripts, and other automated programs.
Not providedTBDNot all requests include a user agent request header.
OtherotherUnique user-agents that Netlify hasn’t categorized, typically from specialized browsers or mobile apps. Rare for most customers.

For more information, check out Netlify’s docs on User-Agent header value categories.