Problem#
serverTools is empty where the provider documents built-in tools for the model. Snapshot 2026-10-22.
- grok, mistral, byteplus: 0% of chat rows. xAI documents
web_search and x_search. Mistral documents web search and code interpreter (Conversations API).
- gemini: 41% of chat rows. Empty on gemini-3.5-flash, gemini-3.7-flash, and gemini-3.1-flash-lite-image.
- openai: empty on gpt-4o-search-preview and gpt-4o-mini-search-preview. Both always search the web.
Ask#
- Fill
serverTools from each provider's tool docs, with factSources.
- Where a tool is only on one API surface (for example a Responses or Conversations API), say so in
factSources.
Acceptance#
- The rows above have
serverTools, or a factSources entry that says the provider has none.