Skip to content
Source
Sign inSign up
TanStack/schemas

Gap report: score image, video and audio rows, unclassified rows and origin links #714

Send to my agent
Closedtombeckenham opened this issue 0 comments
tombeckenhamcommented

Problem

The gap report and completeness on GET /v1/status score chat rows only (src/lib/completeness.ts). Snapshot 2026-11-21, 7,885 live rows:

  • 3,424 rows are chat. The other 57% have no score.
  • Priced: audio 342/1,617, image 615/950, video 600/926.
  • 687 rows have a null activity (Replicate 314, Fal 175) and count towards no fact.
  • sameAs is set on 884 rows and is not scored. 221 of 315 non-Anthropic Claude rows have no link.

Ask

  • Add a fact set per activity. Start image, video and audio with priced, endpoint, input modalities and output modalities.
  • Count null-activity rows as a gap on every provider, not only on providers that serve chat.
  • Add an origin-link fact: a row needs a link when its normalised raw id matches a row at another provider, and has one when sameAs is set.
  • Show the new columns in pnpm run gap:report -- --table and serve the per-activity scores on /v1/status.

Acceptance

  • A provider with no chat rows (Cartesia, ElevenLabs) has a score.
  • The report shows origin-link coverage per provider.
  • docs/source-silent/README.md lists the new fact keys.
  1. tombeckenham linked this to #729

  2. tombeckenham closed this

Sign in to join this conversation.