OpenClaw Maturity Scorecard Taxonomy: Surfaces, Categories, Capabilities, Evidence
This page details the product areas and checks behind the OpenClaw maturity scorecard. It explains the hierarchy of surfaces, categories, capabilities, and evidence, and defines maturity levels from Planned to Beta.
Maturity taxonomy
The structure behind the scorecard
Surfaces > categories > capabilities > evidence.
50 surfaces are grouped into 4 families, and every category links back to canonical documentation and QA coverage IDs.
Browse product areas / Open detailed taxonomy / View scores
How to read this page
A surface is a product area like Gateway runtime, Discord, or the macOS app. Each surface contains categories, and each category holds the capability-level checks that QA scenarios cover. Use the scorecard for release-level decisions; use this page to inspect the model underneath it.
Maturity levels
M0 Planned Direction is known, but no supported user path exists. Promotion: Design issue, owner, and target surface exist.
M1 Experimental Implemented behind caveats, flags, source builds, or maintainer-only flows. Promotion: Maintainer can run the scenario from current main.
M2 Alpha Real users can try it, but breaking changes and incomplete UX are expected. Promotion: Documented setup, basic tests, known caveats, and at least one real-environment proof.
M3 Beta Public path exists and the main workflow is usable with bounded caveats. Promotion: Install/update docs, regression tests, support runbook, and successful scenario proof across the expected environment.
M4 Stable Recommended path for normal users. Failures are treated as regressions. Promotion: Release gate, doctor/troubleshooting path, broad docs, and repeated real-world proof.
M5 Clawesome Polished, delightful, well-instrumented, and competitive with the best comparable workflow. Promotion: Stable plus user scorecard pass across representative users.
Product areas
Core
CLI M4 Stable 7 areas - 90% complete
Gateway runtime M4 Stable 13 areas - 89% complete
Agent Runtime M3 Beta 9 areas - 79% complete
Session, memory, and context engine M3 Beta 9 areas - 79% complete
Channel framework M3 Beta 8 areas - 79% complete
Observability M3 Beta 5 areas - 79% complete
Gateway Web App M3 Beta 6 areas - 79% complete
Plugins M3 Beta 9 areas - 79% complete
Security, auth, pairing, and secrets M3 Beta 6 areas - 79% complete
Automation: cron, hooks, tasks, polling M3 Beta 6 areas - 79% complete
Media understanding and media generation M2 Alpha 6 areas - 68% complete
Voice and realtime talk M2 Alpha 6 areas - 68% complete
TUI M2 Alpha 5 areas - 66% complete
ClawHub M2 Alpha 4 areas - 62% complete
OpenClaw App SDK M2 Alpha 6 areas - 53% complete
Platform
Linux Gateway host M4 Stable 5 areas - 89% complete
macOS Gateway host M4 Stable 7 areas - 88% complete Android app M4 Stable 7 areas - 80% complete iOS app M4 Stable 8 areas - 80% complete
Docker and Podman hosting M3 Beta 4 areas - 79% complete
Windows via WSL2 M3 Beta 6 areas - 79% complete
Raspberry Pi and small Linux devices M3 Beta 4 areas - 79% complete
macOS companion app M3 Beta 8 areas - 78% complete
Native Windows M2 Alpha 4 areas - 66% complete
Kubernetes hosting M2 Alpha 4 areas - 61% complete
Nix install path M1 Experimental 5 areas - 44% complete
watchOS companion surfaces M1 Experimental 5 areas - 44% complete
Linux companion app M0 Planned 5 areas - 21% complete
Native Windows companion app M0 Planned 5 areas - 21% complete
Channel
Discord M4 Stable 6 areas - 87% complete
Telegram M3 Beta 5 areas - 78% complete
Slack M3 Beta 5 areas - 78% complete
iMessage and BlueBubbles M3 Beta 5 areas - 78% complete
WhatsApp M3 Beta 5 areas - 78% complete
Matrix M2 Alpha 6 areas - 67% complete
Google Chat M2 Alpha 5 areas - 66% complete
Microsoft Teams M2 Alpha 5 areas - 66% complete
Signal M2 Alpha 5 areas - 66% complete
Voice Call channel M1 Experimental 5 areas - 44% complete
Provider and tool
Browser automation, exec, and sandbox tools M3 Beta 3 areas - 79% complete
OpenAI and Codex provider path M3 Beta 5 areas - 79% complete
Web search tools M3 Beta 4 areas - 79% complete
Anthropic provider path M3 Beta 5 areas - 78% complete
Google provider path M3 Beta 5 areas - 78% complete
OpenRouter provider path M3 Beta 4 areas - 78% complete
Image, video, and music generation tools M2 Alpha 5 areas - 68% complete
Local model providers: Ollama, vLLM, SGLang, LM Studio M2 Alpha 5 areas - 68% complete
Long-tail hosted providers M2 Alpha 3 areas - 68% complete
Details
Core
CLI - M4 Stable - 7 areas
Normal setup and repair paths are documented across install, CLI, and gateway docs. Platform-specific Windows paths are tracked in the Windows via WSL2 and Native Windows rows.
Coverage Experimental - 4% Quality Stable - 83% Completeness Stable - 90% Partial - 6
Area Coverage Quality Completeness Docs
CLI Setup 6 capabilities / LTS-supported
Experimental 17%
Stable 89%
Stable 90%
Index, Installer, Node, Updating
Onboarding and Auth Setup 5 capabilities / LTS-supported
Experimental 0%
Beta 75%
Stable 89%
Onboard, Configure, Onboarding Overview
Plugin and Channel Setup 5 capabilities
Experimental 0%
Beta 75%
Stable 89%
Gateway Service Management 5 capabilities / LTS-supported
Experimental 14%
Stable 87%
Stable 90%
Gateway, Updating, Troubleshooting
CLI Observability 5 capabilities / LTS-supported
Experimental 0%
Stable 89%
Stable 90%
Status, Health, Logs, Diagnostics
Doctor 10 capabilities / LTS-supported
Experimental 0%
Stable 89%
Stable 90%
Doctor, Doctor, Secrets, Troubleshooting
Updates and Upgrades 5 capabilities / LTS-supported
Experimental 0%
Beta 75%
Stable 89%
Updating, Update, Troubleshooting
Gateway runtime - M4 Stable - 13 areas
Core architecture, auth, pairing, protocol docs, daemon docs, and CLI runbooks are broad and current.
Coverage Experimental - 6% Quality Stable - 81% Completeness Stable - 89% Partial - 12
Area Coverage Quality Completeness Docs
Approvals and Remote Execution 6 capabilities / LTS-supported
Experimental 0%
Beta 75%
Stable 89%
HTTP APIs 4 capabilities / LTS-supported
Experimental 25%
Stable 90%
Stable 90%
Index, Openai Http Api, Openresponses Http Api, Tools Invoke Http Api, Hooks, Index
Hosted Web Surface 4 capabilities / LTS-supported
Experimental 0%
Stable 89%
Stable 90%
Index, Architecture, Control Ui, Webchat, Canvas
Gateway RPC APIs and Events 20 capabilities / LTS-supported
Experimental 9%
Stable 90%
Stable 90%
Device Auth and Pairing 10 capabilities / LTS-supported
Experimental 0%
Beta 75%
Stable 89%
Network Access and Discovery 6 capabilities / LTS-supported
Experimental 0%
Beta 75%
Stable 89%
Nodes and Remote Capabilities 8 capabilities
Experimental 0%
Beta 75%
Stable 89%
Health, Diagnostics, and Repair 7 capabilities / LTS-supported
Experimental 0%
Beta 75%
Stable 89%
Protocol Compatibility 7 capabilities / LTS-supported
Experimental 0%
Beta 75%
Stable 89%
Protocol, Architecture, Typebox, Bridge Protocol
Roles and Permissions 5 capabilities / LTS-supported
Experimental 0%
Beta 75%
Stable 89%
Gateway Lifecycle 7 capabilities / LTS-supported
Experimental 33%
Stable 90%
Stable 90%
Security Controls 6 capabilities / LTS-supported
Experimental 0%
Beta 75%
Stable 89%
WebSocket Connection 8 capabilities / LTS-supported
Experimental 13%
Stable 90%
Stable 90%
Agent Runtime - M3 Beta - 9 areas
Main loop, models, provider routing, and tool streaming are first-class, but provider behavior shifts weekly and needs scenario proof per release.
Coverage Experimental - 33% Quality Beta - 78% Completeness Beta - 79% Partial - 6
Area Coverage Quality Completeness Docs
Agent Turn Execution 3 capabilities / LTS-supported
Experimental 29%
Beta 79%
Beta 79%
Agent Loop, Agent, Agent Runtimes
External Runtimes and Subagents 4 capabilities
Experimental 30%
Beta 79%
Beta 79%
Agent Runtimes, Anthropic, Google, Subagents
Hosted Provider Execution 5 capabilities / LTS-supported
Experimental 20%
Beta 79%
Beta 79%
OpenAI, Anthropic, Google, Models
Local and Self-hosted Providers 5 capabilities
Experimental 0%
Alpha 68%
Beta 79%
Model and Runtime Selection 4 capabilities / LTS-supported
Experimental 25%
Beta 79%
Beta 79%
Models, Models, OpenAI, Agent Runtimes
Provider Auth 10 capabilities / LTS-supported
Experimental 24%
Beta 79%
Beta 79%
Models, Agent, Models, OpenAI, Anthropic, Google, Subagents
Streaming and Progress 2 capabilities
Alpha 56%
Beta 79%
Beta 79%
Tool Calls and Response Handling 3 capabilities / LTS-supported
Alpha 65%
Beta 79%
Beta 79%
Tool Execution Controls 6 capabilities / LTS-supported
Alpha 50%
Beta 79%
Beta 79%
Sandbox Vs Tool Policy Vs Elevated, Agent Loop, Subagents
Session, memory, and context engine - M3 Beta - 9 areas
Strong docs and active implementation. Maturity depends on transcript durability, compaction quality, and cross-client parity.
Coverage Experimental - 30% Quality Beta - 77% Completeness Beta - 79% Partial - 6
Area Coverage Quality Completeness Docs
CLI Session and Transcript Management 2 capabilities / LTS-supported
Experimental 0%
Alpha 68%
Beta 79%
Session, Session Management Compaction, Sessions
Token Management 3 capabilities / LTS-supported
Experimental 20%
Beta 79%
Beta 79%
Compaction, Context, Session Management Compaction
Context Engine 2 capabilities / LTS-supported
Alpha57%
Beta79%
Beta79%
Cross-client History and Session Parity 2 capabilities
Experimental40%
Beta79%
Beta79%
Webchat, Android, Channel Routing
Diagnostics, Maintenance, and Recovery 3 capabilities
Experimental40%
Beta79%
Beta79%
Diagnostics, Session Management Compaction, Flags
Core Prompts and Context 2 capabilities / LTS-supported
Experimental38%
Beta79%
Beta79%
Context, Transcript Hygiene, Discord
Memory 5 capabilities
Experimental46%
Beta79%
Beta79%
Memory Config, Memory Qmd, Memory, Discord
Session Routing 2 capabilities / LTS-supported
Experimental25%
Beta79%
Beta79%
Session, Channel Routing, Discord
Transcript Persistence 2 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Session Management Compaction, Transcript Hygiene
Channel framework - M3 Beta - 8 areas
Delivery and routing contracts are shared across many channels, but upstream API and account policy constraints cause differences in channel behavior.
Coverage Experimental - 13%Quality Beta - 76%Completeness Beta - 79%Partial - 5
AreaCoverageQualityCompletenessDocs
Channel Actions Commands and Approvals 5 capabilities
Experimental0%
Beta79%
Beta79%
Groups, Discord, Google Chat, Signal, Matrix
Channel Setup 5 capabilities / LTS-supported
Experimental14%
Beta79%
Beta79%
Index, Pairing, Troubleshooting, Sdk Channel Plugins
Group Thread and Ambient Room Behavior 5 capabilities
Experimental36%
Beta79%
Beta79%
Groups, Group Messages, Ambient Room Events, Broadcast Groups, Discord
Inbound Access and Identity Gates 5 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Access Groups, Groups, Discord, Line
Media Attachments and Rich Channel Data 4 capabilities
Experimental0%
Alpha68%
Beta79%
Line, Signal, Google Chat, Matrix, Discord
Outbound Delivery and Reply Pipeline 4 capabilities / LTS-supported
Experimental38%
Beta79%
Beta79%
Groups, Ambient Room Events, Discord, Matrix, Config Channels
Conversation Routing and Delivery 10 capabilities / LTS-supported
Experimental19%
Beta79%
Beta79%
Channel Routing, Groups, Discord, Matrix, Troubleshooting, Configuration Reference
Status Health and Operator Controls 4 capabilities / LTS-supported
Experimental0%
Beta79%
Beta79%
Health, Configuration Reference, Troubleshooting, Discord
Observability - M3 Beta - 5 areas
OTel, Prometheus, logging, and diagnostics docs exist. A public maturity pass for "what operators should look at first" is needed.
Coverage Experimental - 18%Quality Beta - 75%Completeness Beta - 79%Partial - 3
AreaCoverageQualityCompletenessDocs
Health and Repair 12 capabilities / LTS-supported
Experimental28%
Beta79%
Beta79%
Health, Telegram, Doctor, Doctor, Sdk Subpaths, Health, Protocol
Logging 5 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Diagnostic Collection 8 capabilities
Experimental30%
Beta79%
Beta79%
Diagnostics, Health, Codex Harness, Protocol
Telemetry Export 13 capabilities
Experimental33%
Beta79%
Beta79%
Hooks, Opentelemetry, Logging, Sdk Subpaths, Diagnostics Otel, Prometheus, Diagnostics Prometheus
Session Diagnostics 4 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Opentelemetry, Prometheus, Diagnostics, Protocol
Gateway Web App - M3 Beta - 6 areas
Web UI is documented with pairing, chat, PWA, Talk, push, and remote Gateway flows. Promote after cross-browser and mobile-PWA scorecards are completed.
Coverage Experimental - 4%Quality Beta - 74%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Browser Realtime Talk 5 capabilities
Experimental0%
Alpha68%
Beta79%
Browser Access and Trust 5 capabilities
Experimental0%
Alpha68%
Beta79%
Control Ui, Dashboard, Tailscale, Remote
Configuration 5 capabilities
Experimental0%
Alpha68%
Beta79%
Browser UI 10 capabilities
Experimental8%
Beta79%
Beta79%
Control Ui, Index, Dashboard, Protocol
WebChat Conversations 15 capabilities
Experimental10%
Beta79%
Beta79%
Control Ui, Webchat, Getting Started, Channel Routing, Secure File Operations
Operator Console 10 capabilities
Experimental8%
Beta79%
Beta79%
Control Ui, Health, Protocol, Dashboard
Plugins - M3 Beta - 9 areas
Broad docs and strong internal runtime evidence exist across manifests, discovery, loading, provider/tool architecture, and approval boundaries. Keep the row at beta until public SDK API/subpaths and external distribution proof are stronger.
Coverage Experimental - 12%Quality Beta - 72%Completeness Beta - 79%Partial - 7
AreaCoverageQualityCompletenessDocs
Authoring and Packaging plugins 8 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Building Plugins, Sdk Overview, Sdk Entrypoints, Sdk Subpaths, Manifest, Reference
Bundled plugins 5 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Plugin Inventory, Plugins, Architecture Internals
Canvas plugin 6 capabilities
Experimental0%
Alpha68%
Beta79%
Canvas, Canvas, Configuration Reference
Installing and running plugins 6 capabilities / LTS-supported
Experimental35%
Beta79%
Beta79%
Architecture, Architecture Internals, Plugins
Channel plugins 5 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Sdk Channel Plugins, Sdk Channel Inbound, Sdk Channel Outbound
Provider and tool plugins 6 capabilities / LTS-supported
Experimental43%
Beta79%
Beta79%
Sdk Provider Plugins, Tool Plugins, Adding Capabilities
Plugin approvals 6 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Plugin Permission Requests, Exec Approvals, Sdk Channel Plugins
Publishing plugins 6 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Plugins, Compatibility, Publishing
Testing plugins 6 capabilities
Experimental27%
Beta79%
Beta79%
Sdk Testing, Sdk Setup, Codex Harness
Security, auth, pairing, and secrets - M3 Beta - 6 areas
Good docs and hardening surfaces exist. Promote after regular upgrade and security scenario runs prove no setup regressions.
Coverage Experimental - 16%Quality Beta - 72%Completeness Beta - 79%Partial - 5
AreaCoverageQualityCompletenessDocs
Approval Policy and Tool Safeguards 2 capabilities / LTS-supported
Alpha50%
Beta79%
Beta79%
Exec Approvals, Approvals, Plugin Permission Requests, Audit Checks
Gateway Auth and Remote Access 9 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Index, Exposure Runbook, Trusted Proxy Auth, Tailscale, Remote, Configuration Reference, Gateway, Doctor, Control Ui, Browser Control, Audit Checks
Channel Access Control 3 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Pairing, Telegram, Access Groups, Audit Checks
Device and Node Pairing 11 capabilities / LTS-supported
Experimental0%
Alpha68%
Beta79%
Protocol, Devices, Pairing, Pairing, Operator Scopes, Control Ui, Webchat, Approvals
Plugin Trust 2 capabilities
Experimental0%
Alpha68%
Beta79%
Manifest, Plugin Permission Requests, Manage Plugins, Audit Checks
Credential and Secret Hygiene 5 capabilities / LTS-supported
Experimental46%
Beta79%
Beta79%
Authentication, Models, OpenAI, Oauth, Secrets, Secrets, Secretref Credential Surface, Audit Checks
Automation: cron, hooks, tasks, polling - M3 Beta - 6 areas
Documented and usable, but scenario proof should cover unattended delivery, retries, and failure visibility.
Coverage Experimental - 2%Quality Beta - 72%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Cron Jobs 15 capabilities
Experimental0%
Beta79%
Beta79%
Cron Jobs, Cron, Protocol, Tasks, Discord
Event Ingress 15 capabilities
Experimental0%
Alpha68%
Beta79%
Telegram, Zalo, Troubleshooting, Imessage From Bluebubbles, Gmail Pubsub Integration, Gmail Pubsub, Webhooks, Webhooks, Webhook
Automation Hooks 11 capabilities
Experimental0%
Alpha68%
Beta79%
Hooks, Hooks, Hooks, Plugin Permission Requests, Sdk Subpaths
Background Tasks and Flows 10 capabilities
Experimental0%
Alpha68%
Beta79%
Tasks, Index, Tasks, Taskflow, Sdk Runtime
Heartbeat 5 capabilities
Experimental14%
Beta79%
Beta79%
Polling Controls 10 capabilities
Experimental0%
Alpha68%
Beta79%
Poll, Message, Telegram, Microsoft Teams, Background Process
Media understanding and media generation - M2 Alpha - 6 areas
A broad capability surface exists, but provider variance, file limits, and node/app parity keep this from being stable yet.
Coverage Experimental - 2%Quality Alpha - 64%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Media Intake and Access 8 capabilities
Experimental0%
Alpha61%
Alpha68%
Media Overview, Media Understanding, Secure File Operations, Pdf, Image Generation, Qr, Line, WhatsApp
Channel Media Handling 5 capabilities
Experimental0%
Alpha61%
Alpha68%
Images, Media Overview, Discord
Media Configuration 1 capabilities
Experimental0%
Alpha61%
Alpha68%
Media Overview, Image Generation, Manifest, Codex Harness
Text-to-Speech Delivery 2 capabilities
Experimental0%
Alpha61%
Alpha68%
Media Understanding 12 capabilities
Experimental7%
Alpha69%
Alpha69%
Audio, Media Understanding, Media Overview, WhatsApp, Images, Infer, Pdf
Media Generation 17 capabilities
Experimental5%
Alpha69%
Alpha69%
Image Generation, Media Overview, Skills, Music Generation, Video Generation
Voice and realtime talk - M2 Alpha - 6 areas
Multiple implementations exist across Control UI, apps, and providers. Latency, failure-mode, and setup scorecards are needed before beta.
Coverage Experimental - 0%Quality Alpha - 61%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Talk Providers 7 capabilities
Experimental0%
Alpha61%
Alpha68%
OpenAI, Google, Sdk Provider Plugins, Talk, Control Ui
Realtime Talk Sessions 11 capabilities
Experimental0%
Alpha61%
Alpha68%
Speech and Transcription 5 capabilities
Experimental0%
Alpha61%
Alpha68%
Native App Talk 4 capabilities
Experimental0%
Alpha61%
Alpha68%
Voice Wake and Routing 4 capabilities
Experimental0%
Alpha61%
Alpha68%
Voicewake, Voicewake, Voice Overlay
Talk Observability 5 capabilities
Experimental0%
Alpha61%
Alpha68%
Control Ui, Voice Overlay, Talk
TUI - M2 Alpha - 5 areas
Present in docs and source, but less visible as a primary user workflow. An explicit scenario definition is needed.
Coverage Experimental - 0%Quality Alpha - 59%Completeness Alpha - 66%None
AreaCoverageQualityCompletenessDocs
Runtime Modes 14 capabilities
Experimental0%
Alpha59%
Alpha66%
Input and Commands 8 capabilities
Experimental0%
Alpha59%
Alpha66%
Session Management 3 capabilities
Experimental0%
Alpha59%
Alpha66%
Local Shell Execution 4 capabilities
Experimental0%
Alpha59%
Alpha66%
Rendering and Output Safety 4 capabilities
Experimental0%
Alpha59%
Alpha66%
Tui, Qr, Logs, Completion
ClawHub - M2 Alpha - 4 areas
Public documentation and an ecosystem concept are available. Still needs scorecards for install, trust, update, rollback, and compatibility.
Coverage Experimental - 0%Quality Alpha - 58%Completeness Alpha - 62%None
AreaCoverageQualityCompletenessDocs
Publishing 7 capabilities
Experimental0%
Alpha54%
Alpha55%
Publishing, Creating Skills, Community
Catalog Discovery 5 capabilities
Experimental0%
Alpha61%
Alpha68%
Plugin, Plugins, Skills, Skills, Community
Compatibility and Trust 12 capabilities
Experimental0%
Alpha55%
Alpha56%
Plugin, Plugins, Compatibility, Plugin Inventory, Publishing, Skills, Skills Config
Plugin Lifecycle and Health 26 capabilities
Experimental0%
Alpha61%
Alpha68%
Plugin, Plugins, Skills, Skills, Protocol, Bundles, Dependency Resolution
OpenClaw App SDK - M2 Alpha - 6 areas
The OpenClaw App SDK is a separate external app contract, distinct from the Gateway runtime and Plugin SDK. Current scoring shows a real @openclaw/sdk path, but gaps remain in public packaging, auto-discovery, approvals, helpers, and compatibility.
Coverage Experimental - 3%Quality Alpha - 54%Completeness Alpha - 53%None
AreaCoverageQualityCompletenessDocs
Client API 4 capabilities
Experimental0%
Alpha51%
Alpha50%
Openclaw Sdk, Openclaw Sdk Api Design
Gateway Access 5 capabilities
Experimental0%
Alpha53%
Alpha54%
Openclaw Sdk, Openclaw Sdk Api Design, Protocol, Index
Agent Conversations 6 capabilities
Experimental0%
Alpha52%
Alpha52%
Openclaw Sdk, Openclaw Sdk Api Design, Protocol
Events and Approvals 5 capabilities
Experimental0%
Alpha52%
Alpha52%
Openclaw Sdk, Openclaw Sdk Api Design, Protocol
Resource Helpers 5 capabilities
Experimental17%
Alpha62%
Alpha53%
Openclaw Sdk, Openclaw Sdk Api Design
Compatibility 5 capabilities
Experimental0%
Alpha54%
Alpha55%
Openclaw Sdk Api Design, Typebox, Protocol
Platform
Linux Gateway host - M4 Stable - 5 areas
The Node runtime is recommended, the systemd user service is documented, and VPS/container guidance is broad.
Coverage Experimental - 0%Quality Beta - 75%Completeness Stable - 89%Partial - 4
AreaCoverageQualityCompletenessDocs
Host Setup and Updates 4 capabilities / LTS-supported
Experimental0%
Beta75%
Stable89%
Gateway Runtime and Service Control 6 capabilities / LTS-supported
Experimental0%
Beta75%
Stable89%
Remote Access and Security 6 capabilities / LTS-supported
Experimental0%
Beta75%
Stable89%
Remote, Tailscale, Exposure Runbook, Authentication, Secrets
Diagnostics and Repair 4 capabilities / LTS-supported
Experimental0%
Beta75%
Stable89%
Status, Logs, Doctor, Diagnostics, Index
Deployment Targets 3 capabilities
Experimental0%
Beta75%
Stable89%
Vps, Docker, Hetzner, Digitalocean, Kubernetes, Podman
macOS Gateway host - M4 Stable - 7 areas
The LaunchAgent service path, local and remote Gateway modes, CLI install, and app integration are all documented.
Coverage Experimental - 0%Quality Beta - 74%Completeness Stable - 88%None
AreaCoverageQualityCompletenessDocs
CLI Setup 4 capabilities
Experimental0%
Beta74%
Stable88%
Macos, Bundled Gateway, Installer, Node
Local Gateway Integration 9 capabilities
Experimental0%
Beta74%
Stable88%
Macos, Bundled Gateway, Remote, Index, Gateway, Bonjour
Remote Gateway Mode 5 capabilities
Experimental0%
Beta74%
Stable88%
Gateway Service Lifecycle 10 capabilities
Experimental0%
Beta74%
Stable88%
Macos, Bundled Gateway, Gateway, Index, Update, Updating, Uninstall, Troubleshooting
Diagnostics and Observability 4 capabilities
Experimental0%
Beta74%
Stable88%
Bundled Gateway, Macos, Gateway, Doctor, Troubleshooting
Permissions and Native Capabilities 4 capabilities
Experimental0%
Beta74%
Stable88%
Profiles and Isolation 5 capabilities
Experimental0%
Beta74%
Stable88%
Multiple Gateways, Index, Gateway
Android app - M4 Stable - 7 areas
An official Google Play distribution exists, source build and run docs are maintained, and the Android app is documented as a standard companion node for users.
Coverage Experimental - 0%Quality Stable - 80%Completeness Stable - 80%None
AreaCoverageQualityCompletenessDocs
Media Capture 1 capabilities
Experimental0%
Stable80%
Stable80%
Mobile Chat 1 capabilities
Experimental0%
Stable80%
Stable80%
Connection Setup 1 capabilities
Experimental0%
Stable80%
Stable80%
Distribution 3 capabilities
Experimental0%
Stable80%
Stable80%
Settings 1 capabilities
Experimental0%
Stable80%
Stable80%
Voice 1 capabilities
Experimental0%
Stable80%
Stable80%
Device Runtime 2 capabilities
Experimental0%
Stable80%
Stable80%
Android, Troubleshooting, Protocol
iOS app - M4 Stable - 8 areas
An official App Store distribution exists, relay-backed push is documented, and the iOS app is documented as a standard companion node for users.
Coverage Experimental - 0%Quality Stable - 80%Completeness Stable - 80%None
AreaCoverageQualityCompletenessDocs
Media and Sharing 1 capabilities
Experimental0%
Stable80%
Stable80%
Canvas and Screen 1 capabilities
Experimental0%
Stable80%
Stable80%
Chat and Sessions 1 capabilities
Experimental0%
Stable80%
Stable80%
Gateway Setup and Diagnostics 7 capabilities
Experimental0%
Stable80%
Stable80%
Distribution 1 capabilities
Experimental0%
Stable80%
Stable80%
Device Commands 2 capabilities
Experimental0%
Stable80%
Stable80%
Notifications and Background 1 capabilities
Experimental0%
Stable80%
Stable80%
Voice 1 capabilities
Experimental0%
Stable80%
Stable80%
Docker and Podman hosting - M3 Beta - 4 areas
Install docs exist and cover common deployment paths. Promote after recurring release smoke captures verify upgrade and volume behavior.
Coverage Experimental - 7%Quality Beta - 71%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Container Setup 6 capabilities
Experimental0%
Alpha68%
Beta79%
Container Operations 11 capabilities
Experimental0%
Alpha68%
Beta79%
Podman, Docker Vm Runtime, Docker, Hetzner, Hostinger
Image Release and Validation 5 capabilities
Experimental29%
Beta79%
Beta79%
Docker, Docker Vm Runtime, Full Release Validation
Agent Sandbox and Tooling 3 capabilities
Experimental0%
Alpha68%
Beta79%
Windows via WSL2 - M3 Beta - 6 areas
The recommended Windows path includes systemd/user-service guidance and boot-chain docs. Promote after repeated install and update scorecards.
Coverage Experimental - 6%Quality Alpha - 69%Completeness Beta - 79%Partial - 5
AreaCoverageQualityCompletenessDocs
WSL Setup 6 capabilities / LTS-supported
Experimental0%
Alpha67%
Beta79%
CLI 8 capabilities / LTS-supported
Experimental0%
Alpha67%
Beta79%
Windows, Getting Started, Updating, Onboard, Doctor, Status, Logs
Gateway Service Lifecycle 10 capabilities / LTS-supported
Experimental0%
Alpha67%
Beta79%
Gateway Access and Exposure 11 capabilities / LTS-supported
Experimental0%
Alpha67%
Beta79%
Authentication, Secrets, Remote, Exposure Runbook, Windows
Diagnostics and Repair 6 capabilities / LTS-supported
Experimental38%
Beta79%
Beta79%
Windows, Status, Logs, Doctor, Doctor
Browser and Control UI 6 capabilities
Experimental0%
Alpha67%
Beta79%
Browser Wsl2 Windows Remote Cdp Troubleshooting, Browser, Control Ui
Raspberry Pi and small Linux devices - M3 Beta - 4 areas
Platform docs exist and the Gateway path is Linux-based. Needs hardware-specific release smoke proof to move higher.
Coverage Experimental - 0%Quality Alpha - 67%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Setup and Compatibility 12 capabilities
Experimental0%
Alpha67%
Beta79%
Raspberry Pi, Index, Faq First Run, Faq, Linux, Installer
Remote Access and Auth 9 capabilities
Experimental0%
Alpha67%
Beta79%
Raspberry Pi, Authentication, Secrets, Pairing, Devices, Remote, Tailscale
Gateway Runtime 10 capabilities
Experimental0%
Alpha67%
Beta79%
Index, Gateway, Raspberry Pi, Linux, Vps
Performance and Diagnostics 5 capabilities
Experimental0%
Alpha67%
Beta79%
Raspberry Pi, Linux, Health, Diagnostics
macOS companion app - M3 Beta - 8 areas
A rich menu bar app with permissions, node mode, Canvas, voice wake, WebChat, and remote mode is available. Still moving too fast to call Stable.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Canvas 4 capabilities
Experimental0%
Alpha66%
Beta78%
Local Setup 7 capabilities
Experimental0%
Alpha66%
Beta78%
Bundled Gateway, Macos, Child Process, Dev Setup
Status and Settings 5 capabilities
Experimental0%
Alpha66%
Beta78%
Menu Bar, Icon, Macos, Health, Logging, Remote
Native Capabilities 5 capabilities
Experimental0%
Alpha66%
Beta78%
Macos, Xpc, Permissions, Signing, Peekaboo
Remote Connections 3 capabilities
Experimental0%
Alpha66%
Beta78%
Voice and Talk 3 capabilities
Experimental0%
Alpha66%
Beta78%
Voicewake, Voice Overlay, Talk, Macos
WebChat 3 capabilities
Experimental0%
Alpha66%
Beta78%
Remote WebChat 5 capabilities
Experimental0%
Alpha66%
Beta78%
Native Windows - M2 Alpha - 4 areas
Core CLI and Gateway flows work, but docs still recommend WSL2 for the full experience and list native caveats.
Coverage Experimental - 0%Quality Alpha - 58%Completeness Alpha - 66%Partial - 1
AreaCoverageQualityCompletenessDocs
CLI 9 capabilities / LTS-supported
Experimental0%
Alpha54%
Alpha64%
Index, Installer, Windows, Getting Started, Onboard
Gateway Management 11 capabilities
Experimental0%
Alpha59%
Alpha66%
Windows, Index, Gateway, Doctor
Networking 4 capabilities
Experimental0%
Alpha59%
Alpha66%
Updates 4 capabilities
Experimental0%
Alpha59%
Alpha66%
Kubernetes hosting - M2 Alpha - 4 areas
Kubernetes hosting is a separate Kustomize-based cluster deployment path. Current scoring shows a real minimal deployment path, but gaps remain in Kubernetes-specific CI, ingress/TLS/NetworkPolicy packaging, backup/restore, and production exposure hardening.
Coverage Experimental - 0%Quality Alpha - 55%Completeness Alpha - 61%None
AreaCoverageQualityCompletenessDocs
Deployment Setup 5 capabilities
Experimental0%
Alpha55%
Alpha61%
Configuration and Secrets 5 capabilities
Experimental0%
Alpha55%
Alpha61%
Kubernetes, Secrets, Environment
Access and Exposure 5 capabilities
Experimental0%
Alpha55%
Alpha61%
Kubernetes, Authentication, Remote, Exposure Runbook
Cluster Lifecycle 5 capabilities
Experimental0%
Alpha55%
Alpha61%
Nix install path - M1 Experimental - 5 areas
Install flow is optional. A clearer support commitment is needed before alpha or beta promotion.
Coverage Experimental - 0%Quality Experimental - 41%Completeness Experimental - 44%None
AreaCoverageQualityCompletenessDocs
Install Handoff 4 capabilities
Experimental0%
Experimental41%
Experimental44%
Plugin Lifecycle 4 capabilities
Experimental0%
Experimental41%
Experimental44%
Activation and App UX 7 capabilities
Experimental0%
Experimental41%
Experimental44%
Config and State 7 capabilities
Experimental0%
Experimental41%
Experimental44%
Service Runtime and Guards 8 capabilities
Experimental0%
Experimental41%
Experimental44%
watchOS companion surfaces - M1 Experimental - 5 areas
The source includes Watch app and extension surfaces, but the public docs do not yet present this as a user-facing feature.
Coverage Experimental - 0%Quality Experimental - 41%Completeness Experimental - 44%None
AreaCoverageQualityCompletenessDocs
Delivery and Recovery 7 capabilities
Experimental0%
Experimental41%
Experimental44%
Exec Approvals 3 capabilities
Experimental0%
Experimental41%
Experimental44%
Distribution and Support 6 capabilities
Experimental0%
Experimental41%
Experimental44%
Notifications and Replies 7 capabilities
Experimental0%
Experimental41%
Experimental44%
Watch App UI 3 capabilities
Experimental0%
Experimental41%
Experimental44%
Linux companion app - M0 Planned - 5 areas
The docs state that native Linux companion apps are planned. Gateway is the supported Linux path right now.
Coverage Experimental - 0%Quality Experimental - 19%Completeness Experimental - 21%None
AreaCoverageQualityCompletenessDocs
App Distribution 3 capabilities
Experimental0%
Experimental19%
Experimental21%
Gateway Connectivity 4 capabilities
Experimental0%
Experimental19%
Experimental21%
Chat and Sessions 3 capabilities
Experimental0%
Experimental19%
Experimental21%
Desktop Capabilities 9 capabilities
Experimental0%
Experimental19%
Experimental21%
Linux, Exec Approvals, Secrets, Index, Exec, Talk, Camera
Status and Diagnostics 7 capabilities
Experimental0%
Experimental19%
Experimental21%
Native Windows companion app - M0 Planned - 5 areas
Only planned.
Coverage Experimental - 0%Quality Experimental - 19%Completeness Experimental - 21%None
AreaCoverageQualityCompletenessDocs
Installation and Updates 4 capabilities
Experimental0%
Experimental19%
Experimental21%
Gateway Connection 3 capabilities
Experimental0%
Experimental19%
Experimental21%
Windows, Index, Pairing, Remote
Chat Sessions 2 capabilities
Experimental0%
Experimental19%
Experimental21%
Status and Repair 5 capabilities
Experimental0%
Experimental19%
Experimental21%
Desktop Tools and Permissions 10 capabilities
Experimental0%
Experimental19%
Experimental21%
Windows, Index, Exec, Exec Approvals, Index
Channel
Discord - M4 Stable - 6 areas
Deep documentation and broad feature coverage. Voice and delegation paths should continue to be scored separately as beta or alpha.
Coverage Experimental - 0%Quality Beta - 73%Completeness Stable - 87%Partial - 4
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 10 capabilities / LTS-supported
Experimental0%
Beta73%
Stable87%
Discord, Discord, Fly, Slash Commands, Health, Channels, Config Channels
Access and Identity 6 capabilities / LTS-supported
Experimental0%
Beta73%
Stable87%
Discord, Pairing, Access Groups, Groups
Conversation Routing and Delivery 12 capabilities / LTS-supported
Experimental0%
Beta73%
Stable87%
Discord, Channel Routing, Groups, Access Groups, Acp Agents, Subagents
Media and Rich Content 1 capabilities / LTS-supported
Experimental0%
Beta73%
Stable87%
Native Controls and Approvals 5 capabilities
Experimental0%
Beta73%
Stable87%
Realtime Voice and Calls 5 capabilities
Experimental0%
Beta73%
Stable87%
Discord, OpenAI, Elevenlabs, Qa E2e Automation, Config Channels
Telegram - M3 Beta - 5 areas
The core channel is mature enough for regular use, but high-variance UX and media edge cases still need recurring scenario proof.
Coverage Experimental - 0%Quality Alpha - 68%Completeness Beta - 78%Full - 5
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 10 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Telegram, Config Channels, Channels
Access and Identity 10 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Telegram, Pairing, Access Groups, Groups, Multi Agent
Conversation Routing and Delivery 1 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Media and Rich Content 1 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Native Controls and Approvals 9 capabilities / LTS-supported
Experimental0%
Beta77%
Beta79%
Telegram, Exec Approvals, Reactions
Slack - M3 Beta - 5 areas
First-class channel docs and routing surface. Needs workspace install and admin scenario scorecards.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%Full - 5
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 10 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Slack, Slack, Secrets, Qa E2e Automation, Troubleshooting
Access and Identity 1 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Conversation Routing and Delivery 5 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Slack, Bot Loop Protection, Pairing
Media and Rich Content 1 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Native Controls and Approvals 8 capabilities / LTS-supported
Experimental0%
Alpha66%
Beta78%
Slack, Slash Commands, Exec Approvals
iMessage and BlueBubbles - M3 Beta - 5 areas
Supported iMessage runs through imsg on a signed-in macOS Messages host. Legacy BlueBubbles configs require migration. Keep macOS permissions, SSH wrapper, SIP/private API, and migration caveats visible.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 11 capabilities
Experimental0%
Alpha66%
Beta78%
Bluebubbles Imessage, Imessage From Bluebubbles, Config Channels, iMessage
Access and Identity 6 capabilities
Experimental0%
Alpha66%
Beta78%
iMessage, Imessage From Bluebubbles, Config Channels
Conversation Routing and Delivery 4 capabilities
Experimental0%
Alpha66%
Beta78%
Media and Rich Content 7 capabilities
Experimental0%
Alpha66%
Beta78%
iMessage, Imessage From Bluebubbles, Config Channels
Native Controls and Approvals 3 capabilities
Experimental0%
Alpha66%
Beta78%
WhatsApp - M3 Beta - 5 areas
The core path is important and documented. Upstream Baileys and session volatility keep it below Stable.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 5 capabilities
Experimental0%
Alpha66%
Beta78%
WhatsApp, Config Channels, WhatsApp, Qa E2e Automation, Doctor
Access and Identity 7 capabilities
Experimental0%
Alpha66%
Beta78%
WhatsApp, Config Channels, Qa E2e Automation, Pairing
Conversation Routing and Delivery 4 capabilities
Experimental0%
Alpha66%
Beta78%
Media and Rich Content 2 capabilities
Experimental0%
Alpha66%
Beta78%
Native Controls and Approvals 2 capabilities
Experimental0%
Alpha66%
Beta78%
Matrix - M2 Alpha - 6 areas
Supported through a bundled plugin. Needs bridge, auth, and room lifecycle scorecards.
Coverage Experimental - 0%Quality Alpha - 60%Completeness Alpha - 67%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 5 capabilities
Experimental0%
Alpha60%
Alpha67%
Access and Identity 7 capabilities
Experimental0%
Alpha60%
Alpha67%
Matrix, Groups, Bot Loop Protection
Conversation Routing and Delivery 1 capabilities
Experimental0%
Alpha60%
Alpha67%
Media and Rich Content 1 capabilities
Experimental0%
Alpha60%
Alpha67%
Native Controls and Approvals 6 capabilities
Experimental0%
Alpha60%
Alpha67%
Encryption and Verification 3 capabilities
Experimental0%
Alpha60%
Alpha67%
Google Chat - M2 Alpha - 5 areas
Documented channel, but enterprise and admin setup raises maturity risk.
Coverage Experimental - 0%Quality Alpha - 59%Completeness Alpha - 66%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 16 capabilities
Experimental0%
Alpha59%
Alpha66%
Google Chat, Google Chat, Config Channels, Wizard Cli Reference, Secrets, Secretref Credential Surface, Health, Plugin Inventory, Index
Access and Identity 11 capabilities
Experimental0%
Alpha59%
Alpha66%
Google Chat, Pairing, Access Groups, Config Channels, Bot Loop Protection, Channel Routing
Conversation Routing and Delivery 1 capabilities
Experimental0%
Alpha59%
Alpha66%
Google Chat, Bot Loop Protection, Access Groups, Channel Routing
Media and Rich Content 1 capabilities
Experimental0%
Alpha59%
Alpha66%
Google Chat, Message, Media Understanding, Secretref Credential Surface
Native Controls and Approvals 16 capabilities
Experimental0%
Alpha59%
Alpha66%
Google Chat, Message, Media Understanding, Secretref Credential Surface, Reactions, Slash Commands, Config Agents, Message Lifecycle Refactor
Microsoft Teams - M2 Alpha - 5 areas
Enterprise auth and admin flows need explicit scenario proof.
Coverage Experimental - 0%Quality Alpha - 59%Completeness Alpha - 66%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 9 capabilities
Experimental0%
Alpha59%
Alpha66%
Microsoft Teams, Microsoft Teams, Config Channels, Health
Access and Identity 9 capabilities
Experimental0%
Alpha59%
Alpha66%
Microsoft Teams, Pairing, Access Groups
Conversation Routing and Delivery 5 capabilities
Experimental0%
Alpha59%
Alpha66%
Microsoft Teams, Groups, Channel Routing
Media and Rich Content 5 capabilities
Experimental0%
Alpha59%
Alpha66%
Native Controls and Approvals 5 capabilities
Experimental0%
Alpha59%
Alpha66%
Microsoft Teams, Exec Approvals Advanced
Signal - M2 Alpha - 5 areas
Supported channel docs exist. Needs stronger install and reconnect proof.
Coverage Experimental - 0%Quality Alpha - 59%Completeness Alpha - 66%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 7 capabilities
Experimental0%
Alpha59%
Alpha66%
Access and Identity 6 capabilities
Experimental 0%
Alpha 59%
Alpha 66%
Conversation Routing and Delivery 1 capabilities
Experimental 0%
Alpha 59%
Alpha 66%
Media and Rich Content 7 capabilities
Experimental 0%
Alpha 59%
Alpha 66%
Native Controls and Approvals 3 capabilities
Experimental 0%
Alpha 59%
Alpha 66%
Feishu, QQ Bot, WeChat, Yuanbao, Zalo, Zalo Personal, regional channels - M2 Alpha - 4 areas
Regional coverage is significant, but the public support level should be adjusted per account type, upstream approval, and maintainer proof.
Coverage Experimental - 0%Quality Alpha - 55%Completeness Alpha - 58%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 6 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Index, Pairing, Feishu, Architecture Internals
Access and Identity 1 capabilities
Experimental 0%
Alpha 53%
Alpha 54%
No linked docs
Conversation Routing and Delivery 1 capabilities
Experimental 0%
Alpha 53%
Alpha 54%
No linked docs
Media and Rich Content 1 capabilities
Experimental 0%
Alpha 53%
Alpha 54%
No linked docs
Mattermost, LINE, IRC, Nextcloud Talk, Nostr, Twitch, Tlon, Synology Chat - M2 Alpha - 4 areas
Supported surfaces exist, but maturity likely differs by upstream and maintainer coverage. Score each one individually later.
Coverage Experimental - 0%Quality Alpha - 53%Completeness Alpha - 54%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 1 capabilities
Experimental 0%
Alpha 53%
Alpha 54%
No linked docs
Access and Identity 1 capabilities
Experimental 0%
Alpha 53%
Alpha 54%
No linked docs
Conversation Routing and Delivery 1 capabilities
Experimental 0%
Alpha 53%
Alpha 54%
No linked docs
Media and Rich Content 1 capabilities
Experimental 0%
Alpha 53%
Alpha 54%
No linked docs
Voice Call channel - M1 Experimental - 5 areas
Optional or plugin path with complex realtime behavior. Needs a scenario scorecard before public beta.
Coverage Experimental - 0%Quality Experimental - 41%Completeness Experimental - 44%None
AreaCoverageQualityCompletenessDocs
Channel Setup and Operations 2 capabilities
Experimental 0%
Experimental 41%
Experimental 44%
Voicecall, Voice Call, Protocol
Access and Identity 1 capabilities
Experimental 0%
Experimental 41%
Experimental 44%
Conversation Routing and Delivery 1 capabilities
Experimental 0%
Experimental 41%
Experimental 44%
Media and Rich Content 2 capabilities
Experimental 0%
Experimental 41%
Experimental 44%
Realtime Voice and Calls 2 capabilities
Experimental 0%
Experimental 41%
Experimental 44%
Provider and tool
Browser automation, exec, and sandbox tools - M3 Beta - 3 areas
Core tools are documented, but host security and permission UX should remain under active scorecard review.
Coverage Experimental - 21%Quality Beta - 75%Completeness Beta - 79%Partial - 2
AreaCoverageQualityCompletenessDocs
Browser Automation 8 capabilities
Experimental 13%
Beta 79%
Beta 79%
Browser Control, Testing, Browser, Index, Audit Checks
Tool Invocation and Execution 6 capabilities / LTS-supported
Alpha 50%
Beta 79%
Beta 79%
Exec, Background Process, Tools Invoke Http Api, Operator Scopes, Protocol, Exec Approvals, Exec Approvals Advanced, Elevated
Sandbox and Tool Policy 6 capabilities / LTS-supported
Experimental 0%
Alpha 68%
Beta 79%
Sandboxing, Sandbox Vs Tool Policy Vs Elevated, Multi Agent Sandbox Tools, Codex Harness Reference, Config Tools
OpenAI and Codex provider path - M3 Beta - 5 areas
Deep docs, OAuth or subscription path, realtime voice, image, and compatibility behavior. Provider churn prevents Stable status without release scorecard proof.
Coverage Experimental - 26%Quality Beta - 74%Completeness Beta - 79%Partial - 3
AreaCoverageQualityCompletenessDocs
Model and Auth 6 capabilities / LTS-supported
Experimental 44%
Beta 79%
Beta 79%
OpenAI, Codex Harness, Models, Oauth, Codex Harness Reference, Auth Monitoring
Responses and Tool Compatibility 4 capabilities / LTS-supported
Experimental 40%
Beta 79%
Beta 79%
OpenAI, Openresponses Http Api, Openai Http Api, Codex Native Plugins
Native Codex Harness 2 capabilities / LTS-supported
Experimental 44%
Beta 79%
Beta 79%
Codex Harness, Codex Harness Runtime, Codex Harness Reference, Codex Native Plugins
Image and Multimodal Input 2 capabilities
Experimental 0%
Alpha 67%
Beta 79%
OpenAI, Image Generation, Images
Voice and Realtime Audio 2 capabilities
Experimental 0%
Alpha 67%
Beta 79%
Web search tools - M3 Beta - 4 areas
Multiple providers and docs exist. Needs quota, error, and SSRF proof per provider family.
Coverage Experimental - 9%Quality Beta - 74%Completeness Beta - 79%None
AreaCoverageQualityCompletenessDocs
Search Providers 19 capabilities
Experimental 11%
Beta 79%
Beta 79%
Web, Brave Search, Tavily, Exa Search, Firecrawl, Perplexity Search, Duckduckgo Search, Searxng Search, Gemini Search, Grok Search, Kimi Search, Minimax Search, Ollama Search, Sdk Subpaths, Sdk Overview, Manifest
Setup and Diagnostics 9 capabilities
Experimental 0%
Alpha 68%
Beta 79%
Web, Web Fetch, Faq, Api Usage Costs, Brave Search, Perplexity Search, Tavily, Firecrawl
Network Safety 4 capabilities
Experimental 0%
Alpha 68%
Beta 79%
Web, Web Fetch, Firecrawl, Searxng Search
Tool Availability and Fetch 11 capabilities
Experimental 25%
Beta 79%
Beta 79%
Config Tools, Web Fetch, Web, Faq
Anthropic provider path - M3 Beta - 5 areas
First-class model provider. Needs recurring auth, catalog, and tool call scenario proof.
Coverage Experimental - 0%Quality Beta - 71%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Provider Auth and Recovery 9 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Anthropic, Doctor, Configuration Examples, Troubleshooting, Prompt Caching
Model and Runtime Selection 10 capabilities
Experimental 0%
Beta 78%
Beta 79%
Anthropic, Config Agents, Models, Cli Backends
Request Transport and Turn Semantics 10 capabilities
Experimental 0%
Beta 77%
Beta 79%
Anthropic, Prompt Caching, Troubleshooting, Cli Backends, Model Providers
Prompt Cache and Context 5 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Anthropic, Prompt Caching, Troubleshooting, Heartbeat
Media Inputs 4 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Google provider path - M3 Beta - 5 areas
First-class provider with model and realtime surfaces. Needs separate Live and Talk scoring.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Provider Setup and Credentials 10 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Model Routing and Endpoints 10 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Google, Model Providers, Google, Gemini Search
Direct Gemini Runtime 9 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Google, Model Providers, Faq Models, Testing Live
Media, Search, and Realtime 10 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Prompt Caching 5 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Prompt Caching, Google, Model Providers, Token Use
OpenRouter provider path - M3 Beta - 4 areas
Unified provider path is documented and valuable, but model specific behavior varies.
Coverage Experimental - 0%Quality Alpha - 66%Completeness Beta - 78%None
AreaCoverageQualityCompletenessDocs
Provider Setup and Auth 14 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Openrouter, Model Providers, Configure, Authentication, Environment, Models, Models
Chat Runtime and Normalization 15 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Openrouter, Model Providers, Prompt Caching
Provider Recovery and Diagnostics 5 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Model Failover, Openrouter, Models
Media Generation and Speech 7 capabilities
Experimental 0%
Alpha 66%
Beta 78%
Openrouter, Image Generation, Music Generation, Media Overview, Video Generation, Tts
Image, video, and music generation tools - M2 Alpha - 5 areas
Capability exists across providers, but quality, latency, and parameter compatibility vary too much for beta without per provider proof.
Coverage Experimental - 0%Quality Alpha - 61%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Media Routing and Discovery 4 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Config Agents, Image Generation, Video Generation, Music Generation
Task Lifecycle and Delivery 12 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Media Overview, Image Generation, Video Generation, Music Generation
Image Generation 9 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Image Generation, Infer, Media Overview
Video Generation 11 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Video Generation, Runway, Pixverse, Fal, Openrouter
Music Generation 6 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Local model providers: Ollama, vLLM, SGLang, LM Studio - M2 Alpha - 5 areas
Useful and documented, but environment variance is high.
Coverage Experimental - 0%Quality Alpha - 61%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Provider Setup, Lifecycle, and Diagnostics 12 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Local Models, Lmstudio, Ollama, Vllm, Local Model Services, Config Agents, Troubleshooting, Doctor
Native Provider Plugins 10 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
OpenAI-Compatible Runtime Compatibility 8 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Vllm, Sglang, Local Models, Lmstudio
Local Memory and Embeddings 5 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Network Safety and Prompt Controls 2 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Index, Config Tools, Local Models
Long-tail hosted providers - M2 Alpha - 3 areas
Many docs and reference pages exist. Score should be generated from provider metadata plus live smoke coverage.
Coverage Experimental - 0%Quality Alpha - 61%Completeness Alpha - 68%None
AreaCoverageQualityCompletenessDocs
Hosted LLM Providers 12 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Index, Model Providers, Testing Live, Onboard
Hosted Media Providers 8 capabilities
Experimental 0%
Alpha 61%
Alpha 68%
Provider Operations 12 capabilities
Experimental 0%
Alpha 61%
Alpha 68%