Skip to content

Observability dashboard with org-level metrics #9

Description

@haasonsaas

Problem

Room records durable audit events (append-only, SQLite) but the admin dashboard is currently a minimal token-based UI. Security and engineering teams need visibility into how coding agents are being used and what Room is enforcing across the organization.

Proposal

Expand the dashboard to surface:

  • Guardrail invocations over time (allow / block / indeterminate breakdown)
  • Active agents and workspaces — which agents are connected, how often they call Room
  • Policy violations — blocked actions grouped by signal type, ruleset version, workspace
  • MCP tool usage — call counts for room_get_rules, room_analyze_plan, room_check_diff
  • Ruleset version history — what changed when, who published

These metrics already exist in the audit event log; the work is aggregation and presentation.

Why

Security teams are the primary buyers of guardrail tooling, and audit/visibility is a core requirement — both for incident response and for compliance evidence. The data is already being collected; it needs to be queryable.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions