crud-otagent-supabase

To query and aggregate OT-Agent evaluation data in Supabase, you access the sandbox_jobs, models, and benchmarks schemas. You can aggregate ID/OOD means and binomial SE using canonical rules for multiple entries per model.

The best way to register new models and eval jobs is by running provided scripts connected via local secrets. This safely writes rows to the registry and maintains cross-user foreign key safety.

Supabase handles data integrity for cross-user model evaluations by enforcing cross-user foreign key safety checks. This ensures relationships between models, benchmarks, and sandbox_jobs remain consistent across different users.

Yes, you can repair failed uploads for model benchmark results in Supabase. The skill provides scripts to reconcile and safely write rows, fixing failed uploads while maintaining database integrity.

You identify ID and OOD benchmarks by querying the benchmarks schema within Supabase. The skill supports identifying these benchmark types to correctly aggregate their means and binomial standard errors.

Yes, you need local secrets to access the Supabase evaluation database. Connecting locally using your secret environment variables is required to run the scripts for querying and registering data.