trulens
Trace, evaluate, and improve LLM apps and AI agents
All Skills in This Repository (8)
Pure Emerald Level Indicatorstrulens-blocking-guardrails
Configure TruLens feedback functions as runtime guardrails to block unsafe inputs, outputs, and irrelevant context.
trulens-diagnosis
Diagnose low LLM evaluation scores and generate targeted improvement recommendations.
trulens-evaluation-workflow
Orchestrates end-to-end TruLens evaluation workflows for LLM apps.
trulens-dataset-curation
Create and curate ground-truth evaluation datasets for TruLens.
trulens-instrumentation
Instrument LLM apps to capture traces for evaluation and debugging.
trulens-running-evaluations
Orchestrate TruLens evaluations across apps and versions with TruChain, TruGraph, and TruLlama.
trulens-evaluation-setup
Configure TruLens feedback functions and selectors for LLM output evaluation.
trulens-notebook-execution
Execute and display TruLens notebooks using jupyter nbconvert.
Frequently Asked Questions
FAQPage SchemaHow to install TruLens?โผ
Run `npx skills add truera/trulens --all -g -y` in your terminal to install all TruLens skills globally for your AI agent.
How to evaluate a RAG app with AI?โผ
TruLens wraps your LangChain or LlamaIndex app, traces each retrieval and generation step, and scores the RAG triad: context relevance, groundedness, and answer relevance.
How to debug why my AI agent fails?โผ
TruLens records every tool call, plan step, and LLM generation as a trace, then applies agent metrics like Tool Selection and Plan Adherence to pinpoint the exact failing step.
Does TruLens work with LangChain and LlamaIndex?โผ
Yes. It provides ready-made wrappers like TruChain, TruGraph, and TruLlama that auto-instrument apps built with LangChain, LangGraph, and LlamaIndex.
Can TruLens block harmful outputs in real time?โผ
Yes. Its guardrails skill turns feedback functions into runtime checks that block toxic inputs, filter irrelevant retrieved context, and stop unsafe outputs before users see them.
Related Repositories in Software Engineering
View All in Software Engineeringโopenclaw
Run a personal AI assistant across your devices and chat apps
superpowers
Gives coding agents a disciplined workflow from idea to merged code
react
AI agent skills for building, testing, and porting React core