lai

Generate language descriptors and system prompts for Langium DSL evaluation suites.

28|4|Updated Apr 10, 2025
One-click install
npx skills add https://github.com/eclipse-langium/langium-ai --skill lai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: lai
Source: https://github.com/eclipse-langium/langium-ai/tree/main/skills/lai
Command: npx skills add https://github.com/eclipse-langium/langium-ai --skill lai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It solves the challenge of building reliable AI-powered tooling for a Langium DSL by turning your language project into a descriptor-driven workflow that supports evaluation and continuous prompt refinement.

Core Features & Use Cases

  • Descriptor generation and refinement: Create and iteratively improve a YAML language descriptor from your Langium project structure so prompt generation stays aligned with your grammar, services, and examples.
  • System prompt synthesis: Generate a DSL-aware system prompt directly from the descriptor to guide LLM behavior during evaluation.
  • Evaluation loop with diagnostics: Run evaluation suites against real Langium parsing/validation to measure outputs, compare runs, and diagnose failures so you can refine the descriptor and prompts.
  • Workflow automation for common scenarios: Use it to bootstrap a new Langium AI project, regenerate descriptors/prompts from scratch, validate file/path correctness, and maintain evaluation history for prompt improvements.
  • Use case: After you update your grammar or validation rules, regenerate the descriptor and system prompt, re-run evaluations, and use history/compare/stats to confirm that improvements increased pass rates and reduced diagnostics.

Quick Start

Tell an AI assistant: "Guide me through running lai init, generating a language descriptor, generating a system prompt, and running lai evaluate to measure and improve my Langium DSL prompt quality."

Frequently Asked Questions about lai

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate a system prompt for my Langium DSL project?

To generate a system prompt for a Langium DSL, you create a YAML language descriptor from your project structure and then synthesize a DSL-aware system prompt directly from that descriptor to guide LLM behavior during evaluation.

How do I evaluate LLM outputs against a custom DSL grammar?

You evaluate LLM outputs against a DSL grammar by running evaluation suites that test generated text against real Langium parsing and validation, comparing run histories and analyzing diagnostics to measure prompt pass rates.

What is a language descriptor in Langium AI tooling?

A language descriptor in Langium AI tooling is a YAML representation of your project's grammar, services, and examples used to keep system prompt generation aligned with your specific domain-specific language structure.

Can I automate prompt refinement when my Langium grammar changes?

Yes, you can automate prompt refinement by regenerating the descriptor and system prompt from scratch after updating grammar or validation rules, then re-running evaluations to confirm improvements increased pass rates and reduced diagnostics.

Do I need a YAML descriptor to run Langium AI evaluation suites?

Yes, a YAML language descriptor is required to run Langium AI evaluation suites because it defines the schema for validation and drives the synthesis of the system prompt that guides the LLM during the evaluation loop.

Why does my Langium AI evaluation keep failing validation rules?

Langium AI evaluation failures occur when the generated LLM output violates real Langium parsing constraints; you diagnose these failures by analyzing evaluation run diagnostics, refining the YAML descriptor, and regenerating the system prompt.