nox-preference-learner

Learn behavioral preferences from conversational feedback and inject them into agent context.

3|1|Updated Mar 8, 2026
One-click install
npx skills add https://github.com/rockywuest/openclaw-memory-local --skill nox-preference-learner
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: nox-preference-learner
Source: https://github.com/rockywuest/openclaw-memory-local/tree/main/plugins/nox-preference-learner
Command: npx skills add https://github.com/rockywuest/openclaw-memory-local --skill nox-preference-learner

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill allows users to directly influence and shape an AI agent's behavior through natural conversation, adapting its responses without requiring model retraining.

Core Features & Use Cases

  • Behavioral Adaptation: Learns preferences across 6 dimensions (autonomy, verbosity, proactivity, formality, technical depth, confirmation seeking) based on user feedback.
  • RLHF-lite: Implements a lightweight Reinforcement Learning from Human Feedback loop by injecting learned preferences into the agent's context.
  • Use Case: If an agent is too verbose, a user can say "Be more concise" or "TLDR". The agent learns this preference and adjusts its future responses to be shorter.

Quick Start

Use the nox-preference-learner skill to adjust the agent's verbosity to be less verbose.

Frequently Asked Questions about nox-preference-learner

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I adjust an AI agent's verbosity and formality without retraining the model?

To make an AI agent less verbose through conversation, provide direct feedback like asking it to be more concise. The skill captures this conversational feedback, logs it for reinforcement, and applies a lightweight RLHF loop to shorten future responses automatically.

How does conversational feedback shape an AI agent's behavior?

Conversational feedback shapes an AI agent's behavior through a lightweight Reinforcement Learning from Human Feedback mechanism. It logs user feedback signals, updates a JSON-based preference store with decay mechanisms, and injects learned preferences into the agent's context to adapt responses.

What behavioral dimensions can I control by teaching an AI agent preferences?

You can control six behavioral dimensions by teaching an AI agent preferences: autonomy, verbosity, proactivity, formality, technical depth, and confirmation seeking. The agent adapts its responses across these dimensions based on your ongoing conversational feedback.

Does this preference learning approach require any dependencies to work?

No, this preference learning approach does not require any external dependencies. It operates entirely through scripts to manage a JSON-based preference store and inject learned behavioral patterns directly into the AI agent's context.

How does the agent handle outdated behavioral preferences over time?

The agent handles outdated behavioral preferences using built-in decay mechanisms within its JSON-based preference store. This ensures that older conversational feedback signals gradually lose influence, allowing the agent to adapt to more recent behavioral preferences.