aiml-sarcasm-harassment

Benchmark veiled harassment detection using Python scripts and JSON datasets.

934|152|Updated Mar 1, 2026
One-click install
npx skills add https://github.com/wuyoscar/ISC-Bench --skill aiml-sarcasm-harassment
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: aiml-sarcasm-harassment
Source: https://github.com/wuyoscar/ISC-Bench/tree/main/templates/aiml_sarcasm
Command: npx skills add https://github.com/wuyoscar/ISC-Bench --skill aiml-sarcasm-harassment

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Calibrates and evaluates a sarcasm detector on veiled harassment in both workplace and online contexts, enabling researchers to build safe benchmarks and study model behavior under challenging safety scenarios.

Core Features & Use Cases

  • Provides an end-to-end benchmarking workflow using included scripts and data to assess veiled harassment detection across multiple contexts such as workplace_bullying, online_dogpiling, gaslighting, microaggression, and passive_threat.
  • Includes anchor-based evaluation constraints to ensure deniability and realism in generated harassment samples.
  • Supplies a ready-made evaluation harness (JSON datasets and Python scripts) that can be extended to new contexts and datasets for AI safety research.

Quick Start

Run the provided benchmark by executing benchmark.py against sarcasm_cases.json to evaluate veiled harassment detection.

Frequently Asked Questions about aiml-sarcasm-harassment

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I benchmark veiled harassment detection in AI safety research?

Benchmark veiled harassment detection by running the provided Python scripts against JSON datasets to evaluate a local transformer-based classifier. This workflow validates data integrity and uses explicit context checks across scenarios like workplace bullying, online dogpiling, and microaggression.

What contexts does veiled sarcasm detection cover for online dogpiling and microaggression?

Veiled harassment detection covers workplace bullying, online dogpiling, gaslighting, microaggression, and passive threats. It uses anchor-based evaluation constraints to ensure realism and deniability in generated harassment samples for AI safety model behavior research.

Can I use a local transformer-based classifier for evaluating gaslighting and passive threats?

Yes, you can use a local transformer-based classifier with explicit context checks to evaluate gaslighting and passive threats. The benchmarking workflow enforces no placeholders and validates data integrity to ensure accurate AI safety model behavior assessment.

How do I evaluate sarcasm detectors on veiled harassment using JSON datasets?

Evaluate sarcasm detectors on veiled harassment by executing the provided benchmark.py against sarcasm_cases.json. The harness validates data integrity, enforces no placeholders, and uses anchor-based constraints to ensure realistic deniability in AI safety datasets.

Does the benchmark harness enforce constraints against placeholders in generated harassment samples?

Yes, the benchmark harness enforces no placeholders and validates data integrity in generated harassment samples. It applies anchor-based evaluation constraints to maintain realism and deniability across workplace bullying, gaslighting, and microaggression contexts.

What is the best way to extend an AI safety benchmark to new harassment contexts?

Extend the AI safety benchmark to new harassment contexts by modifying the included JSON datasets and Python scripts. The ready-made evaluation harness supports adding new scenarios while maintaining anchor-based constraints, data integrity, and explicit context checks for model behavior.