jailbreak-construction

Yes, you can validate MobileGym jailbreak tasks by generating and executing offline judge tests. This ensures constructed tasks strictly adhere to JSON specifications and produce accurate execution results for adversarial benchmarking.

MobileGym jailbreak task construction requires Python version 3.11 or higher. You must also install specific libraries and dependencies like pytest, runtime, and bench_env to properly execute task validation and offline testing.

Offline testing for MobileGym adversarial benchmarks works by generating judge tests that execute locally to validate task definitions. This mechanism verifies that constructed jailbreak tasks run correctly and meet expected specifications before deployment.

Yes, you can use pytest to validate MobileGym jailbreak task definitions. The skill leverages pytest along with the runtime and bench_env dependencies to execute offline judge tests and ensure accurate task validation results.

Automating jailbreak task construction is limited to processing valid JSON definitions and requires a strict Python 3.11 environment with pytest, runtime, and bench_env dependencies. It cannot construct tasks from malformed definitions or unsupported formats.