Automate A/B test setup, execution, and analysis in UrhoX Lua games.
npx skills add https://github.com/haitao2016/--Skill --skill ab-testing-haitao2016
Please help me install this Agent Skill. Skill: ab-testing Source: https://github.com/haitao2016/--Skill/tree/main/ab-testing Command: npx skills add https://github.com/haitao2016/--Skill --skill ab-testing-haitao2016
This Skill simplifies A/B testing within UrhoX Lua games by automating experiment setup, group assignment, data tracking, analysis, and visualization, allowing for quick evaluation of feature impacts.
Run the ab-testing skill to initiate an A/B test for a new game feature. Example: use ab-testing to run experiment my_feature_test with variants control, experimental with weights 50, 50.
High-intent search queries and answers about installing and using this skill.
A/B testing in UrhoX Lua is automated by configuring experiment variants, assigning player groups, collecting metrics, and performing statistical analysis to evaluate feature impact on user engagement.
Statistical analysis for game A/B testing includes Z-test, Welch's t-test, and Cohen's d to evaluate the significance and effect size of experimental feature impacts on collected metrics.
Yes, A/B testing metrics can be visualized within UrhoX using NanoVG to render real-time dashboards, allowing immediate monitoring of experiment data and player session tracking.
Player group assignment and experiment configuration are handled by defining multiple variants, assigning weights like 50/50, and tracking metrics such as session time and user actions automatically.
Yes, UrhoX Lua requires external libraries like cjson for dependencies, alongside built-in APIs, to handle data tracking, JSON processing, and statistical analysis for A/B testing.
A/B testing should be used when implementing new game features to evaluate their impact on user engagement, session time, and performance before rolling changes out to all players.
haitao2016Implement the Santorini board game with UrhoX Lua and NanoVG.
dkyazzentwatwaCalculate statistical significance for A/B tests using Chi-square, Z-test, or T-test.
haitao2016Track and visualize game analytics metrics like DAU, MAU, and ARPU in UrhoX Lua.
dxprManage Thompson Sampling multi-armed bandit experiments via Drush commands.
