latency-vs-throughput

Community

Master the latency-throughput relationship with real-world system insights.

Authorhung-phan
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill unit clarifies the intricate relationship between latency and throughput in high-load systems, empowering you to diagnose capacity issues, set effective SLOs, and optimize your applications for real-world demand.

Core Features & Use Cases

  • Latency vs Throughput Definitions: Explains Little's Law, the importance of percentiles over means, and user-perceived latency.
  • Queueing Theory Basics: Covers the M/M/1 queue model and utilization curves to understand how load impacts performance.
  • Capacity Planning Insights: Guides on designing effective capacity plans with practical application examples and formulas.
  • Batching & Scaling Strategies: Provides insights on how to apply batching for performance without incurring unexpected penalties.

Quick Start

Explore the relationship between latency and throughput for a system using Little's Law calculator provided within the 'mm1.py' script in the 'scripts/' directory.

Dependency Matrix

Required Modules

None required

Components

scriptsreferencesassets

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: latency-vs-throughput
Download link: https://github.com/hung-phan/system-skills/archive/main.zip#latency-vs-throughput

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.