ad-graph-dump

What problem does it solve?

Ad-graph-dump helps you debug TensorRT-LLM AutoDeploy by making the intermediate FX graph structure visible after each transform, so you can confirm what rewrites happened and where a specific subgraph came from.

Core Features & Use Cases

• Per-transform FX graph dumps: Writes a text dump after every registered AutoDeploy transform runs, capturing the module’s graph state immediately after that transform.
• Deterministic file naming for pipeline order: Produces lexicographically sortable filenames that track run order and transform stage/keys for easy before/after comparisons.
• Rank-aware safe dumping: Only rank 0 writes files, avoiding duplicated outputs in distributed runs.
• Actionable for fusion and subgraph verification: Use dumps to verify fusion matches, check whether wrapper/metadata nodes appear or disappear, and correlate transform logs to on-disk graph output.

Quick Start

Set AD_DUMP_GRAPHS_DIR to a writable directory, then run your AutoDeploy entrypoint so that the pipeline emits numbered graph dump files after each transform.