Actually, That Was The Easy Part: Async Pipelines, Per-Context Isolation, and Five Days of ATSInfer Engineering
⚠️ This is an engineering log, not a benchmark post. Every Phase A/B/C/D table row is "⬜ Not run" or "TBD." The async pipeline, MoE hot cache, and adaptive MTP changes described here have not been empirically validated end-to-end. The one measured number (71.46 t/s aggregate decode …