Related papers
- Not All Loops Cost the Same: Phase-Dependent Depth for Serving Looped Transformers
LoopDuet shows that asymmetric loop depths for prefilling versus decoding—with prefilling shallower—boost throughput by up to 19% and quality by 6.04 EM points without retraining.
- Library of Layers (LoL): Adaptively Ordering Transformer Layers at Runtime
Library of Layers lets a router dynamically reorder transformer layers per input, matching dense, looped, and sparse MoE baselines while enabling interpretable, controllable routing paths.
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
TestPrism shows single-reference test evaluation overstates quality by 2x, with frontier agents achieving only 28% joint success across valid and invalid implementations.