Transformer architecture search

Neural Spectral Capacity: Quantifying and Designing Architectures Using Only Network Specifications

NSC scores Transformers from specs, enabling exact budget search and fast LLaMA pruning, with superior ranking…