Transformer Efficiency

CoWindow Attention: Complete Causal Coverage as a Collective Attribute

CoWA shares causal history across heads; MALA skips low-contribution work, cutting FLOPs and speeding long-con…