matrix multiplication

Modify the Multiplication, Retain the Parameters: Associative Algebraic Layers for Transformers

This research explores replacing standard matrix multiplication in Transformer projections with a lower-rank a…