Transformer projections
1 stories tagged “Transformer projections”.
-
Modify the Multiplication, Retain the Parameters: Associative Algebraic Layers for Transformers
This research explores replacing standard matrix multiplication in Transformer projections with a lower-rank a…