Linear Attention
2 stories tagged “Linear Attention”.
-
Retrieval-Oriented Deep Learning in Expanding Nonparametric Neural Networks
The paper reframes linear-layer training through the duality between gradient descent and linear attention, th…
-
V-CoLA: Compressing Vision Tokens Using Linear Attention
V-CoLA compresses vision tokens in linear-attention VLMs without training, keeping accuracy and speeding prefi…