Publications

A collection of my research publications and academic papers.

PSA: Pyramid Sparse Attention for Efficient Video Understanding and Generation

PSA: Pyramid Sparse Attention for Efficient Video Understanding and Generation

Xiaolong Li*, Youping Gu*, Xi Lin*, Weijie Wang, Bohan Zhuang

* Equal contribution

PreprintDecember 2025

PSA introduce an efficient attention mechanism to accelerate video understanding and generation. It leverages a multi-level sparse attention strategy, enabling the model to effectively mitigates information loss while preserving computational efficiency under a low compute budget.
Nifty tech tag lists from Wouter Beeftink