PackMamba: Efficient Processing of Variable-Length Sequences in Mamba Training
Abstract
PackMamba improves the efficiency of training Mamba models on variable-length sequences. It packs sequences and modifies the convolution and selective-scan operators to preserve sequence boundaries, reducing padding overhead while maintaining parallel execution.
Type
Publication
In Computer Vision – ECCV 2024 Workshops, published in 2025
