Awesome Mamba

:fire::fire: This is a collection of awesome articles about Mamba models (With a particular emphasis on Medical Image Analysis):fire::fire:

• Our survey paper on arXiv: Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis :heart:

Citation

@article{heidari2024computation,
  title={Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis},
  author={Heidari, Moein and Ghorbani Kolahi, Sina and Karimijafarbigloo, Sanaz and Azad, Bobby and Bozorgpour, Afshin and Hatami, Soheila and Azad, Reza and Diba, Ali and Bagci, Ulas and Merhof, Dorit and others},
  journal={arXiv e-prints},
  pages={arXiv--2406},
  year={2024}
}

Updates

• :sunglasses: First release: June 05, 2024

Table of Contents

• Survey Papers
• Architecture Redesign
• Remote Sensing
• Speech Processing
• Video Processing
• Activity Recognition
• Image Enhancement
• Image & Video Generation
• Medical Imaging
• Image Segmentation
• Reinforcement Learning
• Natural Language Processing
• 3D Recognition
• Multi-Modal Understanding
• Time Series
• GNN
• Point Cloud
• Tabular Data
• Other Applications

Surveys

• From Generalization Analysis to Optimization Designs for State Space Models
• MambaOut: Do We Really Need Mamba for Vision? [Github]
• State Space Model for New-Generation Network Alternative to Transformers: A Survey [Github]
• A Survey on Visual Mamba
• Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges [Github]
• Vision Mamba: A Comprehensive Survey and Taxonomy [Github]
• A Survey on Vision Mamba: Models, Applications and Challenges [Github]

Preliminaries and State Space Models

• S7: Selective and Simplified State Space Layers for Sequence Modeling
• HiPPO: Recurrent Memory with Optimal Polynomial Projections [Github]
• S4: Efficiently Modeling Long Sequences with Structured State Spaces [Github]
• H3: Hungry Hungry Hippos: Toward Language Modeling with State Space Models [Github]
• LOCOST: State-Space Models for Long Document Abstractive Summarization [Github]
• Theoretical Foundations of Deep Selective State-Space Models
• S4++: Elevating Long Sequence Modeling with State Memory Reply
• Hieros: Hierarchical Imagination on Structured State Space Sequence World Models [Github]
• State Space Models as Foundation Models: A Control Theoretic Overview
• Selective Structured State-Spaces for Long-Form Video Understanding
• Retentive Network: A Successor to Transformer for Large Language Models[Github]
• Convolutional State Space Models for Long-Range Spatiotemporal Modeling[Github]
• Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions[Github]
• Resurrecting Recurrent Neural Networks for Long Sequences
• Hyena Hierarchy: Towards Larger Convolutional Language Models[Github]

Architecture Redesign

• Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality [Github]
• Mamba: Linear-time sequence modeling with selective state spaces [Github]
• Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality [Github]
• Locating and Editing Factual Associations in Mamba [Github]
• MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection [Github]
• Jamba: A Hybrid Transformer-Mamba Language Model
• Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data[Github]
• Incorporating Exponential Smoothing into MLP: A Simple but Effective Sequence Model [Github]
• PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition [Github]
• Understanding Robustness of Visual State Space Models for Image Classification
• Efficientvmamba: Atrous selective scan for light weight visual mamba [Github]
• Localmamba: Visual state space model with windowed selective scan [Github]
• Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Models [Github]
• The hidden attention of mamba models [Github]
• Learning method for S4 with Diagonal State Space Layers using Balanced Truncation
• BlackMamba: Mixture of Experts for State-Space Models[Github]
• MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts[Github]
• Scalable Diffusion Models with State Space Backbone [Github]
• ZigMa: Zigzag Mamba Diffusion Model[Github]
• Spectral State Space Models
• Mamba-unet: Unet-like pure visual mamba for medical image segmentation [Github]
• Mambabyte: Token-free selective state space model
• Vmamba: Visual state space model [Github]
• Vision mamba: Efficient visual representation learning with bidirectional state space model [Github]
• Sparsified State-Space Models are Efficient Highway Networks [Github]

Remote Sensing

• ChangeMamba: Remote Sensing Change Detection with Spatio-Temporal State Space Model [Github]
• RS-Mamba for Large Remote Sensing Image Dense Prediction [Github]
• RS3Mamba: Visual State Space Model for Remote Sensing Images Semantic Segmentation [Github]
• HSIMamba: Hyperspectral Imaging Efficient Feature Learning with Bidirectional State Space for Classification [Github]
• Rsmamba: Remote sensing image classification with state space model [Github]
• HSIMamba: Hyperpsectral Imaging Efficient Feature Learning with Bidirectional State Space for Classification [Github]
• Samba: Semantic Segmentation of Remotely Sensed Images with State Space Model [Github]

Speech Processing

• SPMamba: State-space model is all you need in speech separation [Github]
• Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation [Github]

Video Processing

• SpikeMba: Multi-Modal Spiking Saliency Mamba for Temporal Video Grounding
• Video mamba suite: State space model as a versatile alternative for video understanding [Github]
• SSM Meets Video Diffusion Models: Efficient Video Generation with Structured State Spaces [Github]
• Videomamba: State space model for efficient video understanding [Github]

Activity Recognition

• HARMamba: Efficient Wearable Sensor Human Activity Recognition Based on Bidirectional Selective SSM
• VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting[Github]

Image Enhancement

• Aggregating Local and Global Features via Selective State Spaces Model for Efficient Image Deblurring
• Serpent: Scalable and Efficient Image Restoration via Multi-scale Structured State Space Models
• VmambaIR: Visual State Space Model for Image Restoration [Github]
• Activating Wider Areas in Image Super-Resolution [Github]
• MambaIR: A Simple Baseline for Image Restoration with State-Space Model [Github]
• Pan-Mamba: Effective pan-sharpening with State Space Model [Github]
• U-shaped Vision Mamba for Single Image Dehazing [Github]

Image-Video-Generation

• DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesis [Github]

Medical Imaging

• MambaRoll: Physics-Driven Autoregressive State Space Models for Medical Image Reconstruction [GitHub]
• DenoMamba: A fused state-space model for low-dose CT denoising [Github]
• Vim4Path: Self-Supervised Vision Mamba for Histopathology Images [Github]
• VMambaMorph: a Visual Mamba-based Framework with Cross-Scan Module for Deformable 3D Image Registration [Github]
• UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentation [Github]
• Rotate to Scan: UNet-like Mamba with Triplet SSM Module for Medical Image Segmentation
• Integrating Mamba Sequence Model and Hierarchical Upsampling Network for Accurate Semantic Segmentation of Multiple Sclerosis Legion
• CMViM: Contrastive Masked Vim Autoencoder for 3D Multi-modal Representation Learning for AD classification
• H-vmunet: High-order vision mamba unet for medical image segmentation [Github]
• ProMamba: Prompt-Mamba for polyp segmentation
• Vm-unet-v2 rethinking vision mamba unet for medical image segmentation [Github]
• MD-Dose: A Diffusion Model based on the Mamba for Radiotherapy Dose Prediction [Github]
• Large Window-based Mamba UNet for Medical Image Segmentation: Beyond Convolution and Self-attention [Github]
• MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathology [Github]
• Clinicalmamba: A generative clinical language model on longitudinal clinical notes [Github]
• Lightm-unet: Mamba assists in lightweight unet for medical image segmentation [Github]
• MedMamba: Vision Mamba for Medical Image Classification [Github]
• Weak-Mamba-UNet: Visual Mamba Makes CNN and ViT Work Better for Scribble-based Medical Image Segmentation [Github]
• P-Mamba: Marrying Perona Malik Diffusion with Mamba for Efficient Pediatric Echocardiographic Left Ventricular Segmentation
• Semi-Mamba-UNet: Pixel-Level Contrastive Cross-Supervised Visual Mamba-based UNet for Semi-Supervised Medical Image Segmentation [Github]
• FD-Vision Mamba for Endoscopic Exposure Correction [Github]
• Swin-umamba: Mamba-based unet with imagenet-based pretraining [Github]
• Vm-unet: Vision mamba unet for medical image segmentation[Github]
• Vivim: a video vision mamba for medical video object segmentation [Github]
• Segmamba: Long-range sequential modeling mamba for 3d medical image segmentation [Github]
• T-Mamba: Frequency-Enhanced Gated Long-Range Dependency for Tooth 3D CBCT Segmentation [Github]
• U-mamba: Enhancing long-range dependency for biomedical image segmentation [Github]
• MambaMorph: a Mamba-based Backbone with Contrastive Feature Learning for Deformable MR-CT Registration[Github]
• nnMamba: 3D Biomedical Image Segmentation, Classification and Landmark Detection with State Space Model[Github]
• MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation[Github]
• ViM-UNet: Vision Mamba for Biomedical Segmentation[Github]
• VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis
• HC-Mamba: Vision MAMBA with Hybrid Convolutional Techniques for Medical Image Segmentation
• I2I-Mamba: Multi-modal Medical Image Synthesis via Selective State Space Modeling [GitHub]
• MUCM-Net: A Mamba Powered UCM-Net for Skin Lesion Segmentation [Github]
• Cardiovascular Disease Detection from Multi-View Chest X-rays with BI-Mamba
• Convolution and Attention-Free Mamba-based Cardiac Image Segmentation
• AC-MAMBASEG: An adaptive convolution and Mamba-based architecture for enhanced skin lesion segmentation [Github]
• SAM-VMNet: Deep Neural Networks For Coronary Angiography Vessel Segmentation
• MHS-VM: Multi-Head Scanning in Parallel Subspaces for Vision Mamba[Github]

Image Segmentation

• UU-Mamba: Uncertainty-aware U-Mamba for Cardiac Image Segmentation [Github]
• Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation [Github]

Reinforcement Learning

• Decision Mamba: Reinforcement Learning via Sequence Modeling with Selective State Spaces [Github]
• MAMBA: an Effective World Model Approach for Meta-Reinforcement Learning [Github]

Natural Language Processing

• RankMamba Benchmarking Mamba's Document Ranking Performance in the Era of Transformers [Github]
• Densemamba: State space models with dense hidden connection for efficient large language models [Github]
• Is Mamba Capable of In-Context Learning?
• BioMamba: A Pre-trained Biomedical Language Representation Model Leveraging Mamba

3D Recognition

• Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction
• Motion mamba: Efficient and long sequence motion generation with hierarchical and bidirectional selective ssm [Github]

Multi-Modal Understanding

• Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models[Github]
• ReMamber: Referring Image Segmentation with Mamba Twister
• VL-Mamba: Exploring State Space Models for Multimodal Learning
• Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference[Github]
• SurvMamba: State Space Model with Multi-grained Multi-modal Interaction for Survival Prediction
• MambaDFuse: A Mamba-based Dual-phase Model forMulti-modality Image Fusion
• APRICOT-Mamba: Acuity Prediction in Intensive Care Unit (ICU): Development and Validation of a Stability, Transitions, and Life-Sustaining Therapies Prediction Model

Time Series

• SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series [Github]
• Is Mamba Effective for Time Series Forecasting? [Github]
• TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting [Github]
• MambaStock: Selective state space model for stock prediction [Github]
• Bi-Mamba4TS: Bidirectional Mamba for Time Series Forecasting

GNN

• STG-Mamba: Spatial-Temporal Graph Learning via Selective State Space Model
• Graph Mamba: Towards Learning on Graphs with State Space Models [Github]
• Graph-Mamba: Towards long-range graph sequence modeling with selective state spaces [Github]
• Recurrent Distance Filtering for Graph Representation Learning[Github]
• Modeling multivariate biosignals with graph neural networks and structured state space models[Github]

Point Cloud

• Point mamba: A novel point cloud backbone based on state space model with octree-based ordering strategy [Github]
• Point Could Mamba: Point Cloud Learning via State Space Model [Github]
• PointMamba: A Simple State Space Model for Point Cloud Analysis [Github]
• 3DMambaIPF: A State Space Model for Iterative Point Cloud Filtering via Differentiable Rendering
• 3DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion

Tabular Data

• MambaTab: A Simple Yet Effective Approach for Handling Tabular Data
• Mambular: A Sequential Model for Tabular Deep Learning [Github]

Other Applications

• State Space Models for Event Cameras [Github]
• Mamba Drafters for Speculative Decoding

Star History