mamba-architecture
FeaturedState-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware design. Mamba-1 (d_state=16) and Mamba-2 (d_state=128, multi-head). Models 130M-2.8B on HuggingFace.
Install
Quality Score: 94/100
Skill Content
Details
- Author
- Orchestra-Research
- Repository
- Orchestra-Research/AI-Research-SKILLs
- Created
- 1 years ago
- Last Updated
- 1 months ago
- Language
- TeX
- License
- MIT
Integrates with
Similar Skills
Semantically similar based on skill content — not just same category
mamba-architecture
State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware design. Mamba-1 (d_state=16) and Mamba-2 (d_state=128, multi-head). Models 130M-2.8B on HuggingFace.
mamba-architecture
State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware design. Mamba-1 (d_state=16) and Mamba-2 (d_state=128, multi-head). Models 130M-2.8B on HuggingFace.
ml-architecture-data
Use when choosing, configuring, or running LLM model architectures (LitGPT, TorchTitan, nanoGPT, Mamba, RWKV), training or integrating subword tokenizers (Hugging Face Tokenizers, SentencePiece), or building large-scale data curation and streaming ETL pipelines (NeMo Curator, Ray Data). Triggers on 'litgpt', 'torchtitan', 'nanogpt', 'mamba', 'rwkv', 'tokenizers', 'sentencepiece', 'nemo-curator', 'ray-data', 'FSDP2', 'MinHash deduplication', or 'BPE/Unigram'.