dbotwinick commited on
Commit
fe9ea57
·
verified ·
1 Parent(s): 5e197d9

Add files using upload-large-folder tool

Browse files
Files changed (3) hide show
  1. LICENSE +17 -0
  2. README.md +98 -0
  3. hf_quant_config.json +19 -0
LICENSE ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MINIMAX COMMUNITY LICENSE
2
+ Copyright (c) 2026 MiniMax
3
+ Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the “Software”), to deal in the Software for non-commercial purposes, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or provide copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
4
+ 1. The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
5
+ 2. If the Software (or any derivative works thereof) is used for any Commercial Use for your products or services:
6
+ 1. you shall prominently display “Built with MiniMax M3” on a related website, user interface, blogpost, about page or product documentation.
7
+ 2. you shall obtain a separate, prior written authorization from MiniMax by contacting api@minimax.io with the subject line “M3 licensing - authorization request”, if such products and services generate more than 20 million US dollars (or equivalent in other currencies) in yearly revenue; otherwise, you only need to send a one-time notice to api@minimax.io with the subject “M3 licensing — notice”.
8
+ 3. “Commercial Use” means any use of the Software or any derivative work thereof that is primarily intended for commercial advantage or monetary compensation, which includes, without limitation: (i) offering products or services to third parties for a fee, which utilize, incorporate, or rely on the Software or its derivatives, (ii) the commercial use of APIs provided by or for the Software or its derivatives, including to support or enable commercial products, services, or operations, whether in a cloud-based, hosted, or other similar environment, and (iii) the deployment or provision of the Software or its derivatives that have been subjected to post-training, fine-tuning, instruction-tuning, or any other form of modification, for any commercial purpose.
9
+ THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
10
+
11
+ Appendix: Prohibited Uses
12
+ You agree you will not use, or allow others to use, the Software or any derivatives of the Software to:
13
+ 1. Generate or disseminate content prohibited by applicable laws or regulations.
14
+ 2. Assist with, engage in or otherwise support any military purpose.
15
+ 3. Exploit, harm, or attempt to exploit or harm minors.
16
+ 4. Generate or disseminate false or misleading information with the intent to cause harm.
17
+ 5. Promote discrimination, hate speech, or harmful behavior against individuals or groups based on race or ethnic origin, religion, disability, age, nationality and national origin, veteran status, sexual orientation, gender or gender identity, caste, immigration status, or any other characteristic that is associated with systemic discrimination or marginalization.
README.md ADDED
@@ -0,0 +1,98 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: image-text-to-text
3
+ license: other
4
+ license_name: minimax-community
5
+ license_link: LICENSE
6
+ library_name: transformers
7
+ base_model: MiniMaxAI/MiniMax-M3
8
+ base_model_relation: quantized
9
+ tags:
10
+ - multimodal
11
+ - moe
12
+ - agent
13
+ - coding
14
+ - video
15
+ ---
16
+
17
+ ## NOTICE
18
+
19
+ This is an experimental quantization of MiniMax M3 to NVFP4 for use on DGX Spark.
20
+
21
+ NVFP4 uses w1/3 scales, so need either: https://github.com/scitrera/sglang/tree/nvfp4-w13-scale-normalization (or possibly sglang PR#27588) in place to properly
22
+ use the calibration from this model.
23
+
24
+ The calibration is still a work in progress (hence "v0" model). Updates are planned to improve performance.
25
+
26
+ <div align="center">
27
+ <img width="60%" src="figures/logo.svg" alt="MiniMax">
28
+ </div>
29
+ <hr>
30
+
31
+ <p align="center">
32
+ <a href="https://agent.minimax.io/" target="_blank"><img src="https://img.shields.io/badge/MiniMax%20Agent-FF6C37?style=for-the-badge&logo=minimax&logoColor=white" alt="MiniMax Agent"></a>
33
+ <a href="https://platform.minimax.io/docs/guides/text-generation" target="_blank"><img src="https://img.shields.io/badge/API-FF6C37?style=for-the-badge&logo=minimax&logoColor=white" alt="API"></a>
34
+ <a href="https://www.minimax.io" target="_blank"><img src="https://img.shields.io/badge/MiniMax%20Website-FF6C37?style=for-the-badge&logo=minimax&logoColor=white" alt="MiniMax Website"></a>
35
+ <br>
36
+ <a href="https://platform.minimaxi.com/docs/faq/contact-us" target="_blank"><img src="https://img.shields.io/badge/WeChat-07C160?style=for-the-badge&logo=wechat&logoColor=white" alt="WeChat"></a>
37
+ <a href="https://discord.com/invite/DPC4AHFCBw" target="_blank"><img src="https://img.shields.io/badge/Discord-5865F2?style=for-the-badge&logo=discord&logoColor=white" alt="Discord"></a>
38
+ <a href="https://huggingface.co/MiniMaxAI" target="_blank"><img src="https://img.shields.io/badge/Hugging%20Face-FFD21E?style=for-the-badge&logo=huggingface&logoColor=black" alt="Hugging Face"></a>
39
+ <a href="https://github.com/MiniMax-AI/MiniMax-M3" target="_blank"><img src="https://img.shields.io/badge/GitHub-181717?style=for-the-badge&logo=github&logoColor=white" alt="GitHub"></a>
40
+ <a href="https://arxiv.org/abs/2606.13392" target="_blank"><img src="https://img.shields.io/badge/arXiv-2606.13392-B31B1B?style=for-the-badge&logo=arxiv&logoColor=white" alt="arXiv Paper"></a>
41
+ <a href="https://huggingface.co/MiniMaxAI/MiniMax-M3/blob/main/LICENSE" target="_blank"><img src="https://img.shields.io/badge/LICENSE-4CAF50?style=for-the-badge&logo=creativecommons&logoColor=white" alt="LICENSE"></a>
42
+ </p>
43
+
44
+ MiniMax-M3 is a native multimodal model with 1M context. It has ~428B parameters and ~23B activated parameters.
45
+
46
+ **Highlights:**
47
+ - **Native Multimodality:** M3 undergoes mixed-modality training from the very first step, enabling deeper semantic fusion across text, image, and video.
48
+ - **Context Scaling via Sparse Attention:** M3 introduces MiniMax Sparse Attention (MSA) to improve long context efficiency. M3 delivers 9× prefill and 15× decode speedups compared to M2 at 1M context, reducing per-token compute to 1/20.
49
+ - **Coding & Cowork Capability:** M3 achieves frontier-level performance across long-horizon agentic benchmarks, excelling in both coding and cowork.
50
+
51
+
52
+ <p align="center">
53
+ <img width="100%" src="figures/benchmark.jpeg">
54
+ </p>
55
+
56
+ ## MiniMax Sparse Attention (MSA)
57
+
58
+ M3 is powered by [**MiniMax Sparse Attention (MSA)**](https://github.com/MiniMax-AI/MSA), a high-performance sparse attention operator designed for million-token contexts. Compared with GQA, MSA dramatically reduces the attention compute and memory footprint while preserving model quality.
59
+
60
+ <p align="center">
61
+ <img width="100%" src="figures/efficiency_gqa_vs_msa.png" alt="GQA vs MSA Efficiency Comparison">
62
+ </p>
63
+
64
+ > 📄 Read the technical report: [arXiv:2606.13392](https://arxiv.org/abs/2606.13392) · [Hugging Face Papers](https://huggingface.co/papers/2606.13392)
65
+
66
+ ## How to Use
67
+
68
+ - [MiniMax Agent](https://agent.minimax.io/)
69
+ - [MiniMax API](https://platform.minimax.io/)
70
+
71
+ M3 supports two reasoning modes:
72
+ - **thinking** — for complex reasoning, agentic tasks, and long-horizon collaboration.
73
+ - **non-thinking** — for latency-sensitive scenarios such as chat and code completion.
74
+
75
+ ## Local Deployment
76
+
77
+ Download the model:
78
+
79
+ ```bash
80
+ hf download MiniMaxAI/MiniMax-M3 --local-dir MiniMax-M3
81
+ ```
82
+
83
+ We recommend the following inference frameworks (listed alphabetically) to serve the model:
84
+
85
+ - [SGLang](https://docs.sglang.io/) - see [SGLang cookbook](https://docs.sglang.io/cookbook/autoregressive/MiniMax/MiniMax-M3).
86
+
87
+ - [vLLM](https://github.com/vllm-project/vllm) - see [vLLM recipes](https://recipes.vllm.ai/MiniMaxAI/MiniMax-M3).
88
+
89
+ - [Transformers](https://github.com/huggingface/transformers) - see [Transformers docs](https://huggingface.co/docs/transformers/model_doc/minimax_m3_vl).
90
+
91
+
92
+ ### Inference Parameters
93
+
94
+ We recommend the following parameters for best performance: `temperature=1.0`, `top_p=0.95`, `top_k=40`.
95
+
96
+ ## Contact Us
97
+
98
+ Contact us at [model@minimax.io](mailto:model@minimax.io).
hf_quant_config.json ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "producer": {
3
+ "name": "quantization-tool",
4
+ "version": "1.0"
5
+ },
6
+ "quantization": {
7
+ "quant_algo": "NVFP4",
8
+ "kv_cache_quant_algo": null,
9
+ "group_size": 16,
10
+ "exclude_modules": [
11
+ "lm_head",
12
+ "model.embed_tokens",
13
+ "vision_tower*",
14
+ "multi_modal_projector*",
15
+ "patch_merge_mlp*",
16
+ "*block_sparse_moe.gate"
17
+ ]
18
+ }
19
+ }