Post History

Current version by Nick Antonaccio

Current VersionJun 19, 2026 at 16:51

I can confirm that MiniMax-M3-GGUF/UD-IQ4_NL does run on 2 clustered DGX Spark machines. I only loaded and tested it with a small 8k context limit, and haven't done any sort of optimization or software development with it yet, but did see that the 2 Asus GX10s were getting 9.5 tokens per second out of the gate with the IQ4_NL quant. With a 3rd DGX Spark added to the cluster, or using an IQ3_XXS quant on 2 clustered machines, this model should be very useable for challenging tasks, when needed.

One note: Minimax's sparse attention for 1 million token context is not yet included in the gguf files from Unsloth, so there's still some work that needs to be completed by the community before all features of the quantized open source MiniMax M3 version are completely ready - but this is a really promising initial test.

Previous Versions
Version 1Jun 19, 2026 at 16:51

I can confirm that MiniMax-M3-GGUF/UD-IQ4_NL does run on 2 clustered DGX Spark machines. I only loaded and tested it with a small 8k context limit, and haven't done any sort of optimization or software development with it yet, but did see that the 2 Asus GX10s were getting 9.5 tokens per second out of the gate with the IQ4_NL quant. With a 3rd DGX Spark added to the cluster, or using an IQ3_XXS quant on 2 clustered machines, this model should be very useable for challenging tasks, when needed.