Local LLM Practice Episode 6: Will Changing the SSD Make It Faster? Thinking After Measuring the 970 EVO

Hello, this is Sakamoto. This is the 6th episode of Oxtane's local LLM series.Last time, we established performance ...
note

[Mellum 2.1] The shock of JetBrains' new open LLM: 12B parameters, 2.5B active, 47% on SWE-bench, and free for commercial use

It's a model that's a bit of a missed opportunity in some ways. Since it's 12B-2.5B, I was hoping I could use it with about ...