curious for a 4bit just in case..

#1
by hufflepuffle - opened

I saw your sulphur mlx quant goes down to q4. curious to try eros too and see if either does anything on my m4 / 24gb..

MLX Bits org

Have you used that one? I honestly didn't think a 24GB Mac could handle this model at all. My 32GB Mac barely handled the Q4 quant of Sulphur, unless I was doing low-res or very short clips <10 sec.

Have you used that one? I honestly didn't think a 24GB Mac could handle this model at all. My 32GB Mac barely handled the Q4 quant of Sulphur, unless I was doing low-res or very short clips <10 sec.

Haven’t yet, but I am used to low res / short clips regardless from the WAN days. Mac video gen is painful in general. Candidly I’m trying to figure how to run it, ha ha, I am used to swarmUI frontend over comfy (I run my Mac mini headless and comfy is too hard to manipulate via a Remote Desktop on my phone) so working through your directions from sulphur with Gemini assistance tonight

MLX Bits org

Give that one a try first, if you could. I just don't want to sink the time into a quant for a machine I'm pretty sure can't handle it. I was doing 10 sec clips at 384x480, on a 32GB Macbook Air, and that was pretty much the ceiling before performance and heat caused it to slow down a lot.

Sign up or log in to comment