• partofthevoice@lemmy.zip
    link
    fedilink
    English
    arrow-up
    1
    ·
    15 hours ago

    I’m on a MacBook with M2, 32GB ram. Literally just tried:

    • gemma4:12b - very slow, unworkable
    • qwen3:8b - very slow, unworkable
    • qwen2.5-coder:7b - slow but workable. Doesn’t use tools properly in OpenCode.

    Well, I guess I’ll try again next year.

    For context: my home pc is running gemma4:31b just fine. It’s also a beefy ass desktop, though.

    • fluxx@mander.xyz
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 hours ago

      Are you running an mlx model? If not, try that. My m4 macbook runs qwen3.6-35b-a3b lightning fast. Has its issues, but fast nonetheless.

    • NotMyOldRedditName@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      14 hours ago

      You might be doing something wrong, models that size shouldn’t be that slow if properly configured on a 32gb m2

      You need a metal optimized client and model, not the same models you’d run on your desktop machine.