Civilizational intelligence infrastructure must remain free to study, build, deploy, and run, not rented from closed institutions.
    • ZephyrXero@lemmy.worldEnglish
      41·
      1 month ago

      I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over

      • mabeledo@lemmy.worldEnglish
        2·
        1 month ago

        I was talking about combined system RAM. People often overestimate what the average system specs are.

        • ZephyrXero@lemmy.worldEnglish
          41·
          1 month ago

          If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM