Civilizational intelligence infrastructure must remain free to study, build, deploy, and run, not rented from closed institutions.
  • ZephyrXero@lemmy.worldEnglish
    41·
    21 days ago

    I got Qwen 3.5:9b running on my 8GB GPU the other day, and it still has some room left over

    • mabeledo@lemmy.worldEnglish
      2·
      21 days ago

      I was talking about combined system RAM. People often overestimate what the average system specs are.

      • ZephyrXero@lemmy.worldEnglish
        41·
        21 days ago

        If the model dumps over to system ram it gets super slow, you ideally want it to fit completely in your VRAM