https://xylight.dev/

Developer of Photon

Main account @Xylight@lemdro.id

  • 1 Post
  • 2 Comments
Joined 7 months ago
cake
Cake day: June 9th, 2025

help-circle
  • Xylight@feddit.onlinetoLemmy Shitpost@lemmy.worldu WoT m8
    link
    fedilink
    English
    arrow-up
    5
    ·
    3 days ago

    Qwen3 30b a3b, for example, is brilliant for its size and i can run it on my 8 GB VRAM + 32 GB RAM system at like 20 tokens per second. For lower powered systems, Qwen3 4b + a search tool is also insanely great for its size and can fit in less than 3 GB of RAM or VRAM at Q5 quantization