I could in theory upgrade the power supply to go beyond the 150W target, but then I’d also need a better chassis because it is already quite warm with my current 130W card.
Hoping to stick with AMD, but if my wishes to play around with local LLMs and image upscaling makes Nvidia a more practical choice, I can live with that compromise.
Working with a budget of 200 US, I’m fine going with a used GPU.
Firstly AMD and NVidia both have a range of cards with different power levels. Getting a card with 8G that uses the 75W available from the PCIe slot should be possible.
A card that is setup for ML isn’t necessarily going to work well for desktop use. I currently have a NVIDIA card in my workstation setup for ML and it gives 0.2fps on games. I installed the NVIDIA card because the AMD card died and decided to play with ML on it.
I think the best thing to do is to use a separate PC for ML.