Goodeye8

And it’s their prerogative if they choose to do so. That’s not the same as Trump pushing his policies onto other countries.

And it’s not other countries. It’s right-wing parties who are using Trump for inspiration, it doesn’t automatically mean those parties are in power. In a parliamentary system, if they have any power then in most cases they’re in a coalition with center-right parties who will act as a stop-gap to their most extremist ideas. Even if they wanted to do like Trump does they have a much harder time doing that.

Let’s say you and me are neighbors. If I don’t listen to my wife, kids, extended family and set up stupid rules in my house, does that affect you? No. If I set up a stupid rule where guests can’t flush the toilet does that affect you? Not really unless you come and visit. If I decide to walk around in my house with a loaded gun, does that affect you? No.

But if I come to you house, punch you in the face and tell you “Your wife now runs the house and I will be checking that she is the one running the house” does that affect you? Absolutely. That’s a simplified version of what happened in Venezuela. If kick your door in, shove a gun in your face and tell you “This house is now mine. Either deal with it or fuck off” does that affect you? Absolutely. That’s a simplified version of what Trump would in Greenland.

What you’ve described are domestic issues that don’t violate the sovereignty of another country. What I’ve described as a bad precedent is an international issue where there actions directly violate the sovereignty of another country. They’re two different things.

I agree, he’s absolutely making the statement only from the perspective of his own interests. But just because he himself doesn’t think beyond his own interest it doesn’t mean it’s not setting (if actually followed through) a precedent where taking land by force is acceptable.

Sadly he’s saying something far more sinister. He’s basically saying that it doesn’t matter if you’ve lived somewhere for 500 years, someone else can come and say “This is mine now, fuck off”. Basically he’s stating that Russia has claim to whatever land they’ve conquered from Ukraine or that Israel has claim to all the lands they’re taking from Palestine.

Setting up a local model was specifically about people who take privacy and security seriously because that often requires sacrificing convenience, which in this case would be having to build a suitable server and learning the necessary know-how of setting up your own local model. Casual consumers don’t really think about privacy so they’re going to go with the most convenient option, which is whatever service the major players will provide.

As for Dell keeping the NPUs I forgot they’re going to be bundled with processors.

I’m not that concerned with the hardware limitations. Nobody is going to run a full-blown LLM on their laptop, running one on a desktop would already require building a PC with AI in mind. What you’re going to see being used locally are going smaller models (something like 7B using INT8 or INT4). Factor in the efficiency of an NPU and you could get by with 16GB of memory (especially if the models are used in INT4) with little extra power draw and heat. The only hardware concern would be the technological advancement speed of NPUs, but just don’t be an early adopter and you’ll probably be fine.

But this is where Dells point comes in. Why should the consumer care? What benefits do consumers get by running a model locally? Outside of privacy and security reasons you’re simply going to get a better result by using one of the online AI services because you’d be using a proper model instead of the cheap one that runs with limited hardware. And even for the privacy and security minded people you can just build your own AI server (maybe not today but when hardware prices get back to normal) that you run from home and then expose that to your laptop or smartphone. For consumers to desire running a local model (actually locally and not in a selfhosting kind of way) there would have to be some problem that the local model solve that the over the internet solution can’t solve. So far such a problem doesn’t exist today and there doesn’t seem to be a suitable problem on the horizon either.

Dell is keeping their foot in the door by still implementing NPUs into their laptops, so if by some miracle some magical problem is found that AI solves they’re ready, but they realize that NPUs are not something they can actually use as a selling point because as it stands, NPUs solve no problems because there’s no benefit to running small models locally.