I’m actually a bit scared. We’re essentially at the early days of AIs now being able to execute tasks and hack. Imagine a much better model than what Claude has now, being set free/open, for hackers to utilize that in a virus. A virus that adapts, learns, changes it’s own code/masks, looks for exploits, spreads around like crazy, destroying systems. How do you stop something like that once it starts doing it’s thing?
I think there are physical and economic limits. Neural networks may improve in software, but they still need more and more hardware, at some point that hardware resource curve is going to be to steep to climb at the current rate.
It’s way worse than that. The OpenAI talk at DefCon is a real eye-opener.
The agents swarmed, discovered chinks, left each other notes in hard-to-find places, and just relentlessly pressed on. Nobody knew what was going on for months, until it hacked its way into Huggingface. And HF’s own AI security agents didn’t pick anything up for weeks. It took a small glitch for someone to even notice.
I recognize it’s possible, but I somehow refuse to believe it happened because of how crazy it sounds. It’s like a trauma or something where your brain refuses to accept it as reality and tries to come up with excuses. I already have PTSD from automated hacking bots and crawlers wrecking havoc on my projects. I probably should have taken cybersecurity courses before taking webdev courses
I wonder how close we are to something that really takes down large chunks of the Internet. Although it’s probably more likely for it to just use your computer without revealing itself.
I’m actually a bit scared. We’re essentially at the early days of AIs now being able to execute tasks and hack. Imagine a much better model than what Claude has now, being set free/open, for hackers to utilize that in a virus. A virus that adapts, learns, changes it’s own code/masks, looks for exploits, spreads around like crazy, destroying systems. How do you stop something like that once it starts doing it’s thing?
Well, it’s a good thing that AI is being used to fix tons of bugs and potential exploits before it comes to that, isn’t it?
I think there are physical and economic limits. Neural networks may improve in software, but they still need more and more hardware, at some point that hardware resource curve is going to be to steep to climb at the current rate.
Why are you assuming that software improvements don’t include less resource utilization?
I thought it was clear that’s what I was implying.
And I’m asking why you think that.
China’s models have gotten significantly less resource intensive based on updating the software.
We’re gonna get the blackwall, just you wait. Cyberpunk is coming but only the bits that really suck.
It’s way worse than that. The OpenAI talk at DefCon is a real eye-opener.
The agents swarmed, discovered chinks, left each other notes in hard-to-find places, and just relentlessly pressed on. Nobody knew what was going on for months, until it hacked its way into Huggingface. And HF’s own AI security agents didn’t pick anything up for weeks. It took a small glitch for someone to even notice.
I recognize it’s possible, but I somehow refuse to believe it happened because of how crazy it sounds. It’s like a trauma or something where your brain refuses to accept it as reality and tries to come up with excuses. I already have PTSD from automated hacking bots and crawlers wrecking havoc on my projects. I probably should have taken cybersecurity courses before taking webdev courses
I wonder how close we are to something that really takes down large chunks of the Internet. Although it’s probably more likely for it to just use your computer without revealing itself.