What are you saying precisely? It’s well known that LLMs have non-deterministic output (Ilya Sutskever even claims as such). Are you saying the way it goes about retrieving tokens as deterministic?
I think you’re right about that, but it is artificial nondeterminism in the sense that it’s relying on several algorithmic factors and, more subtly, device differences. The system itself is a complex yet deterministic function.
The Assumed Intelligence systems I’m familiar with have a “random” element, but it’s unclear where that source of randomness comes from. It it using a computational random source, or something like the lava lamp wall at Cloudflare, which is significantly more random, potentially actually random.
What are you saying precisely? It’s well known that LLMs have non-deterministic output (Ilya Sutskever even claims as such). Are you saying the way it goes about retrieving tokens as deterministic?
I think you’re right about that, but it is artificial nondeterminism in the sense that it’s relying on several algorithmic factors and, more subtly, device differences. The system itself is a complex yet deterministic function.
They are deterministic but complex to determine.
The Assumed Intelligence systems I’m familiar with have a “random” element, but it’s unclear where that source of randomness comes from. It it using a computational random source, or something like the lava lamp wall at Cloudflare, which is significantly more random, potentially actually random.