• Rimu@piefed.social
    link
    fedilink
    English
    arrow-up
    27
    ·
    12 hours ago

    If you’ve ever spent 10 minutes using an AI agent, you’d know that there’s no way to predict how many tokens it’s going to use before you give it a task. It can be $0.20 worth sometimes or $20 other times. Or anything, really.

    It’s only after watching it churn away for a few minutes that you can assume it’s gotten stuck and have the option of pulling the plug before the bill gets run up too high. But you need to watch it like a hawk and you need to be the one paying the bill otherwise you’re not going to care (e.g. workers using AI at work aren’t paying for it, their company is).

    Taken in aggregate across a month, that unpredictability might average out or it might explode.