• monotremata@lemmy.ca
    link
    fedilink
    English
    arrow-up
    127
    ·
    12 hours ago

    It’s particularly funny because I’m pretty sure AI companies are still selling the service below cost to try to retain market share (and drive small competitors out of business). They just aren’t taking quite as big a loss on every token with the increased prices.

      • monotremata@lemmy.ca
        link
        fedilink
        English
        arrow-up
        4
        ·
        7 hours ago

        Yeah. It certainly pays off sometimes. Amazon did it. It just, y’know, also crashes and burns sometimes, and I’m not sanguine about the way this is shifting its investment money from venture capitalists to, y’know, passive index fund investors.

    • Kairos@lemmy.today
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 hours ago

      So, they’re earning money on token generation but not overall (including training)?

      • monotremata@lemmy.ca
        link
        fedilink
        English
        arrow-up
        6
        ·
        7 hours ago

        No, my understanding is that they’re bringing in revenue on token generation, but it’s exceeded by the costs of token generation (running data centers, so, electricity and cooling). They definitely want to make a profit on token generation, but they’re afraid that raising costs that high too quickly would drive customers to switch to other providers. So they’ve reduced the amount they’re subsidizing token costs, but not switched over to making a profit.

        I can’t find a good citation for this, though, so it’s possible I’m mistaken. They also have huge costs associated with buying new GPUs and building new datacenters, so they’re operating at a massive loss either way, and it’s a little hard to find articles which tease apart the two aspects.

        In any case, operating at a massive loss for the first few years is practically standard operating procedure in silicon valley at this point, and sometimes it eventually leads to a profitable, even wildly profitable, business (e.g. Amazon). But it does require a steady stream of investors and a steadily increasing market valuation. That’s…we’ll have to see what happens on that front.

      • DeadDigger@lemmy.zip
        link
        fedilink
        English
        arrow-up
        25
        ·
        11 hours ago

        Openai had 2025 6billion in revenue and 20 billion costs on compute. So just to run the models to get 6billion they need to pay 20billion r&d and marketing etc get on top of that