zlacker

[parent] [thread] 15 comments
1. johnsi+(OP)[view] [source] 2026-02-04 19:48:23
Both companies are making bank on inference
replies(4): >>ehsanu+i1 >>lysace+Q3 >>waldop+x6 >>exitb+I6
2. ehsanu+i1[view] [source] 2026-02-04 19:56:38
>>johnsi+(OP)
Could you substantiate that? That take into account training and staffing costs?
replies(1): >>ihsw+K3
◧◩
3. ihsw+K3[view] [source] [discussion] 2026-02-04 20:07:08
>>ehsanu+i1
The parent specifically said inference, which does not include training and staffing costs.
replies(1): >>ehsanu+nZ
4. lysace+Q3[view] [source] 2026-02-04 20:07:48
>>johnsi+(OP)
That is the big question. Got reliable data on that?

(My gut feeling tells me Claude Code is currently underpriced with regards to inference costs. But that's just a gut feeling...)

replies(2): >>simian+w9 >>tvink+Pb
5. waldop+x6[view] [source] 2026-02-04 20:21:13
>>johnsi+(OP)
You may not like this sources, but both the tomato throwers to the green visor crowds agree they are losing money. How and when they make up the difference is up to speculation

https://www.wheresyoured.at/why-everybody-is-losing-money-on... https://www.economist.com/business/2025/12/29/openai-faces-a... https://finance.yahoo.com/news/openais-own-forecast-predicts...

replies(2): >>mh2266+nW >>mediam+n01
6. exitb+I6[view] [source] 2026-02-04 20:21:42
>>johnsi+(OP)
Maybe on the API, but I highly doubt that the coding agent subscription plans are profitable at the moment.
replies(2): >>tvink+Za >>lawren+6N
◧◩
7. simian+w9[view] [source] [discussion] 2026-02-04 20:32:50
>>lysace+Q3
> If we subtract the cost of compute from revenue to calculate the gross margin (on an accounting basis),2 it seems to be about 50% — lower than the norm for software companies (where 60-80% is typical) but still higher than many industries.

https://epoch.ai/gradient-updates/can-ai-companies-become-pr...

replies(1): >>lysace+ja
◧◩◪
8. lysace+ja[view] [source] [discussion] 2026-02-04 20:36:19
>>simian+w9
The context of that quote is OpenAI as a whole.
◧◩
9. tvink+Za[view] [source] [discussion] 2026-02-04 20:39:14
>>exitb+I6
For sure not
◧◩
10. tvink+Pb[view] [source] [discussion] 2026-02-04 20:42:11
>>lysace+Q3
https://www.wheresyoured.at/costs/

Their AWS spend being higher than their revenue might hint at the same.

Nobody has reliable data, I think it's fair to assume that even Anthropic is doing voodoo math to sleep at night.

replies(1): >>rcxdud+MR1
◧◩
11. lawren+6N[view] [source] [discussion] 2026-02-05 00:00:41
>>exitb+I6
Build out distribution first and generate network effects.
◧◩
12. mh2266+nW[view] [source] [discussion] 2026-02-05 01:11:20
>>waldop+x6
> green visor crowds

??

replies(1): >>mkl+ZO1
◧◩◪
13. ehsanu+nZ[view] [source] [discussion] 2026-02-05 01:36:31
>>ihsw+K3
But those aren't things you can really separate for proprietary models. Keeping inference running also requires staff, not just for the R&D.
◧◩
14. mediam+n01[view] [source] [discussion] 2026-02-05 01:44:36
>>waldop+x6
The comment was with reference to inference, not total P&L.

Of course they are losing money in total. They are not, however, losing money per marginal token.

It’s trivial to see this by looking at the market clearing price of advanced open source models and comparing to the inference prices charged by OpenAI.

◧◩◪
15. mkl+ZO1[view] [source] [discussion] 2026-02-05 09:33:13
>>mh2266+nW
https://en.wikipedia.org/wiki/Green_eyeshade
◧◩◪
16. rcxdud+MR1[view] [source] [discussion] 2026-02-05 09:55:59
>>tvink+Pb
The closed frontier models seem to sell at a substantial premium to inference on open-source models, so that does suggest that there is a decent margin to the inference. The training is where they're losing money, and the bull case is that every model makes money eventually, but the models keep getting bigger or at least more expensive to train, so they're borrowing money to make even more money later (which does need to converge somehow, i.e. they can't just keep shooting larger until the market can't actually afford to pay for the training). The bear case is that this is basically just a treadmill to stay on the frontier where they can make that premium (if the big labs ever stop they'll quickly get caught up by cheaper or even open-source models and lose their edge), in which case it's probably never going to actually become sustainable.
[go to top]