> Seriously I am a 2x coder compared to what I was because of this.
Isn't the energy consumption of this technology pretty catastrophic? Do you consider the issue of energy consumption so abstracted you don't worry about it? Do you do anything to offset your increased carbon emissions?
They certainly are not providing these services at less than electricity costs. So if you are spending $20 a month on it, they are spending less than that on electricity. It's very low compared to any person in the first world's energy spend.
They would need 250 million GPT Plus $20 subscribers to recoup a $5 billion expense. They're far from that even when we count the free users (which are likely 99% of the user base?)
The math just doesn't work. They're hemorrhaging money as far as I can tell (not counting the Azure computing deal).
We can only guess, but my guess is that inference is still a good chunk of their costs. That's why they're trying to get the mini/turbo models into a usable state.
Even then, training is still an expense. And it's not like you can train and forget. Even if your model is already trained you still need to incorporate new knowledge over time.
Common sense, having been around cloud operations for a bit. The big cloud providers run gross margins around 30%. So if openai are using MSFT and getting a "good deal" maybe MSFT only get 20% GM. So, $1 of openai compute costs MSFT say $0.80. Of that cost of providing the service, something like 30-40% goes to electricity. So, lets say the electricity cost is $0.30 for $1 of OpenAI compute. (And that's probably a steelman, I think it's actually more like $0.20. )
There is about zero chance OpenAI are running their service at a 70% negative gross margin.
I’m working on getting a place with solar panels. I think that’s important for sustainability, plus who wants to have to be connected to the grid anyway?
Offsetting carbon emissions - what does it even mean? There is no feasible way to remove carbon from the athmosphere as far as I know. Would you care to explain what you mean by that?
isn't the energy consumption of travel, driving, and shipping food to you pretty catastrophic? Do you consider the issue of energy consumption so abstracted you don't worry about it? Do you do anything to offset your increased carbon emissions?
Isn't the energy consumption of this technology pretty catastrophic? Do you consider the issue of energy consumption so abstracted you don't worry about it? Do you do anything to offset your increased carbon emissions?