According to this article, this is not considered true anymore:
As conversations with experts and AI companies made clear, inference, not training, represents an increasing majority of AI’s energy demands and will continue to do so in the near future. It’s now estimated that 80–90% of computing power for AI is used for inference.
I think there’s a reason why OpenAI, Microsoft, Google and Facebook hold the energy consumption and water usage numbers so close to their chest.
According to numbers floating around online, thiat would mean one llama query is around as expensive as 10 google searches. And it’s likely that those costs will increase further.
It still seems like the biggest factor here is the scale of adaptation. Unfortunately the total energy costs of AI might even scale exponentially since the more complex the queries get, the better the responses will likely be. And that will further drive adaptation.
This pace is so clearly unsustainable it’s horrifying, and while it was obvious to some degree, it seems it’s worse than I thought.
America produced 4,000TWH of electricity a year. This report says “22% of household consumption in 2028”, which if I commit the faux pass of mixing data it gets me 7% of US power consumption.
7% is a fucking lot though?? That’s an immense amount of power going towards slop instead of making our lives better or growing the economy or actually being productive.
It’s like we just decided to start burning our limited reserves of natural gas for fun.
The world won’t end, but we are absolutely on track for billions to die. If not from cataclysmic climate change, then from the inevitable start of WW3 triggered by climate change.
Things are, in fact, really fucking bad. We don’t need even more bullshit making it even worse.
According to this article, this is not considered true anymore:
I think there’s a reason why OpenAI, Microsoft, Google and Facebook hold the energy consumption and water usage numbers so close to their chest.
Oh damn. Very good article btw.
According to numbers floating around online, thiat would mean one llama query is around as expensive as 10 google searches. And it’s likely that those costs will increase further.
It still seems like the biggest factor here is the scale of adaptation. Unfortunately the total energy costs of AI might even scale exponentially since the more complex the queries get, the better the responses will likely be. And that will further drive adaptation.
This pace is so clearly unsustainable it’s horrifying, and while it was obvious to some degree, it seems it’s worse than I thought.
deleted by creator
7% is a fucking lot though?? That’s an immense amount of power going towards slop instead of making our lives better or growing the economy or actually being productive.
It’s like we just decided to start burning our limited reserves of natural gas for fun.
deleted by creator
The situation is already apocalyptic. Making it even worse just means we all die even faster.
deleted by creator
The world won’t end, but we are absolutely on track for billions to die. If not from cataclysmic climate change, then from the inevitable start of WW3 triggered by climate change.
Things are, in fact, really fucking bad. We don’t need even more bullshit making it even worse.