Hungry Bots – AI’s Shocking Energy Usage

“Large Language Models” (LLMs) – have quickly become as familiar as our morning coffee.

They have revolutionized the world since their inception, and best of all, they’re free!

Except, they’re not.

LLMs like ChatGPT may be marvels of technology, but they come with a hefty hidden price tag – their voracious appetite for energy.

Energy hogs

That cup of coffee you’re drinking? That requires about .5 kilowatt-hour (KWh).

ChatGPTs daily energy consumption? Approximately 1 gigawatt-hour (GWh), which is equivalent to the daily energy consumption of 12 million US households. 

To repeat, ChatGPT consumes the same energy as 12 million US households.

That’s a lot of cups of coffee! And we’re still at the stage of relatively early adoption with LLMs. 

Vast data centers are already required to handle these processing requirements, with demand only set to increase.

Energy hogs

Water ’bout that

And it’s not just energy that is being used. LLM’s might soon be competing for our morning coffee.

With massive computational models, comes hefty heaving computers, that all have pretty incredible cooling.

In fact, ChatGPT guzzles 500ml of water for every 5 to 50 queries it answers, putting huge strain on rivers in Iowa where its Azure supercomputer is located. Currently, ChatGPT receives 10 million daily prompts – that’s 5 million liters.

In training GPT-3 alone, Microsoft may have consumed an incredible 700,000 liters of water, enough to produce 370 BMW cars or 320 Tesla electric vehicles.

With GPT-4 and future models offering more and more sophistication, water consumption isn’t going away anytime soon.

A load of hot air

Longer-term environmental impacts? LLMs come with those too.

BLOOM calculated that training their LLM led to 25,000 tons of carbon emissions, equivalent to around 60 flights between London and New York.

Companies employing these models must find ways to offset their carbon footprint with sustainable practices.

Quick wins? Try setting carbon reduction targets, or using ESG software to help measure and reduce your environmental impact.

A load of hot air

The financial toll

Aside from the environmental burden, there is the bottom-line impact.

Data centers require substantial investments in both infrastructure and cooling systems to prevent overheating. 

And the electricity bills for running them? Astronomical.

Running LLMs has a very real-world cost, and this will eventually cost businesses dearly.

Humans not so bad

The prospects of ChatGPT might look amazing when free. However, it is actually really resource-intensive, even though OpenAI is picking up the bill for this – for now.

When comparing apples with apples, maybe the good old human workforce looks increasingly affordable, environmentally friendly, and efficient in comparison.

The question for your business

Is your business replacing humans with AI yet?

Read more thought leadership articles here:

Start your
journey today

  • Independent
  • Secure
  • Transparent

Access fantastic talent at world-leading prices

Scale your business fast while reducing costs —
the average all-in employment costs in the
Philippines are typically 70% less than its
Western counterparts

Philippines United Kingdom Australia United States
Software Developer
HR Manager
Team Leader
Copy Writer
Customer Service
Virtual Assistance
Select a role to view salaries
Philippines $7,221
United Kingdom $39,913
Australia $62,653
United States $81,994

Avoid guesswork. Talk to the experts, free.

Get 3 free quotes

You can save 70% on staff costs, whilst driving quality & growth. Connect with an outsourcing expert to see how outsourcing can transform your business.

Why choose us?
  • Independent and unrivalled expertise
  • We carefully match you from 2,300+ leading suppliers
  • Access to Outsourcing Savings Calculator & Report

Get Started

How many staff to outsource?

About OA

Outsource Accelerator is the trusted source of independent information, advisory and expert implementation of Business Process Outsourcing (BPO).

The #1 outsourcing authority

Outsource Accelerator offers the world’s leading aggregator marketplace for outsourcing. It specifically provides the conduit between world-leading outsourcing suppliers and the businesses – clients – across the globe.

The Outsource Accelerator website has over 5,000 articles, 450+ podcast episodes, and a comprehensive directory with 3,900+ BPO companies… all designed to make it easier for clients to learn about – and engage with – outsourcing.

About Derek Gallimore

Derek Gallimore has been in business for 20 years, outsourcing for over eight years, and has been living in Manila (the heart of global outsourcing) since 2014. Derek is the founder and CEO of Outsource Accelerator, and is regarded as a leading expert on all things outsourcing.