Tuesday, 13 October 2026

SODA Foundation and Aitra: The Open-Source Project Making AI Greener

 

What Is SODA Foundation?

SODA Foundation is an open-source project under the Linux Foundation. Its mission is simple: make data management and storage work smoothly across cloud, edge, and on-premise systems

.

Think of it as a "universal translator" for data storage. Instead of locking your data into one vendor's system, SODA helps you move and manage data freely across different platforms

.

Founded in 2020 (originally called OpenSDS), SODA now includes major players like Huawei, Fujitsu, NTT Communications, Toyota, Sony, and China Unicom

.


What Is Aitra?

Aitra is an open-source project by SODA Foundation that measures how much energy AI systems use.

Here's the problem Aitra solves: When you run AI models (like ChatGPT-style tools), they consume massive amounts of GPU power. But most businesses have no idea how much energy each AI task actually costs

.

Aitra fixes this by tracking "energy per output token" — basically, how many joules of electricity it takes to generate each piece of AI output

.

Aitra in Plain English

What Aitra DoesWhy It Matters
Measures GPU energy in real-timeKnow exactly where your AI costs come from
Attributes energy to specific workloadsChargeback per team or project
Runs on KubernetesWorks with modern cloud infrastructure
Open source (Apache 2.0)Free to use and modify

Why Should You Care About AI Energy?

If you run any AI tools on your website or servers, energy costs are real money. Aitra helps you:

  1. See the hidden costs — Most companies only track GPU usage time, not actual energy consumption

  1. Optimize efficiency — Find which AI models or configurations waste the most power

  2. Report carbon usage — Meet ESG (Environmental, Social, Governance) requirements

  3. Reduce bills — Better scheduling = lower electricity costs

Aitra was featured at KubeCon Japan 2026, where companies like SoftBank and NTT DOCOMO showed interest in using it for their AI data centers

.


Aitra's Key Metric: Joules Per Token

The core measurement is called aitra_j_per_token — joules (energy) divided by output tokens (work done)

.

Lower is better. A lower number means your AI is more efficient — it produces more output for less energy.

Aitra also tracks:

  • aitra_idle_time_ratio — How often GPUs sit unused

  • aitra_gpu_power_watts — Real-time power draw

These metrics integrate with Kubernetes and tools like KAI Scheduler to automatically place AI workloads on the most efficient nodes

.


Who Should Use SODA Foundation and Aitra?

Perfect for you if:

  • You run AI models on GPUs (cloud or on-premise)

  • Your electricity bill for AI is growing

  • You need to report carbon/energy usage

  • You want to optimize costs across teams

Not needed if:

  • You only use basic website hosting

  • Your AI usage is minimal (under a few hours daily)


The Bigger Picture: Green AI Matters

As AI becomes more common, energy consumption is exploding. Data centers already use ~1-2% of global electricity, and AI is pushing that higher.

Aitra represents a shift toward accountable AI — where companies can measure and reduce their AI carbon footprint, not just chase performance.


Suggested Searches

Try these on Google to learn more:

  • SODA Foundation Aitra energy measurement

  • AI inference energy efficiency Kubernetes

  • GPU power consumption monitoring open source

  • green AI carbon footprint tools

Related Links:

No comments:

Post a Comment