← The Vault
At Work

How businesses are figuring out what AI actually costs

As companies move past simple experiments with AI, they face a reality check on infrastructure costs and security. A new research push aims to help technical leaders navigate the hidden plumbing of AI, from managing multiple service providers to fixing wasted computing power, moving beyond the surface-level hype to understand how these systems perform under real-world pressure.

Edition № 440Room: At Work20 August 20262 min readSources: 1
Article

Most of us know AI as a chatbot that answers questions or writes emails. But for large companies, AI is not just a tool; it is a massive, expensive piece of machinery that needs to be plugged into everything else they do. Lately, the people in charge of buying and building this technology are finding that reality is much messier than the marketing suggests.

WHAT'S HAPPENING

VentureBeat has hired a veteran analyst, Rob Strechay, to lead a new effort focused on the technical side of business AI. Instead of covering news, this work aims to answer the specific, difficult questions company leaders face when they try to move AI from a fun test project to something that runs their daily operations. These leaders want to know how to connect different AI tools from different companies, how to keep their data secure, and why their expensive computer systems are being drained of resources.

The hidden cost of AI

HOW IT WORKS

To understand why this matters, imagine your company is building a high-tech kitchen. At first, you just wanted a toaster, and any brand would do. Now, you are trying to build a restaurant-grade automated kitchen. You realize that you cannot just buy one brand of oven; you need different machines for different tasks, and they all need to be connected to the same power grid. If they are not coordinated, they will blow a fuse or waste power even when they are not cooking anything.

This is the current state of enterprise AI. Companies often use different AI tools together, which requires careful setup to ensure the software pieces talk to each other correctly. They also use a method called retrieval-augmented generation, or RAG, which acts like a librarian that finds and feeds specific, private company documents to the AI so it can answer questions based on facts rather than just general knowledge. When these systems become complex enough to perform tasks automatically on behalf of the company, they are often called agents. Managing the data flow, security, and connection points for these automated tools creates massive plumbing problems. If the pipes are not built right, the system becomes slow or insecure. Infrastructure analysis is the job of checking those pipes to see where the leaks are.

WHY IT MATTERS

For the average person, this transition represents a quiet, critical shift. We are moving away from the era where AI was a flashy new toy. We are entering the era of infrastructure, where the most important question is not what the AI can say, but whether it can be built to run reliably without bankrupting the company or creating a security disaster. When companies succeed at this, AI becomes as boring and reliable as electricity. Until then, the focus will remain on the hard work of building and maintaining the engine room, rather than just enjoying the output.

Sources
← PreviousCan robots learn to improvise like a child?Next →Why Silicon Valley keeps missing the point of AI backlash
Tomorrow's edition · free

Liked this one? The next lands at breakfast.

Every story in tomorrow's AI news, rebuilt in plain English — five minutes, sources linked, free forever.

By joining you agree to receive Article's daily newsletter — unsubscribe in one click. Privacy

← Back to the Vault