AI

Beware AI’s hidden costs before they bankrupt innovation

Comment

ladders leading from one cloud to another; cloud migration
Image Credits: Baac3nes (opens in a new window) / Getty Images

Mark Troller

Contributor
Mark Troller, chief information officer at Tangoe, Inc., brings over 20 years of diverse IT leadership experience from a range of industries, including telecom, cable television, internet advertising, and financial services.

As the lynchpin of digital innovation, artificial intelligence holds the future for every forward-leaning business. But while AI and generative AI pave a path toward opportunity, they come with financial sustainability risks that can threaten the durable use of these technologies.

Unpacking this issue requires understanding AI’s addiction to the cloud. AI relies heavily on cloud storage and computing powers. Separate, they are nothing, but together, AI has velocity.

Cloud infrastructure and applications give advanced analytics, hyper-automation, and large language models the fast, scalable delivery channels they need to be effective. But this also triggers cloud expenditures that can go unforeseen and undetected. The Wall Street Journal recently published an article on how AI is impacting the ability to control cloud costs. Hidden infrastructure and application costs pile expenses on an already tricky cloud dynamic:

When you factor in AI’s costly yet indispensable ally with the high demands for new GenAI tools, it’s easy to see why investment strategies can quickly become financially unsustainable. GenAI is driving another layer of technical debt for many businesses. Under the pressures of constant innovation, we could see the AI cloud grow at new, record-breaking speeds. As these factors come together in 2024, we may even see cloud hangovers of the past three years grow into full-fledged AI-cloud bankruptcies. Hidden costs have the potential to bankrupt AI innovation because they limit the ability for CIOs and CFOs to create new budgets, finding funding from within as a means to sustain the economic cycles of digital transformation.

Investments in AI become untenable when costs outpace the value delivered or the growth of the business overall. One of the most significant innovation pitfalls is failing to account for contributing costs, including the underlying network platform and expertise needed to support AI. Returns must cover fully loaded expenses without increasingly consuming more of the IT budget — not to mention the IT staff’s time.

To keep disruptive technologies from disrupting financial futures, executives must navigate the adverse economics of innovation, drawing more attention to the sustainability of emerging technologies.

AI’s financial watchdog: Lean portfolio management

Research from Gartner shows that by 2025, “70% of digital investments will fail to deliver expected business outcomes due to the absence of strategic portfolio management.” Sometimes referred to as IT business management, the practice of technology portfolio management executes an innovation strategy while staying within the confines of financial and human resource constraints. To be resilient in their ability to innovate, companies should consider these key focal points.

Dispel misconceptions: AI automation means less to do but more to manage

Yes, AI automates operations, leading to productivity gains. However, it’s essential to acknowledge that investments require a paradigm shift in expense management. On-demand cloud resources and variable pricing structures offer favorable pay-for-what-you-use terms and infinitely scalable costs amid increased consumption habits.

Financial leaders should tighten their grip with visibility, control, and predictability in mind when investing in dynamically scalable technologies, as these are the guideposts for ultimately driving sustainable innovation.

  • Look closely at your returns. Accelerated ROI (return on investment) can be achieved by closely aligning AI to business goals, prioritizing projects with quick wins, and regularly assessing the impact of AI on metrics. These are critical in attaining business value faster.
  • Control and track both direct and indirect costs. Cloud financial management strategies, including FinOps, put governance in place with spending thresholds and proactive alerts. They also monitor all-in costs using chargebacks to connect expenditures to innovation projects and business lines to better trace results.
  • Use AI to counterbalance AI’s side effects. While AI can spur more cloud expenses, it can also help control them. Advanced cost management platforms can find sources of overspending in multi-cloud environments and pinpoint the most cost-effective infrastructure configurations, making changes automatically.

Address friction points: Bring finance and tech together to cultivate accountability

Speed of innovation is a must, but as companies open the taps on AI, spending becomes decentralized, which makes cost control more difficult. Inherently, executives, line-of-business leaders, and employees want purchasing power, but financial checks and balances are necessary for risk management. CEO mandates can clash with risk appetites. This tension can create internal resistance and contention as innovation leaders are under increasing pressure to transform digitally. In contrast, financial leaders need to balance controls to tune spending continuously.

  • Align tech and finance leaders and their teams under the assumption that AI and cloud spending will grow in ways that call for more collaboration, visibility, and real-time controls.
  • Just-in-time approaches can help make the necessary mental shifts, constantly matching resources to demands with a commitment to rightsizing and reducing waste.
  • Foster a culture of accountability, ensuring that financial responsibility permeates IT while digital innovation permeates finance. Rather than viewing innovation as individual projects, it should be seen as a broad enabler where sound personal investments facilitate continuous widespread advancements.

Affording AI transformation with minimal impact

AI’s addiction to cloud computing conceals a financial sustainability challenge that creates another impetus for guarded rationalization. The escalating impact of AI on cloud costs, the looming threat of “cloud inflation,” and the demand for GenAI raise concerns about unforeseen expenditures and AI’s ability to afford positive business outcomes with minimal impact in the near- and long-term.

AI promises unprecedented business growth, but companies must take charge of their tech portfolios to avert the risk of AI-cloud bankruptcies in 2024. Managing expenses and fostering a culture of accountability are crucial strategies. By aligning innovation with financial responsibility, businesses can capitalize on the limitless potential of AI without compromising their ability to transform reliably. Extending the useful life of AI will help extract more business value while also putting less pressure on innovation leaders.

More TechCrunch

A police officer pulled over a self-driving Waymo vehicle in Phoenix after it ran a red light and pulled into a lane of oncoming traffic, according to dispatch records. The…

Waymo robotaxi pulled over by Phoenix police after driving into the wrong lane

Welcome back to TechCrunch’s Week in Review — TechCrunch’s newsletter recapping the week’s biggest news. Want it in your inbox every Saturday? Sign up here. This week, Figma CEO Dylan…

Figma pauses its new AI feature after Apple controversy

We’ve created this guide to help parents navigate the controls offered by popular social media companies.

How to set up parental controls on Facebook, Snapchat, TikTok and more popular sites

Featured Article

You could learn a lot from a CIO with a $17B IT budget

Lori Beer’s work is a case study for every CIO out there, most of whom will never come close to JP Morgan Chase’s scale, but who can still learn from how it goes about its business.

20 hours ago
You could learn a lot from a CIO with a $17B IT budget

For the first time, Chinese government workers will be able to purchase Tesla’s Model Y for official use. Specifically, officials in eastern China’s Jiangsu province included the Model Y in…

Tesla makes it onto Chinese government purchase list

Generative AI models don’t process text the same way humans do. Understanding their “token”-based internal environments may help explain some of their strange behaviors — and stubborn limitations. Most models,…

Tokens are a big reason today’s generative AI falls short

After multiple rejections, Apple has approved Fortnite maker Epic Games’ third-party app marketplace for launch in the EU. As now permitted by the EU’s Digital Markets Act (DMA), Epic announced…

Apple approves Epic Games’ marketplace app after initial rejections

There’s no need to worry that your secret ChatGPT conversations were obtained in a recently reported breach of OpenAI’s systems. The hack itself, while troubling, appears to have been superficial…

OpenAI breach is a reminder that AI companies are treasure troves for hackers

Welcome to Startups Weekly — TechCrunch’s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Most…

Space for newcomers, biotech going mainstream, and more

Elon Musk’s X is exploring more ways to integrate xAI’s Grok into the social networking app. According to a series of recent discoveries, X is developing new features like the…

X plans to more deeply integrate Grok’s AI, app researcher finds

We’re about four months away from TechCrunch Disrupt 2024, taking place October 28 to 30 in San Francisco! We could not bring you this world-class event without our world-class partners…

Meet Brex, Google Cloud, Aerospace and more at Disrupt 2024

In its latest step targeting a major marketplace, the European Commission sent Amazon another request for information (RFI) Friday in relation to its compliance under the bloc’s rulebook for digital…

Amazon faces more EU scrutiny over recommender algorithms and ads transparency

Quantum Rise, a Chicago-based startup that does AI-driven automation for companies like dunnhumby (a retail analytics platform for the grocery industry), has raised a $15 million seed round from Erie…

Quantum Rise grabs $15M seed for its AI-driven ‘Consulting 2.0’ startup

On July 4, YouTube released an updated eraser tool for creators so they can easily remove any copyrighted music from their videos without affecting any other audio such as dialog…

YouTube’s updated eraser tool removes copyrighted music without impacting other audio

Airtel, India’s second-largest telecom operator, on Friday denied any breach of its systems following reports of an alleged security lapse that has caused concern among its customers. The telecom group,…

India’s Airtel dismisses data breach reports amid customer concerns

According to a recent Dealroom report on the Spanish tech ecosystem, the combined enterprise value of Spanish startups surpassed €100 billion in 2023. In the latest confirmation of this upward trend, Madrid-based…

Spain’s exposure to climate change helps Madrid-based VC Seaya close €300M climate tech fund

Forestay, an emerging VC based out of Geneva, Switzerland, has been busy. This week it closed its second fund, Forestay Capital II, at a hard cap of $220 million. The…

Forestay, Europe’s newest $220M growth-stage VC fund, will focus on AI

Threads, Meta’s alternative to Twitter, just celebrated its first birthday. After launching on July 5 last year, the social network has reached 175 million monthly active users — that’s a…

A year later, what Threads could learn from other social networks

J2 Ventures, a firm led mostly by U.S. military veterans, announced on Thursday that it has raised a $150 million second fund. The Boston-based firm invests in startups whose products…

J2 Ventures, focused on military healthcare, grabs $150M for its second fund

HealthEquity said in an 8-K filing with the SEC that it detected “anomalous behavior by a personal use device belonging to a business partner.”

HealthEquity says data breach is an ‘isolated incident’

Roll20 said that on June 29 it had detected that a “bad actor” gained access to an account on the company’s administrative website for one hour.

Roll20, an online tabletop role-playing game platform, discloses data breach

Fisker has a willing buyer for its remaining inventory of all-electric Ocean SUVs, and has asked the Delaware Bankruptcy Court judge overseeing its Chapter 11 case to approve the sale.…

Fisker asks bankruptcy court to sell its EVs at average of $14,000 each

Teddy Solomon just moved to a new house in Palo Alto, so he turned to the Stanford community on Fizz to furnish his room. “Every time I show up to…

Fizz, the anonymous Gen Z social app, adds a marketplace for college students

With increasing competition for what is, essentially, still a small number of hard tech and deep tech deals, Sidney Scott realized it would be a challenge for smaller funds like…

Why deep tech VC Driving Forces is shutting down

A guide to turn off reactions on your iPhone and Mac so you don’t get surprised by effects during work video calls.

How to turn off those silly video call reactions on iPhone and Mac

Amazon has decided to discontinue its Astro for Business device, a security robot for small- and medium-sized businesses, just seven months after launch.  In an email sent to customers and…

Amazon retires its Astro for Business security robot after only 7 months

Hiya, folks, and welcome to TechCrunch’s regular AI newsletter. This week in AI, the U.S. Supreme Court struck down “Chevron deference,” a 40-year-old ruling on federal agencies’ power that required…

This Week in AI: With Chevron’s demise, AI regulation seems dead in the water

Noplace had already gone viral ahead of its public launch because of its feature that allows users to express themselves by customizing the colors of their profile.

noplace, a mashup of Twitter and Myspace for Gen Z, hits No. 1 on the App Store

Cloudflare analyzed AI bot and crawler traffic to fine-tune automatic bot detection models.

Cloudflare launches a tool to combat AI bots

Twilio says “threat actors were able to identify” phone numbers of people who use the two-factor app Authy.

Twilio says hackers identified cell phone numbers of two-factor app Authy users