AI

Microsoft unveils new AI tools Copilot Azure, Copilot for Service and Copilot Studio at Ignite event

Comment

Copilot, Microsoft’s brand of generative AI technologies, promises to be a big moneymaker for the company, with one analyst predicting that it could generate $10 billion in annualized revenue by 2026. Despite a staggered and somewhat confusing rollout, 40% of companies in the Fortune 100 were testing Copilot by fall, according to Microsoft CEO Satya Nadella. Forrester predicts, meanwhile, that 6.9 million U.S. knowledge workers will be using some form of Copilot in 2024.

And so Microsoft’s quest to grow the tech continues.

During Microsoft Ignite 2023, the company took the wraps off of three new Copilot offerings across its software and services portfolio: Copilot for Azure, Copilot for Service and Copilot in Dynamics 365 Guides. The company also launched Copilot Studio, a new platform that delivers tools for connecting Copilot for Microsoft 365 — the Copilot in apps like Excel, Word and PowerPoint as well as Microsoft’s Edge browser and Windows — to third-party data.

Copilot for Azure

Copilot for Azure, which is now available in preview, is Microsoft’s answer to the recently announced Duet AI in Google Cloud. Like Google’s AI, Copilot for Azure takes the form of a chat-driven assistant for cloud customers, suggesting configurations for apps and environments and helping with troubleshooting by identifying potential issues — and solutions.

“Microsoft Copilot for Azure is integrated into the Azure platform, right into the Azure portal where IT teams work,” Erin Chapple, CVP of Azure core product and design, told TechCrunch in an email interview. “Through a unified chat experience, they can easily ask questions, get insights into their workloads, infrastructure and cloud functionality and take action.”

Copilot for Azure
Image Credits: Microsoft

Copilot for Azure can respond to questions like “Copilot, how many cloud resources do I have?” in addition to more complex queries and requests such as “Copilot, what data store should I use for my application?” and “Copilot, create the command-line interface to perform this action.” (Imagine OpenAI’s ChatGPT, but for Azure-related tasks.) Leveraging a combination of generative AI models, specifically large language models (LLMs), Copilot for Azure pulls in knowledge from technical documentation plus users’ individual setups and policies.

“Using the power of LLMs, Copilot reasons over the customer’s data that we have in Azure … that defines everything that’s been deployed and running for that customer and all of its characteristics,” Chapple said. “We’re reasoning on top of things like metrics and monitoring data so that customers can ask questions and understand patterns in their data.”

But given that generative AI is prone to making mistakes, can Copilot in Azure be trusted? Maybe — at least depending on your risk tolerance. Chapple says that users can always ask Copilot in Azure how it landed on a recommendation or to explain its reasoning.

Copilot for Azure
Image Credits: Microsoft

“Currently,” Chapple said, “we envision customers will use Copilot for Azure in four activities: designing (configuring the right services for their applications and environment), operating (answering questions, authoring … commands and acting on their behalf), troubleshooting (orchestrating data across Azure services for insights) and optimizing (improving costs, scalability, security and reliability through recommendations for their environment).”

Chapple claims that Copilot for Azure has already been used by more than 15,000 internal users and a “handful” of private preview customers. “We’ll continually add skills as we learn through the preview, expanding the ways in which it can help,” she added.

Copilot for Service

Copilot for Service is a different animal. Designed for customer service use cases, it integrates with customer relationship management (CRM) software including Microsoft’s own Dynamics 365, Salesforce, SAP, Workday and ServiceNow to answer sales-related questions and offer next-step suggestions.

Copilot for Service — which can be embedded at the Windows desktop level or deployed via Microsoft Teams — can answer commonly asked questions from customer service agents by drawing on a company’s websites, knowledge articles, offline databases and more. Those same agents can ask Copilot for Service to provide them with account and case information from CRM systems when — and in theory, where — they need it.

Copilot for Service
Image Credits: Microsoft

Functionality seems a bit limited at launch, but Microsoft’s promising a lot to come as the service evolves. Soon, the company says, Copilot for Service will be able to make proactive recommendations for creating or updating existing “knowledge assets” (e.g. articles) based on emails, customer service cases, Teams chats and more. And it’ll enrich email summaries and drafts in Outlook and meeting recaps in Teams with data from CRMs, giving users the ability to view and update CRM records directly in Outlook and Teams and automate tasks like case wrap-ups, meeting scheduling, task follow-ups and adding new contacts.

Readers might recall Microsoft introduced a customer service-focused Copilot, Copilot in Dynamics 365 Customer Service, in March with a comparable feature set. So what’s the difference between the two? Well, minimal — except that Copilot for Service comes with Copilot for Microsoft 365 and can be customized via the new Copilot Studio. (More on Copilot Studio down below.)

Copilot for Service will be available in public preview in early December, Microsoft says, priced at $50 per user per month. (That’s higher than Microsoft’s pricing for Microsoft 365 Copilot, which starts at $30 per user per month — likely reflecting the steep cost of running AI models at scale.) The company’s targeting Q1 2024 for general availability.

Copilot in Dynamics 365 Guides

Copilot in Dynamics 365 Guides might be among Microsoft’s more ambitious Copilot launches.

Designed to work best on the company’s HoloLens 2 headset, with support for mobile devices to follow several preview periods, Copilot in Dynamics 365 Guides taps generative AI to summarize information potentially useful to frontline workers and translate those summaries into overlays on equipment that they’re maintaining.

Using Copilot in Dynamics 365 Guides, workers can point to or look at a component and ask questions such as “What’s the torque limit for these bolts?,” “Which direction does this part fit?” and “Walk me through the steps to disassemble this filtration unit.” Copilot will recognize what’s being referred to or pointed at and provide answers, projecting instructions on the HoloLens 2’s heads-up display.

The more information Copilot in Dynamics 365 Guides can access (e.g. technical documentation, internet of things sensors, service records, operational data, notes, transcripts, training content and so on), the more domain- and company-specific questions it can answer, Microsoft says. The OpenAI generative AI models underpinning the service decipher what’s on the HoloLens 2’s camera and show diagrams — or even read summaries aloud — to elucidate particular steps and solutions.

Copilot in Dynamics 365 Guides
Image Credits: Microsoft

It’s all very interesting in a sci-fi, “Minority Report” sort of way. But I’m skeptical that the new Copilot will work quite as well as Microsoft promises. Understanding images and text is tough enough for generative AI, much less dealing with imperfect viewing conditions (dimly lit smokey factories, for instance) and niche machinery.

Microsoft’s decision to launch Copilot in Dynamics 365 Guides first in private preview with “a limited set of customers and capabilities” suggests there’s indeed some kinks to work out. Color me intrigued, though. I’m curious to see where this Copilot goes — and how it measures up to attempts from various startups in the field service space.

Copilot Studio

Copilot Studio — the last of today’s Copilot-related announcements — is Microsoft’s attempt to make its Copilot products more extensible for business customers. Microsoft telegraphed Copilot fine-tuning, Copilot Studio’s principal feature, some time ago, but the emergence of countless generative AI-powered chatbot builders — many of which can connect LLMs to proprietary company data — no doubt put the pressure on.

With the web-based Copilot Studio, which is now available in public preview for existing Copilot for Microsoft 365 subscribers, an enterprise can give Copilot for Microsoft 365 and Copilot for Service access to data in its CRMs, enterprise resource management systems and other databases and data stores using prebuilt connectors or ones that it builds itself. (Microsoft plans to expand Copilot Studio’s controls to additional Copilots at some point, but it’s starting with just these few.) Through Copilot Studio, customers can also ensure Copilots always respond in a certain way to certain questions (say, onboarding questions), and — arguably more significantly — create and publish their own tailored “copilots.”

Copilot Studio
Image Credits: Microsoft

“Copilot Studio plays an important role in Microsoft’s Copilot strategy,” Omar Aftab, VP of conversational AI at Microsoft, told TechCrunch via email. “What Microsoft heard from customers is that they want to customize and extend copilots with their unique business processes and data for enterprise-specific scenarios. Now, with Copilot Studio, they can easily do so. Similarly, customers wanting to build their own custom standalone Copilot experience can now do so and publish it to the channel of their choice.”

Any user with the proper license can tap Copilot Studio to create a custom copilot — e.g. a chatbot for expense management — by describing it in natural language. Copilot Studio will provide a starting point and send the copilot to a “canvas” UI with collaborative tools, among them a commenting system and side-by-side coding views, that can be used to refine it.

Customers can build copilots that filter to specific datasets for particular teams or users. Or they can connect a copilot to an automation, plug-in or third-party service to kick off actions or a workflow.

Copilot Studio
Image Credits: Microsoft

Once finalized in Copilot Studio, copilots can be deployed across a range of channels, including websites and social media platforms. A dashboard shows the status of running copilots and who’s building and customizing them, along with controls for securing copilot data using access policies and managing deployment environments.

“Copilot Studio exposes a full end-to-end lifecycle for Copilots within a single pane — you can build, deploy, analyze and manage Copilots all from within the same web experience,” Aftab said. “And since it’s software-as-a-service, everything you build is live instantly.”

One wonders whether Microsoft has the data center capacity to host an untold number of custom copilots, considering the company’s recent struggles on that front. But Microsoft’s nothing if not confident — it’s offering Copilot Studio as a purchasable capacity-based license, aiming to drive adoption not only of the Copilot ecosystem but of the ever-growing Azure product lineup.

For more Microsoft Ignite 2023 coverage:

This story was originally published at 8am PT on Nov. 15 and updated at 3:15pm PT.

More TechCrunch

Featured Article

CIOs’ concerns over generative AI echo those of the early days of cloud computing

CIOs trying to govern generative AI have the same concerns they had about cloud computing 15 years ago, but they’ve learned some things along the way.

6 mins ago
CIOs’ concerns over generative AI echo those of the early days of cloud computing

It sounds like the latest dispute between Apple and Fortnite-maker Epic Games isn’t over. Epic has been fighting Apple for years over the company’s revenue-sharing requirements in the App Store.…

Epic Games CEO promises to ‘fight’ Apple over ‘absurd’ changes

As deep-pocketed companies like Amazon, Google and Walmart invest in and experiment with drone delivery, a phenomenon reflective of this modern era has emerged. Drones, carrying snacks and other sundries,…

What happens if you shoot down a delivery drone?

A police officer pulled over a self-driving Waymo vehicle in Phoenix after it ran a red light and pulled into a lane of oncoming traffic, according to dispatch records. The…

Waymo robotaxi pulled over by Phoenix police after driving into the wrong lane

Welcome back to TechCrunch’s Week in Review — TechCrunch’s newsletter recapping the week’s biggest news. Want it in your inbox every Saturday? Sign up here. This week, Figma CEO Dylan…

Figma pauses its new AI feature after Apple controversy

We’ve created this guide to help parents navigate the controls offered by popular social media companies.

How to set up parental controls on Facebook, Snapchat, TikTok and more popular sites

Featured Article

You could learn a lot from a CIO with a $17B IT budget

Lori Beer’s work is a case study for every CIO out there, most of whom will never come close to JP Morgan Chase’s scale, but who can still learn from how it goes about its business.

22 hours ago
You could learn a lot from a CIO with a $17B IT budget

For the first time, Chinese government workers will be able to purchase Tesla’s Model Y for official use. Specifically, officials in eastern China’s Jiangsu province included the Model Y in…

Tesla makes it onto Chinese government purchase list

Generative AI models don’t process text the same way humans do. Understanding their “token”-based internal environments may help explain some of their strange behaviors — and stubborn limitations. Most models,…

Tokens are a big reason today’s generative AI falls short

After multiple rejections, Apple has approved Fortnite maker Epic Games’ third-party app marketplace for launch in the EU. As now permitted by the EU’s Digital Markets Act (DMA), Epic announced…

Apple approves Epic Games’ marketplace app after initial rejections

There’s no need to worry that your secret ChatGPT conversations were obtained in a recently reported breach of OpenAI’s systems. The hack itself, while troubling, appears to have been superficial…

OpenAI breach is a reminder that AI companies are treasure troves for hackers

Welcome to Startups Weekly — TechCrunch’s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Most…

Space for newcomers, biotech going mainstream, and more

Elon Musk’s X is exploring more ways to integrate xAI’s Grok into the social networking app. According to a series of recent discoveries, X is developing new features like the…

X plans to more deeply integrate Grok’s AI, app researcher finds

We’re about four months away from TechCrunch Disrupt 2024, taking place October 28 to 30 in San Francisco! We could not bring you this world-class event without our world-class partners…

Meet Brex, Google Cloud, Aerospace and more at Disrupt 2024

In its latest step targeting a major marketplace, the European Commission sent Amazon another request for information (RFI) Friday in relation to its compliance under the bloc’s rulebook for digital…

Amazon faces more EU scrutiny over recommender algorithms and ads transparency

Quantum Rise, a Chicago-based startup that does AI-driven automation for companies like dunnhumby (a retail analytics platform for the grocery industry), has raised a $15 million seed round from Erie…

Quantum Rise grabs $15M seed for its AI-driven ‘Consulting 2.0’ startup

On July 4, YouTube released an updated eraser tool for creators so they can easily remove any copyrighted music from their videos without affecting any other audio such as dialog…

YouTube’s updated eraser tool removes copyrighted music without impacting other audio

Airtel, India’s second-largest telecom operator, on Friday denied any breach of its systems following reports of an alleged security lapse that has caused concern among its customers. The telecom group,…

India’s Airtel dismisses data breach reports amid customer concerns

According to a recent Dealroom report on the Spanish tech ecosystem, the combined enterprise value of Spanish startups surpassed €100 billion in 2023. In the latest confirmation of this upward trend, Madrid-based…

Spain’s exposure to climate change helps Madrid-based VC Seaya close €300M climate tech fund

Forestay, an emerging VC based out of Geneva, Switzerland, has been busy. This week it closed its second fund, Forestay Capital II, at a hard cap of $220 million. The…

Forestay, Europe’s newest $220M growth-stage VC fund, will focus on AI

Threads, Meta’s alternative to Twitter, just celebrated its first birthday. After launching on July 5 last year, the social network has reached 175 million monthly active users — that’s a…

A year later, what Threads could learn from other social networks

J2 Ventures, a firm led mostly by U.S. military veterans, announced on Thursday that it has raised a $150 million second fund. The Boston-based firm invests in startups whose products…

J2 Ventures, focused on military healthcare, grabs $150M for its second fund

HealthEquity said in an 8-K filing with the SEC that it detected “anomalous behavior by a personal use device belonging to a business partner.”

HealthEquity says data breach is an ‘isolated incident’

Roll20 said that on June 29 it had detected that a “bad actor” gained access to an account on the company’s administrative website for one hour.

Roll20, an online tabletop role-playing game platform, discloses data breach

Fisker has a willing buyer for its remaining inventory of all-electric Ocean SUVs, and has asked the Delaware Bankruptcy Court judge overseeing its Chapter 11 case to approve the sale.…

Fisker asks bankruptcy court to sell its EVs at average of $14,000 each

Teddy Solomon just moved to a new house in Palo Alto, so he turned to the Stanford community on Fizz to furnish his room. “Every time I show up to…

Fizz, the anonymous Gen Z social app, adds a marketplace for college students

With increasing competition for what is, essentially, still a small number of hard tech and deep tech deals, Sidney Scott realized it would be a challenge for smaller funds like…

Why deep tech VC Driving Forces is shutting down

A guide to turn off reactions on your iPhone and Mac so you don’t get surprised by effects during work video calls.

How to turn off those silly video call reactions on iPhone and Mac

Amazon has decided to discontinue its Astro for Business device, a security robot for small- and medium-sized businesses, just seven months after launch.  In an email sent to customers and…

Amazon retires its Astro for Business security robot after only 7 months

Hiya, folks, and welcome to TechCrunch’s regular AI newsletter. This week in AI, the U.S. Supreme Court struck down “Chevron deference,” a 40-year-old ruling on federal agencies’ power that required…

This Week in AI: With Chevron’s demise, AI regulation seems dead in the water