Decision IntelligenceJan 20, 2026Alejandro Caldentey

Querying your data in natural language: what is real and what is hype

The promise is seductive: type "how are sales of line A doing this quarter?" and get the answer, without knowing SQL or touching a dashboard. The technology exists and it works. But only if you have first done a piece of work almost nobody tells you about.

What this actually is, minus the marketing

The promise is seductive: you type "how are sales of line A doing this quarter?" and you get the answer, without knowing SQL or opening a dashboard. That is conversational analytics. Tools like Power BI Copilot, Power BI Q&A, the Microsoft Fabric copilot or text-to-SQL systems translate your plain-language question into a query over your data and hand you back the number or the chart.

The underlying idea is to democratize access: let the sales director ask directly, without depending on someone building the report every time. The technology exists, it sits inside products you already use, and it works. The catch is in that word, "works".

Why this is more than a fad

The way data gets consumed is genuinely changing. Static dashboards can no longer keep up with the demand for instant answers, and conversational assistants are starting to live where you already work: inside Teams, inside Slack, inside Office itself. For a small business without a dedicated analyst, being able to ask and get an answer in the moment is, potentially, a big change in how decisions get made.

Where it breaks, and why it almost always breaks the same way

Here is the part the demos do not show. Text-to-SQL systems with no business context get very little right on real, complex questions. The ones that reach usable reliability, around 70-85%, do not get there by pointing at your whole warehouse: they expose only five to ten carefully curated views, not the raw tables. And the number one reason these projects stall halfway is a fragmented semantic layer.

In plain terms: if the tool does not know exactly what "sale", "active customer" or "margin" means in your company, it is going to invent a plausible definition and hand you a number wearing a confident face. And that is the worst possible outcome.

An AI that puts a figure on the wrong word is more dangerous than having no figure at all. Because you believe it.

The piece nobody wants to build: the semantic layer

The semantic layer sounds technical, but in small-business terms it is simply the official dictionary of your business. What a sale is and when it counts. What goes into margin and what does not. Who you consider an active customer. It is the place where your company agrees on what its own words mean, and where the tool reads from.

Gartner's guidance for 2025 flags it as non-negotiable for AI to get things right. It is not glamorous, it does not show up in the demo, but it is exactly what separates "I ask it and I trust it" from "I ask it and then I check by hand, so what do I want it for".

This is the same old story, with a new face

My underlying thesis is this: conversational analytics does not change the rules, it makes them more obvious. It is still true that the foundation comes first (centralized data, defined metrics, a single source of truth) and the pretty layer goes on top. What has changed is that now the pretty layer talks, and that is why it fools people more. An answer written in natural language looks more trustworthy than a dashboard, even when underneath it is exactly as broken.

What you need in place before buying anything

The list is short and unexciting. Your relevant data in one common place, not scattered across silos. Your key metrics defined and documented. A small set of clean, agreed-upon views the tool can use. And clarity on who is accountable for the quality of all of it. With those four points, almost any copilot on the market will work for you. Without them, the best copilot will lie to you politely.

How to test it properly, if you want to test it

A practical tip: do not evaluate it with the easy demo question. Evaluate it with three real business questions whose correct answers you already know in advance. If it gets all three right on your data, you have something real. If it gets one wrong and delivers it with the same confidence as the other two, you now know you cannot yet delegate any decision that matters to it.

The takeaway

Querying your data in natural language is going to become the norm, probably sooner than we think. But the tool is not what decides whether it works: the data work underneath it does. And the good news is that this work is not for the AI, it is for you. The day your metrics are in order, they serve you no matter how you ask, with a copilot or without one.

Want to ask your data a question and trust the answer?

Take the free self-assessment in 5 minutes, or book a call and we look at it together.