04/11/2026
Data nobody chose to include
There's a second way this goes wrong, and it's quieter.
The first is someone finding data they shouldn't. The second is someone using data without knowing it's there.
Picture a manager asking an AI assistant to draft a summary for a leadership meeting. A perfectly reasonable request. The assistant pulls from whatever the manager can access and builds a clear, confident answer in a few seconds, with a good structure and a professional tone.
What the manager doesn't see is where each part came from. One line draws on a document from another team. A figure comes from a file that was only ever meant for finance. A note about a restructure, never intended for circulation, quietly shapes a paragraph. Nothing is flagged. It reads well.
The manager did nothing wrong. They asked a normal question. But the output now carries information they didn't choose to include and can't easily trace. They're busy, the summary looks right, and it goes into the pack.
That's a different kind of risk. It isn't a hacker or a rogue employee. It's an honest person, a helpful tool, and data that was in the wrong place.
It's also harder to spot than the first scenario, because nothing looks wrong at the time. The output looks fine. The problem only shows up later, if at all. Perhaps when someone in the meeting asks where a number came from. Perhaps when the document is forwarded outside the organisation. Perhaps never, which is its own kind of problem.
Many traditional controls were built to watch for people copying files, emailing attachments and uploading to personal storage. They're much less suited to information being summarised, rewritten and folded into a new document that looks entirely original.
The common thread with the first scenario is that the fix doesn't sit with the user. You can't train every manager to second-guess every sentence an assistant writes. The fix sits upstream, in knowing what sensitive data you hold and making sure it isn't sitting where an assistant can reach it unnecessarily.
How would your organisation know if something sensitive had found its way into an AI-drafted document?
www.shadowsight.io