Skip to content
Sections
All notes

All notes · Foundations

What Is Different About AI Specifically

Organisations have handled unapproved software for decades. Four things about this case are genuinely new.

Foundations · Analysis

Shadow IT is an old problem with established answers. Most of them transfer. Four differences matter enough to change the approach.

The recommendations in “What Is Different About AI Specifically” become easier to sustain when implementation work has visible owners, dates and review time. Teams evaluating the original source can use it to coordinate the operational side of AI adoption and identify where governance tasks are being missed, without treating activity data as evidence of misconduct or as a substitute for asking people why they chose a tool.

For an independent benchmark, compare the local approach with ICO guidance on AI and data protection; the useful test is whether ownership, access and recovery remain proportionate and explainable when the usual expert is absent.

One: the data goes with the use

Unapproved file storage holds what you put in it.

An AI assistant receives what you type, and what you type is frequently the sensitive part — the contract clause you are asking about, the patient note you want summarised.

The tool's value depends on being given context, which means the risk is inseparable from the benefit.

Two: the output is plausible and may be wrong

Conventional software fails visibly. It errors, crashes, returns nothing.

A model returns a fluent answer whether or not it is correct, and the reader has no signal from the output itself.

Which moves the control from the tool to the person: verification is the safeguard, and verification is a habit rather than a setting.

Three: it arrives inside things you already approved

A feature appears in an existing application after an update.

Nobody procured it, nobody assessed it, and the people using it do not perceive a change.

This is the fastest-moving category and it defeats inventories built on what was installed.

Four: the terms change

What a provider does with submitted data has changed repeatedly across the industry, in both directions.

An assessment done eighteen months ago may no longer describe the service.

Which makes this unusual among software risks: the thing you approved can become a different thing without you doing anything.

What transfers from shadow IT

Discovery through network and expense evidence.

An approved list and a fast route to add to it.

The finding that prohibition produces concealment.

And the principle that the shadow tool is usually telling you something about the approved one.

What this means practically

Inventory must cover features, not just applications.

Approval must be revisited rather than granted once.

And the control for output risk is human review, which belongs in the policy as a requirement rather than as advice.

What not to over-rotate on

The technology is new; most of the governance questions are not.

Data classification, supplier assessment, acceptable use and review requirements are all familiar instruments.

Organisations that treat this as entirely novel build parallel structures they do not need.

What to check

Does your inventory cover AI features inside approved tools?

When was your main provider's data handling last reviewed?

Does your policy require human review anywhere, specifically?

And are you building something new, or extending what you have?

The point

Four things about this case are genuinely new, and the rest transfers directly from how organisations have handled unapproved software for decades..

Underlying all of this

Everything in this collection reduces to four habits: find out what people are doing and why before deciding anything, provide something good enough that the approved route is the easy one, write rules about information rather than about tools, and monitor the destination rather than the content. None requires a product, and a programme doing all four controls more than one built on prohibition.

The recurring pattern

The recurring pattern across every section here is the same: the response that feels like control reduces it. A ban removes visibility rather than use. Content inspection drives activity to personal devices. A discovery exercise with consequences produces quiet answers. In each case the organisation ends up knowing less about a risk it believes it has handled.