When You Delete Your Data, Does Your AI Forget It?
Deleting a record from a database feels definitive. In an AI-powered world, it may be only the beginning of the question.
For decades, we have thought about data deletion in fairly simple terms.
If a customer asks a company to delete their information, we find the records, remove them from the database, clean up the associated files, and move on.
But AI introduces a new question:
What happens if the data we delete has already been used to teach a model something?
The answer is not always as simple as deleting the original record.
Recent research into machine unlearning explores precisely this problem: how an AI system can selectively reduce or remove the influence of particular training data after a model has already learned from it.
A technical treatment of the subject, Machine Unlearning: Theory and Applications in Networking by Jie Xu and Xiaohua Jia, provides a useful framework for thinking about how data influence moves through a learning system—from training data, through optimization, into model parameters and ultimately into deployed behavior.
The data lifecycle no longer ends with the database
Consider a simplified AI system:
The traditional data-management mindset tends to focus heavily on the first two stages:
- Where is the data stored?
- How long is it retained?
- Who can access it?
- Can it be deleted?
Those questions remain essential. But when machine learning enters the picture, there can be several additional transformations between the original data and the eventual output.
Data can be processed into features or other representations, incorporated into a training dataset, and used during optimization. During training, individual examples influence the model's parameters. Those parameters are then used by the deployed model to produce predictions.
A database doesn't necessarily know what an AI has learned
Imagine that an employee's activity data is stored in a database.
The database might contain applications used, documents accessed, websites visited, timestamps, classifications, and other activity metadata.
Deleting those records removes the original information from that database. But suppose some of those records were subsequently included in a machine-learning training process.
The training process doesn't simply maintain a copy of every record inside the model. Instead, training adjusts model parameters based on the data.
A given example can contribute to the model's optimization trajectory. By the end of training, the effect of many such contributions is distributed across the learned parameters rather than being stored as a clearly labelled "copy" of each source record.
This is the fundamental distinction between ordinary database deletion and machine unlearning:
Deleting a record removes the source data. Unlearning asks what, if anything, must happen to the model that learned from it.
The research literature describes machine unlearning as the selective removal of the influence of particular training data from a trained model. It distinguishes this from simply deleting the original training record.
Why “we deleted it” can be an incomplete answer
The gap between storage-level deletion and model-level influence is not merely philosophical.
AI models can sometimes contain or reveal information from their training data. Depending on the model, training process and attack scenario, researchers have studied techniques such as:
- Membership inference — attempting to determine whether particular information was included in training.
- Model inversion and related inference attacks — attempting to recover or infer information about training data from model behavior.
- Training-data extraction — attempting to make a model reproduce memorized material.
These are not properties of every model, and they should not be treated as evidence that every AI system memorizes individual records. The risk depends heavily on the model, training data, architecture, configuration and deployment context.
But the possibility is important enough that data protection authorities now explicitly discuss personal data at multiple stages of the AI lifecycle.
The UK Information Commissioner's Office, for example, notes that individual rights can apply to personal data in training data, data used to make predictions, prediction outputs, and in some circumstances personal data contained in the model itself. It also makes an important distinction: erasing personal data from training data does not automatically mean that every machine-learning model based on that data must be erased, unless the model itself contains the data or can be used to infer it.
The European Data Protection Board has likewise emphasized that whether an AI model can be considered anonymous is a contextual, case-by-case assessment, including whether individuals can be identified or personal data extracted through queries.
Why full retraining isn't always the answer
The theoretically straightforward approach is to retrain the model from the beginning using a dataset that excludes the data that should be forgotten.
That can work, but it may be computationally expensive and operationally disruptive for large models or frequently updated systems.
This is the tension that has given rise to machine unlearning as a research discipline: can we achieve the relevant forgetting objective without paying the full cost of retraining?
The book discusses two broad families of approaches.
Exact unlearning
Attempts to produce a result equivalent, under a defined protocol, to training without the data that should be forgotten. SISA-style approaches use partitioning so that only affected portions may need to be retrained.
Approximate unlearning
Relaxes the exact equivalence requirement and instead seeks to bound or make negligible the remaining influence, potentially reducing computational cost.
Influence measurement
Measures how individual data points affect model behavior or optimization, helping determine which data may be problematic and informing potential unlearning operations.
The trade-offs are real. Exact approaches can require additional storage, partitioning or retraining. Approximate approaches depend on assumptions and require careful validation. The research itself makes clear that no single technique simultaneously provides model-agnostic applicability, low overhead and efficient unlearning in every setting.
One of the book's later chapters explores a particularly interesting theoretical approach: under specific assumptions about training dynamics, the influence of an individual example can decay over subsequent optimization steps, allowing a calibrated noise-injection mechanism to provide a certified approximate-unlearning guarantee. The authors also explicitly note that their analysis is based on a simplified training setting and does not yet cover many modern production-training details.
AI may need to forget for more than one reason
Privacy is the most obvious motivation, but it is not the only one.
Privacy & rights
A person or organization asks for information to be removed or stops consenting to a particular use.
Security
Training data turns out to be malicious, poisoned or corrupted and its influence needs to be reduced quickly.
Data quality
Historical data becomes outdated, biased, incorrectly labelled or no longer representative of the business.
This third category is particularly interesting for business software.
Not every piece of data that should be forgotten was illegal or malicious. Sometimes it was simply wrong—or it was right six months ago and wrong today.
The book explicitly discusses outdated, biased and low-quality data as a separate unlearning scenario. In that setting, the objective is not necessarily to erase everything associated with a data point. The challenge may instead be to correct a model's behavior while preserving useful information.
AI systems may need data maintenance just as databases do.
From “learn” to “learn, correct and forget”
We are accustomed to thinking about AI primarily in terms of what it can learn:
More data. Better data. More training. Better predictions.
But mature AI systems may need a richer lifecycle:
This is a broader way to think about responsible AI data management. Machine unlearning is one part of that picture—not the whole picture.
The new questions for AI vendors
Traditionally, when evaluating a software vendor, customers might ask:
Where is our data stored?
When AI is involved, that question should expand.
- Is our data ever used to train, fine-tune or improve your models?
- Can customers opt out of model training or improvement uses?
- Which data is sent to external AI providers?
- Are embeddings, derived features or other representations created from our data?
- If we request deletion, what systems and data stores does the request reach?
- Could our data be present in, or inferred from, a model?
- How are model outputs or classifications associated with individuals handled?
- How long are prompts, inputs, outputs and derived information retained?
- Are customer datasets appropriately segregated?
- Can you explain the process and evidence used to respond to a data-rights request?
A vendor that answers these questions clearly is demonstrating something important: not simply that it has a privacy policy, but that it understands the technical lifecycle of the data its AI systems process.
What this means for professional services
Most law firms, accounting firms and other professional-services organizations are not training foundation models themselves. They are adopting AI-powered products built by someone else.
That shifts the practical question.
You may never need to implement machine unlearning yourself. But you may need to understand whether the AI vendors you rely on have considered the problem.
For firms handling confidential, privileged or commercially sensitive information, AI due diligence should therefore go beyond asking whether data is encrypted or stored in a particular region.
It should include questions about what happens after the data leaves the database.
The bigger shift: from data storage to data lifecycle management
For years, data governance has focused on access controls, retention schedules, backups, deletion and audit trails—all built largely around the assumption that data exists as discrete, editable records.
AI adds another dimension.
Once information has been transformed into features, used in training, incorporated into model parameters or used to generate predictions, the relationship between the original data and its downstream effects becomes more complicated.
A more complete lifecycle therefore looks something like this:
The challenge is that these stages can cross multiple systems: application databases, analytics pipelines, vector stores, AI APIs, training datasets, models, backups and subprocessors.
The machine-unlearning research highlights this particularly clearly in distributed systems, where deletion may need to propagate across multiple model tiers and where verification can require a chain of evidence connecting the request, affected models, execution and validation.
Where Chrometa fits
Chrometa operates in a part of the technology stack where this conversation matters: the intersection of workplace activity, analytics and increasingly AI-assisted software.
As organizations adopt more AI tools, we believe customers should be able to ask straightforward questions about what happens to their work data:
- What information is collected?
- Why is it collected?
- Where is it processed?
- Which AI features use it?
- Is it used to train models?
- How long is it retained?
- How can it be corrected or removed?
We don't think every software product needs to implement academic machine-unlearning algorithms. But we do think the underlying principle is increasingly important:
The more technology learns about how we work, the more important it becomes to understand and control that learning.
The future of AI may depend on what it can forget
The most interesting question raised by machine unlearning isn't simply:
Can we make an AI forget?
It is:
Can we build AI systems whose relationship with data remains controllable throughout their entire lifecycle?
That is a much bigger challenge.
AI systems will continue to become more capable. They will process more information, operate across more systems, and increasingly influence business decisions.
The organizations that handle this responsibly won't necessarily be the ones that collect the least data.
They may be the ones that understand exactly what happens to the data they collect.
Because in an AI-powered world:
Deleting the record may be only the beginning.
A practical takeaway
You don't need to become a machine-learning researcher to start addressing this.
Start by mapping your AI data lifecycle:
- Identify the source data. What information enters the AI system?
- Map transformations. Does it become a feature, embedding, summary or other derived representation?
- Identify training and fine-tuning. Is customer data actually used to change a model?
- Map downstream systems. Where do inputs, outputs and derived artifacts go?
- Review deletion and correction procedures. What happens beyond the primary database?
- Understand verification. What evidence can the vendor provide about what happened?
The goal isn't to demand a particular algorithm. It is to replace an incomplete mental model—“our data lives in the database”—with a more accurate one:
Sources and further reading
This article is informed by Machine Unlearning: Theory and Applications in Networking by Jie Xu and Xiaohua Jia (Springer), particularly its discussion of data influence, exact and approximate unlearning, outdated/corrupted data, and distributed-system challenges.
- European Data Protection Board — Opinion 28/2024 on AI models and personal data
- UK ICO — How do we ensure individual rights in our AI systems?
This article is intended as technology and industry thought leadership, not legal advice. Whether a particular deletion request requires action at the model level depends on the AI system, the data involved and the applicable legal and contractual context.