Data residency for AI agents: where your prompts, documents and records actually live

Your security team asks a simple question: where does our data go when the agent runs? The honest answer has four parts. Your systems of record, where it starts. The agent's working state, where it sits between steps. The model provider, which reads it to decide. And the record, which keeps what happened. Each can be in a different country, under different terms, for a different length of time.
In one sentence: data residency for agents means knowing all four locations, and the retention and training terms at each.
Where it comes from
Data residency started with databases and cloud storage: which country the disks are in. Agents add two new stops. The model provider sees every document the agent reads. And the agent often keeps state (a plan, a scratchpad, retrieved files) outside both your systems and the provider's.
Model providers now publish their terms in detail. The trouble is that each one splits the question differently. Training, retention, abuse monitoring and region are four separate answers, and "we don't train on your data" covers only the first.
How it works: the four places
1. Your systems of record. The ERP, the claims platform, the mailbox. Nothing new here. The question is what the agent's credentials let it copy out.
2. The agent's working state. Where the orchestration layer keeps the run: messages, tool results, retrieved documents. This is often the vendor's cloud. Ask where, and for how long.
3. The model provider. What the docs of four major providers say, in their words:
| Provider | Training | Retention | Region |
|---|---|---|---|
| OpenAI API | See its docs | Abuse monitoring logs "retained for up to 30 days, unless longer retention is required by law"1 | "Data residency controls" by project, for eligible customers, via sales1 |
| Anthropic API | See its docs | Inputs and outputs deleted "within 30 days of receipt or generation", with listed exceptions2 | See its docs |
| Azure (Microsoft Foundry) | Prompts and completions "are NOT used to train any generative AI foundation models without your permission or instruction"3 | Models are "stateless"3. Abuse monitoring applies; some customers may apply to modify it3 | "Processed within the customer-specified geography (unless you are using a Global or DataZone deployment type)"3 |
| Amazon Bedrock | See its docs | See its docs | Per AWS Region. Model providers "don't have access to Amazon Bedrock logs or to customer prompts and completions"4 |
"See its docs" means we did not find the answer on the page we cite. Do not read it as "no".
Three things stand out. Retention and training are separate. "Zero data retention" is usually by approval: OpenAI says its controls "are subject to prior approval"1. Anthropic's 30-day rule has exceptions, including a zero data retention agreement and enforcing its usage policy2. And region choice can quietly change with the deployment type. Azure's global deployments may process outside your chosen geography3.
4. The record. What the run leaves behind for your auditor. If the AI Act applies, deployers must keep the logs "to the extent such logs are under their control"5. That phrase is the reason to hold the record in your own store. If it sits only in the vendor's platform, it is under their control, not yours.
What it is good at, and what it is not
Good at. Private or regional deployment shrinks the list of places your data goes. Running a model through your own cloud account (Azure, Bedrock, Vertex) brings it under an agreement you already have. It lets your existing data processing terms apply.
Not good at. Removing the agent vendor. A regional model endpoint does nothing if the agent's working state sits in another region. Ask about all four places. The model is only one.
Not the same as privacy. Residency is about location. An agent in the right country can still send a claimant's medical history to a tool that did not need it. Scope what the agent reads, as well as where it goes.
What to check
- /01
Draw the four places for your agent. Name the country and company at each.
- /02
For the model provider: training, retention, abuse monitoring and region. Four separate answers, in writing.
- /03
Is zero data retention in place, or merely available? Which features fall outside it?
- /04
Where is the agent's working state kept, and for how long?
- /05
Where is the record kept? Can you export it, and read it without the vendor?
- /06
Is every provider on the vendor's sub-processor list, with location?
Where it is going
Providers are adding regional endpoints and zero-retention options quickly, often at a price. OpenAI's docs mention a 10% uplift on data residency endpoints for newer models1. Our view: within two years, regional processing will be standard for enterprise contracts. The harder question will move to the agent layer. Buyers will ask where the plan, the scratchpad and the record live, and many vendors will not have a clean answer.
Gatehouse fit
Surehand keeps engagement data and website data apart. Material reaches a model provider only inside the scope set in the signed rules, under API terms that exclude training, and each crossing is logged. Your business material stays in your own store. The record holds links to it, not copies, and exports in open formats. Model providers are named in each deployment's rules. The Trust page lists the sub-processors, their roles and locations.
At a glance
| Category | Regulation (data) |
|---|---|
| Also called | Data localisation, sovereign AI, private deployment |
| The four places | Systems of record. Agent working state. Model provider. The record |
| Key docs | OpenAI, Anthropic, Azure and Bedrock data pages. AI Act Art. 26(6) |
| Typical owner | Security and privacy own the map. The process owner owns the scope |
| The one test | Name the country and company at each of the four places |
Sources
- [1]Your data, OpenAI API platform docsplatform.openai.com In text
- [2]How long do you store my organization's data?, Anthropic Privacy Centerprivacy.claude.com In text
- [3]Data, privacy, and security for Azure Direct Models in Microsoft Foundry, Microsoft Learnlearn.microsoft.com In text
- [4]Data protection, Amazon Bedrock User Guidedocs.aws.amazon.com In text
- [5]Regulation (EU) 2024/1689 (AI Act), Article 26: Obligations of deployers of high-risk AI systemsartificialintelligenceact.eu In text
Read next

SOC 2 when the product is an agent: what the report covers, and what it does not
A SOC 2 report tells you a vendor's controls over your data were designed and, in Type 2, operated. It does not tell you what their agent will do on your work. How to read one.

EU AI Act obligations for deployers of AI agents, after the 2026 Omnibus
If you use an AI agent rather than build one, you are a deployer. What Article 26 asks of you, which agents count as high-risk, and the dates the 2026 Omnibus moved.
What should you ask an AI vendor before signing?
Twelve questions that separate a system you can run from a demo you can't control. Ask us first.