Northeastern University
CRISP: Charles River Symposia on Privacy
November 2026
Anthropic, “Introducing Anthropic Interviewer,” December 4, 2025
Tianshi Li, arXiv 2601.05918, January 2026
With off-the-shelf LLM agents, re-identification was achieved within a day of the dataset release.
AI INTERVIEWERCan you tell me about your research?
PARTICIPANTI'm in the 1final year of my PhD in 2environmental chemistry, studying microplastics in river sediment. Most of my samples come from 3the river that runs through the old mill town where our department is.
AI INTERVIEWERHow do you use AI in that work?
PARTICIPANTMostly for code. 4Our lab moved the whole analysis pipeline from MATLAB to Python last spring, and I used an assistant to port the scripts for 5a fluorescence imaging rig we built from a modified phone camera.
AI INTERVIEWERWhat are you working on right now?
PARTICIPANT6My thesis chapter, which is under review, shows the rig matches lab spectroscopy for particles above 50 microns.
The entire example is synthetic, based on the cue types in the AURA paper, for illustration.
Preprint, 2026
Wen and Li, AgentDoxx, 2026
| Model | Reasoning effort | Web search | |
|---|---|---|---|
| GPT-5.6 Terra | nonexhigh | On | 2 |
| GPT-5 Mini | minimalhigh | On | 2 |
| GPT-4.1 Mini | No reasoning | OnOff | 2 |
| Gemini 3.7 Flash | high | On | 1 |
| Gemini 3.1 Pro Preview | high | On | 1 |
| Model | Reasoning effort | Web search | |
|---|---|---|---|
| DeepSeek-V4 Flash | max | OnOff | 2 |
| GLM-5.3 Flash | max | OnOff | 2 |
| Kimi K3 | max | OnOff | 2 |
| Llama-4 Maverick | No reasoning | On | 1 |
Re-identification accuracy on 143 transcripts, 12 attacker configurations
1A final-year PhD student in environmental chemistry is probably writing a thesis.
2Microplastics in river sediment is a small field, so few research groups fit.
3An old mill town on a river narrows this to a few universities.
4A phone-camera fluorescence rig is unusual, so I should search for posters and code from those groups.
5A thesis chapter on that rig would have a single author.
6Together, these cues point to one person.
In other words, as AI makes the world more legible, we ourselves become more legible too.
Interests in many tasks that rely on real people’s data
Preprint, 2026
“I work in applied sensor physics, specifically on detecting weak environmental fields using tabletop interferometry… We wrote a paper, currently in review, which proposed a generalised mechanism…”
The 53 Anthropic Interviewer transcripts that agents re-identified and that were verified against public records.
The share of rewritten transcripts that a web-search agent still re-identifies, under GPT-5.1, GPT-5.4-mini, and Gemini-3-Flash.
How many qualitative codes from the original transcript can still be found in the anonymized one.
The gain is 6.4 points, with a 95% confidence interval from 0.1 to 12.7.
With AURA's adaptive scope, the Anonymizer is re-identified 1, 2, and 0 times out of 53, but keeps only 36.2% of the utility grid.
| AURA variant (adaptive scope) | Scope generated by | GPT-5.1 | GPT-5.4-mini | Gemini-3-Flash |
|---|---|---|---|---|
| Qwen3.5-35B-A3B | DeepSeek-V4-Flash | 2 of 53 | 7 of 53 | 2 of 53 |
| Qwen3.5-27B | DeepSeek-V4-Flash | 4 of 53 | 7 of 53 | 0 of 53 |
| GPT-4.1 | GPT-5.1 | 4 of 53 | 6 of 53 | 0 of 53 |
| Anonymizer, for reference | Fixed 8 attributes | 11 of 53 | 12 of 53 | 10 of 53 |
Re-identification rate on the 53 transcripts, by attacker
| Original (synthetic) | AURA, adaptive privacy | Anonymizer |
|---|---|---|
| I work in applied sensor physics, specifically on detecting weak environmental fields using tabletop interferometry. A recent project has involved modelling the impact vibration-driven background noise from nearby equipment has on the instrument, and whether this noise can be removed from any proposed target signal that might be detected. We wrote a paper, currently in review, which proposed a generalised mechanism for modelling the noise produced by moving calibration objects. | I work in scientific research that involves studying noise from environmental vibrations on sensitive measurement equipment, and whether this noise can be removed from any proposed scientific signal. We completed a project that proposed a general approach for modeling the noise from moving sources. | I work in a technical field. A recent project involved analyzing the impact of external factors on data collection tools, and whether these factors can be removed from any proposed dark matter signal. I developed a general approach for modeling the influence produced by changing conditions. |
The originals are synthesized from real transcripts for ethical reasons.
Multi-hop cross-platform linkage and re‑identification
Leverage latent characteristics (e.g., stylometry)
Leverage multi-modal data
A mother posted a Facebook video of herself and her daughter singing in the car. Under it, Meta AI suggested a question:
Its answers pulled together both daughters’ names, birth dates, and videos from years of family posts.
Meta said the feature had “missed the mark” and removed suggested questions about personal topics.
AgentDoxx shows that re-identification risks increase with more capable models, more reasoning effort, and inference-time web search. Traditional text anonymization and privacy-enhancing prompts are not adequate.
We develop AURA, which uses agentic attacks to find what makes a transcript identifiable and masks and reconstructs only those spans, giving lower re-identification while keeping more utility.