AgentProv — Provenance-Aware Containment of Privileged Database Writes

Published:

Status: Pilot complete · scale-up pending · part of the agent-authorization and tool-security line of work.

The question

An LLM agent that reads untrusted content mid-task — a customer email, a support ticket, a retrieved note — may be asked, inside that content, to perform a privileged database write. The obvious defense is to ask the agent where its instruction came from. That fails by construction: a compromised agent can simply lie. AgentProv traces provenance outside the agent instead, so containment does not depend on the agent’s self-report.

Results so far

  • Attack success falls from 1.00 to 0.00. Without provenance tracing, every poisoned task converts untrusted content into a privileged write. With it, none do.
  • No measured utility cost. False-block rate is 0.0 on legitimate writes and 0.0 on benign reads — the defense did not learn to refuse everything.
  • Run on Qwen2.5-1.5B-Instruct served through vLLM, with GPU memory utilization computed from live free memory on a shared machine.

The caveat worth stating is scale: this is a pilot with single-digit task counts per condition. The separation is clean and the mechanism is deterministic, but the interval around a 0.00 rate at this n is wide, and the scaled round is what would narrow it.