How to keep an AI agent under control.

Agent safety is a system design problem. The model is one component; permissions, data boundaries, validation, approvals, audit trails and recovery determine what a mistake can actually affect.

01

Before

Restrict data, tools, authority and instructions to what the job requires.

02

During

Validate inputs and outputs, detect uncertainty and require approval at key gates.

03

After

Retain useful traces, monitor outcomes and make actions reversible where possible.

01

Limit the blast radius

The most dependable control is reducing what the agent can reach. Give it a scoped identity, the minimum necessary records and a small set of explicit actions. Read access and write access should be separated; a tool that can draft a transaction does not automatically need authority to execute it.

Boundaries also apply to time, money and volume. A workflow can cap the number of records changed, require approval above a value or stop after repeated failures. These limits protect the business even when the model misunderstands an instruction.

02

Treat external content as untrusted

Agents often read email, web pages and uploaded documents. Those sources may contain incorrect information or instructions designed to redirect the system. External text should be treated as data, not authority, and it should never silently override the agent’s governing rules.

  • Separate system instructions from retrieved or user-supplied content
  • Allowlist tools and validate every structured argument before execution
  • Keep credentials outside prompts and model-visible logs
  • Require confirmation when an instruction changes scope or recipient
  • Test with malicious, conflicting and incomplete examples before launch
03

Human approval should be specific

A person clicking approve on every step creates fatigue, not control. Approval is most useful at a consequential boundary: sending an external message, changing a financial record, releasing sensitive information or accepting an uncertain exception.

The review screen should show the proposed action, supporting evidence, uncertainty and what will change. After execution, an audit trail should connect the request, decision, tool call and result without retaining more sensitive data than necessary. Singapore organisations should also assess their own data-protection and sector obligations for the intended use; this guide is operational, not legal advice.

A pre-launch control review

  1. 01

    Inventory

    List every data source, credential, tool, action and external recipient.

  2. 02

    Constrain

    Remove unnecessary access and set limits for value, volume, time and retries.

  3. 03

    Challenge

    Test bad data, prompt injection, unavailable tools, duplicates and ambiguous requests.

  4. 04

    Operate

    Assign an owner, monitor real outcomes and review access whenever the workflow changes.

What should an agent take off your plate?

Tell us what happens today, where it gets stuck and what a useful result looks like. We’ll start there.

Email [email protected]