Skip to content

AGENT OVERSIGHT · Checklist

Agent Permissions & Human Oversight

Say what an AI agent may do and how a person is involved in each action. Get a permission map, flags, open questions and a checklist to work through before the agent goes live.

  • Runs in your browser
  • No sign-in
  • Result before any contact step
Illustrative · Example values
FOUR OF TEN ACTIONS · WHERE A PERSON COMES IN · EXAMPLE VALUESAGENTOWN LIMITED ACCOUNTREAD TENANT RECORDSDRAFT REPLYSEND TO TENANTSRUN CODE×NNO PERSON · READ-ONLY · NO FLAGAPPROVED EACH TIME · NO FLAGBATCH APPROVAL · HIGHNOT SURE = NO PERSON · CRITICAL8 FLAGS · 1 CRITICAL · 3 HIGH · 3 MEDIUM · 1 LOW
AGENTRead recordsSend to tenantsRun code×NNO FLAGBATCH · HIGHNOT SURE · CRITICAL
Flags
8 · 1 critical · 3 high · 3 medium · 1 low
Open questions
may it run scripts? · is one person responsible?

Reads with no person, drafts approved each time, replies approved in batches, and nobody is sure about running code.

An AI agent does not only answer questions. It can send messages, change records, run code and move money. The exposure sits in what the agent is allowed to do, and in whether a person looks at each action before it happens. This checker takes ten kinds of action, asks how a person is involved in each one, then asks seven questions about the controls around the agent.

It sets your answers against a fixed rule table and shows where a person should come in. It cannot see or test the agent, and no answer is checked against a real system, so use the result as a review aid for a conversation with the people who run the agent.

Your inputs · worked out in your browser

0 of 17 answered · empty

Everything is worked out in your browser. Anvaylo does not receive the numbers or answers you enter, and nothing is saved when you leave the page. Use estimates and roles, not names, contract text, customer records or credentials.

This checker cannot see or test your agent. It compares the answers you chose with a fixed set of rules. Every checkpoint here is a recommendation. This result does not show that any control is active or that any answer you gave is true.

01 · What may the agent do?

Choose one answer for each action. If you do not know, choose Not sure: it counts as no person involved and stays on the list as an open question.

Read data

Read-onlyFiles, records, inboxes, web pages.

Reads information and changes nothing.

Draft content for a person

ReversibleText a person reads before anything is used.

Changes can be undone if a working undo or backup exists.

Send messages outside the business

ConsequentialEmail, chat, social posts, support replies.

Affects people, customers or systems outside the agent. Hard to take back in full.

Create or change records

ReversibleTickets, CRM entries, spreadsheet rows.

Changes can be undone if a working undo or backup exists.

Delete data

IrreversibleFiles, records, accounts, backups.

Cannot be taken back once done, such as deleted data or a payment sent.

Move money or make payments

IrreversiblePayments, refunds, transfers, card use.

Cannot be taken back once done, such as deleted data or a payment sent.

Change access or permissions

ConsequentialAdd or remove users, roles, sharing links.

Affects people, customers or systems outside the agent. Hard to take back in full.

Run code or change systems

ConsequentialScripts, deployments, settings, tool calls.

Affects people, customers or systems outside the agent. Hard to take back in full.

Make commitments (orders, contracts, prices)

ConsequentialPlace orders, accept terms, set or quote prices.

Affects people, customers or systems outside the agent. Hard to take back in full.

Make decisions about people (hiring, eligibility, account closure)

ConsequentialScreen, rank, approve, refuse or close.

Affects people, customers or systems outside the agent. Hard to take back in full.

02 · How is the agent set up?

Each Not sure takes the least careful answer and is listed as an open question.

How much data can the agent read?
Is there a log of what the agent does?
Can someone stop the agent at once?
Can you undo what the agent changes?
Is one named person responsible for the agent?
Does the agent run on its own outside working hours?
Whose account does the agent use?

Waiting for inputs

Your permission map

0 of 17 questions answered. Answer all 17 to see the permission map, the flags and the checklist, or load the example to see how it reads. This checker cannot see or test your agent. It compares the answers you chose with a fixed set of rules.

What you get

  • A permission map: each action, its class, your answer and a suggested checkpoint
  • Flags counted by severity, each with the answer that raised it and a next step
  • An open question for every answer you marked Not sure
  • Suggested checkpoints and a checklist to work through before rollout
  • An action plan you can assign by role, with .txt, .md and .csv downloads

If you accept analytics cookies, we record only which tool was opened, that a result was shown and which export or service link was used. Inputs, answers and results are never part of that record.

Review aid from self-reported answers. It is not legal advice, a regulatory classification, a certification or an audit, and it cannot see or test any system. Method version 2026-10-14.

How it works

You choose one answer for each of ten actions: not allowed, a person approves each time, a person approves in batches, people are told afterwards, no person involved, or not sure. Each action has a printed class. Reading is read-only. Drafting for a person and creating or changing records are reversible. Sending messages outside the business, changing access, running code, making commitments and making decisions about people are consequential. Deleting data and moving money are irreversible.

The class and the answer together set the flag. Nothing is flagged on a read-only action. A reversible action with no person involved is Medium, and with people told afterwards it is Low. A consequential action with no person involved, or with people told only afterwards, is Critical, and with approval only in batches it is High. An irreversible action is Critical in all three of those cases, because a batch cannot stop one bad payment or deletion. A person who approves each time, or an action that is not allowed, raises no action flag.

Seven more questions look at the controls around the agent: how much data it can read, whether there is an action log, a stop switch and a way to undo, whether one named person is responsible, whether it runs alone outside working hours and whose account it uses. The log, stop switch and undo rules apply only when the agent may take at least one write action, meaning any allowed action other than reading and drafting.

Not sure is never a pass. On an action it counts as no person involved, and on a control question it counts as the least careful answer. Each Not sure also becomes an open question, so you can see what to find out. Changing any answer to Not sure can keep the flags the same or add to them, and it never removes one.

The result starts with the count of flags by severity. Below it are the permission map, the flags with the answer behind each one, the open questions, suggested checkpoints, a checklist for before rollout and an action plan where you can name an owner role and a date. Critical, High, Medium and Low are illustrative review priorities from fixed rules. They are not probabilities, losses or a rating of your agent.

Formula and rules

Flag rules, in the order the checker applies them
Action flag = class of the action x how a person is involved. Not sure counts as no person involved. Not allowed never raises an action flag.
Read-only: no flag for any answer.
Reversible: no person involved = Medium; told afterwards = Low; batch approval = no flag; approval each time = no flag.
Consequential: no person involved = Critical; told afterwards = Critical; batch approval = High; approval each time = no flag.
Irreversible: no person involved = Critical; told afterwards = Critical; batch approval = Critical; approval each time = no flag.
Write action = any allowed action other than reading and drafting. Not sure counts as allowed.
Control flags apply only when at least one write action is allowed:
  Action log: none = High; partial = Medium. Not sure counts as none.
  Stop switch: none = High; never tested = Medium. Not sure counts as none.
  Undo: none = High; by hand only = Medium. Not sure counts as none.
Other flags:
  Data access: broad = Medium; High when sending messages outside the business is allowed. Not sure counts as broad.
  Account: shared or a person’s own = High when a write action is allowed, otherwise Medium. Not sure counts as shared.
  Runs outside working hours: High when a consequential or irreversible action is allowed; Medium when only other write actions are allowed; no flag for reading and drafting only. Not sure counts as yes.
  Named owner: none = Medium. Not sure counts as none.
Classes: Read-only reads and changes nothing. Reversible can be undone if a working undo or backup exists. Consequential affects people or systems outside the agent. Irreversible cannot be taken back once done.
Severity is ordered Critical, High, Medium, Low. Flags with the same severity keep the order above.

Assumptions

  • The class of each action is fixed and printed on this page. It is an illustrative grouping for this checker, not a legal, insurance or regulatory category.
  • A write action is any allowed action other than reading and drafting. An action marked Not sure counts as allowed.
  • Approval means a named person sees exactly what will change before it happens. A quick click-through without that view is not the same thing.
  • Your answers are self-reported. They are not checked against any system, log, contract or setting.
  • Severity names are illustrative review priorities. They are not probabilities, losses or a score.

Worked example

Illustrative worked example · example valuesSample

A property-management firm plans an agent for tenant requests. It reads tenant and building records with no person involved. A person approves each draft reply and each repair order. Replies reach tenants after a person approves them in batches, and maintenance tickets are updated with people told afterwards. Deleting data, moving money, changing access and decisions about people are not allowed. The firm is not sure whether the agent may run scripts or whether one person is responsible for it. Data access is broad, the log is partial, the stop switch was never tested and nothing can be undone. The agent has its own account and runs in working hours only.

The checker raises 8 flags: 1 critical, 3 high, 3 medium and 1 low. The critical flag is running code, because Not sure counts as no person involved on a consequential action. The high flags are tenant replies that a person approves only in batches, broad data access together with messages that leave the business, and no way to undo. The medium flags are the partial log, the untested stop switch and the missing named owner, since Not sure counts as no owner. The low flag is ticket updates with people told only afterwards.

It also lists 2 open questions (may the agent run scripts, and is one person responsible for it), 9 suggested checkpoints and 7 checklist items. Nothing changes in the agent. The result is a list of recommendations to work through with the people who run it.

Evidence to gather

Records that make the result easier to check and act on:

  • An export of the agent’s permission settings, to compare with the actions you marked Not allowed.
  • The list of allowed actions and who approves each one, signed off by the agent owner.
  • A sample of the action log showing inputs, time and approver for several actions.
  • Test records for the stop switch and for undoing a change, with who ran them and how long they took.
  • The account the agent uses, the rights it holds and who can change them.
  • The name of the owner, the person who may stop the agent and a backup for each.

What it does not do

  • This checker has no view of your agent. It sets the answers you pick against a fixed rule table and nothing more.
  • A checkpoint here is a suggestion. Nothing on this page shows that a control exists, works or is switched on.
  • The printed class of an action is a general guide. Your data, contracts and local rules can make an action more serious than shown.
  • Answers are taken as typed. They are not checked against any system, log, setting or document.

Questions

Does the checker connect to or test my agent?

No. It connects to nothing and cannot see your agent, its logs or its settings. It sets the answers you pick against a fixed rule table and shows the outcome.

Why is batch approval treated differently from approving each time?

Someone who approves a batch cannot stop one bad action inside it. For a consequential action that raises a High flag. For an irreversible one, such as a payment or a deletion, it raises a Critical flag.

What does Not sure do to my result?

It takes the least careful answer and becomes an open question. Not knowing never improves a result. When you find out, change the answer and the flags update straight away.

Does a result with no flags mean my agent is under control?

No. It means these answers raised no flag. The checker cannot tell whether the answers are true or whether any control works, so test the controls yourself before you rely on them.

How is this different from an AI readiness assessment?

A readiness assessment asks whether an organization is ready to start using AI. This checker looks at one agent that can already act, and at which of its actions need a person to approve them first.

Is anything I enter sent or stored?

No. The result is worked out in your browser, and nothing you choose is sent to Anvaylo or saved when you leave. Use categories and roles, and keep names, contract text and credentials out of the action plan boxes.