This is probably one of the best ways to think about AI products.
If you can’t tell what went wrong, fix it, or steer it back in the right direction… are you really in control?
A useful test for any AI product: when it gets something wrong, how easily can the person notice, correct it, and change direction?
Human agency depends on having enough visibility and control to make a different choice, even after the agent has started working.