Human Oversight in Agentic AI: Authority, Interaction, and Failure Containment
Keywords:
agentic AI, human oversight, autonomous agents, safety, auditabilityAbstract
This perspective examines human oversight in agentic artificial-intelligence systems. The organizing question is where authority should reside when planning, delegation, tool use, and recovery are distributed across agents. Ten related scholarly sources are synthesized through a decision-centered framework spanning problem definition, mechanism, measurement, evaluation, implementation, and governance. The review does not invent experiments, pooled estimates, or unreported quantitative results. It instead evaluates the strength and transferability of the available evidence, with particular attention to assuming that adding a human approval step guarantees meaningful control. The resulting framework links technical or empirical performance to explicit use conditions and identifies tests that should precede wider adoption in agentic systems acting on organizational resources.
References
- Borghoff, U. M., Bottoni, P., & Pareschi, R. (2025). Human-artificial interaction in the age of agentic AI: a system-theoretical approach. Frontiers in Human Dynamics, 7. https://doi.org/10.3389/fhumd.2025.1579166
- Calisto, F. M., Santiago, C., Nunes, N., & Nascimento, J. C. (2022). BreastScreening-AI: Evaluating medical intelligent agents for human-AI interactions. Artificial Intelligence in Medicine, 127, 102285. https://doi.org/10.1016/j.artmed.2022.102285
- Chandra, S., Shirish, A., & Srivastava, S. C. (2022). To Be or Not to Be …Human? Theorizing the Role of Human-Like Competencies in Conversational Artificial Intelligence Agents. Journal of Management Information Systems, 39(4), 969-1005. https://doi.org/10.1080/07421222.2022.2127441
- Gnewuch, U., Morana, S., Hinz, O., Kellner, R., & Maedche, A. (2023). More Than a Bot? The Impact of Disclosing Human Involvement on Customer Interactions with Hybrid Service Agents. Information Systems Research, 35(3), 936-955. https://doi.org/10.1287/isre.2022.0152
- Li, C. Y., & Zhang, J. T. (2023). Chatbots or me? Consumers’ switching between human agents and conversational agents. Journal of Retailing and Consumer Services, 72, 103264. https://doi.org/10.1016/j.jretconser.2023.103264
- Lim, S., Schmälzle, R., & Bente, G. (2025). Artificial social influence via human-embodied AI agent interaction in immersive virtual reality (VR): Effects of similarity-matching during health conversations. Computers in Human Behavior Artificial Humans, 5, 100172. https://doi.org/10.1016/j.chbah.2025.100172
- Samson, K., & Zaleskiewicz, T. (2025). Warmth and Competence in Human-AI Agent Interactions. Polish Psychological Bulletin, 148-160. https://doi.org/10.24425/ppb.2025.153987
- Seaborn, K., Miyake, N. P., Pennefather, P., & Otake-Matsuura, M. (2021). Voice in Human–Agent Interaction. ACM Computing Surveys, 54(4), 1-43. https://doi.org/10.1145/3386867
- Sedlakova, J., & Trachsel, M. (2022). Conversational Artificial Intelligence in Psychotherapy: A New Therapeutic Tool or Agent?. The American Journal of Bioethics, 23(5), 4-13. https://doi.org/10.1080/15265161.2022.2048739
- Wang, X., Pang, H., Wallace, M. P., Wang, Q., & Chen, W. (2022). Learners’ perceived AI presences in AI-supported language learning: a study of AI as a humanized agent from community of inquiry. Computer Assisted Language Learning, 37(4), 814-840. https://doi.org/10.1080/09588221.2022.2056203
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Machine Intelligence & Responsible Systems

This work is licensed under a Creative Commons Attribution 4.0 International License.