Human-in-the-Loop Systems Are No Panacea for AI Accountability

While there is no guidance on what constitutes a significant effect or how to judge the quality of ex post human review, the law effectively mandates what is called “human-in-the-loop” automation by giving a user “the right to obtain human intervention” in a decision taken by an automated system. Human-in-the-loop review is a tool for reviewing the work of a machine, but it is by no means a framework for addressing the social and political impact automated decision making poses. Human-in-the-loop review is a tool for reviewing the work of a machine, but it is by no means a framework for addressing the social and political impact automated decision making poses.