MIT Sloan Management Review Article on Auditing Algorithmic Risk

How do we know whether algorithmic systems are working as intended? A set of simple frameworks can help even nontechnical organizations check the functioning of their AI tools.

Artificial intelligence, large language models (LLMs), and other algorithms are increasingly taking over bureaucratic processes traditionally performed by humans, whether it’s deciding who is worthy of credit, a job, or admission to college, or compiling a year-end review or hospital admission notes.

About the Author

Cathy O’Neil is the CEO of O’Neil Risk Consulting & Algorithmic Auditing (ORCAA) and the author of Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy (Crown, 2016). Jake Appel is chief strategist at ORCAA. Sam Tyner-Monroe, Ph.D., is the managing director of responsible AI at DLA Piper.

Learn more about MIT SMR.