Giving Agents the Ability to See with Matthew Elkherj

Before an AI agent can reason or plan, it has to see. Dr. Danielle Perszyk and AI researcher Matthew Elkherj explore why user interface (UI) understanding is one of the most underestimated challenges in building autonomous agents—and why it’s foundational to creating reliable AI teammates.

Danielle and Matthew discuss the distinct reliability requirements of agents, how perceptual hallucinations can be a feature (rather than a bug), and the role of synthetic gym environments in training. Together, they explain why building reliable agents requires solving interconnected challenges—from how agents perceive digital interfaces to how they learn from mistakes, handle real-world complexity, and ultimately augment human capacity.

Please note: this podcast was recorded in August 2025.