FocusGUI: helping screen-using AI agents focus on what matters at each step
Some AI agents operate apps by looking at screenshots, audio, video and their own past actions. The authors add a small adapter that picks the inputs that matter for the next action and passes them to a frozen model, without changing the model itself.
Why it matters: Agents that pay attention to everything can drift off course. Showing them only what matters at each step makes them more reliable at a low cost.