#Computer Control

Cradle empowers foundation models to perform complex tasks using human-like interaction with screenshots and traditional interfaces. It supports games like RDR2, Stardew Valley, and Cities: Skylines, along with software such as Chrome and Outlook. The framework utilizes modern Python and OCR technology, ensuring comprehensive environment compatibility and adaptability for new applications, delivering effective generalized control.

ScreenAgent enables Visual Language Model agents to interact with computer interfaces effectively through structured task breakdowns and executions. Utilizing the VNC protocol ensures broad OS compatibility. The comprehensive ScreenAgent dataset supports diverse task automation, highlighting a methodical approach rather than a revolutionary change.