October 22, 2024: Anthropic Unveils AI That Controls Computers - Anthropic announced upgraded Claude modelsClaude 3.5 Sonnet and Haikuthat offer advanced AI capabilities, including computer control via user interfaces. Sonnet excels in coding and tool use, boosting its SWE-bench Verified performance significantly. New features enable the models to perceive and interact with computer screens, allowing tasks like data entry through UI manipulation. Although still experimental and prone to errors, these capabilities represent a significant advancement in AI functionality. Anthropic emphasizes caution and has implemented safeguards against misuse. The Sonnet model is available now, with Haiku releasing later in the month.
