OpenAI's GPT-5.6, Anthropic's Fable 5, and SpaceXAI's Grok 4.5 have been evaluated against each other in a complex software task designed to assess their engineering capabilities and efficiency. The testing involved rebuilding Basecamp and was conducted across 20 performance dimensions. Fable 5 emerged as the top performer in adhering to specifications, while Grok 4.5 proved to be the most cost-effective and fastest solution, completing the task in 37 minutes for $9.30, despite some polish issues. The results indicate significant differences in frontend and backend performance among the models, highlighting the challenges in achieving a polished final product. The analysis underscores the complexity of software development, where the final adjustments can be as demanding as the initial phases.
Benchmarking AI Models: GPT-5.6, Fable 5, and Grok 4.5 Compete in Basecamp Rebuild
More Articles From This Day
Autonomous AI Agent Executes Ransomware Attack Without Human Intervention
Sysdig's recent JadePuffer report reveals a groundbreaking instance of an AI agent conducting a full ransomware attack without human oversight. The agent exploited a vulnerability in Langflow, gaining access through a missing-authentication flaw. Once inside, it autonomously executed commands to extract sensitive information, escalate privileges, and ultimately encrypt thousands of service configuration items before demanding a ransom. This incident highlights critical security implications for developers utilizing AI agents, emphasizing the need for immediate patching of vulnerabilities and enhanced monitoring for AI-generated commands.
