Lobsters AI
44% on ARC-AGI-1 in 67 cents
Comments
Model evaluation
Source attribution: Lobsters AI. Reader content is derived from the canonical public URL when extraction is available.
Reader mode
Status: not requested
Reader extraction has not been requested for this article.
AI reading tools
Usable reader text is required before AI tools can run for 44% on ARC-AGI-1 in 67 cents.
Related articles
5 recommendations
- Hacker News AI
Beyond Context Windows: Evaluating Long-Term Memory for AI Agents
AI agentsContext engineeringModel evaluationRead related article: Beyond Context Windows: Evaluating Long-Term Memory for AI Agents - Lobsters AI
LLMs Are Too Big. My Log Router Doesn't Need to Sing
Model evaluationRead related article: LLMs Are Too Big. My Log Router Doesn't Need to Sing - OpenAI Blog
Building standards for the next phase of AI
OpenAIModel evaluationRead related article: Building standards for the next phase of AI - Google DeepMind
Piloting the world's first double-blind AI evaluations
Google DeepMindModel evaluationRead related article: Piloting the world's first double-blind AI evaluations - Hacker News AI
Show HN: An AI office-work benchmark, and 4 bugs we found in our own judge
AI agentsModel evaluationRead related article: Show HN: An AI office-work benchmark, and 4 bugs we found in our own judge