So I know this is not a popular idea but how about changing the problem statements a bit atleast at lower division/ elo. ↵
↵
So as we all know that general llms can still not solve the arc agi test with a very high success rate <16% for the best model which in my opinion even a newbie will be able to solve with atleast >80% accuracy. ↵
↵
So my idea is simple incorporating arc agi benchmark style in the new problem statements. one particular example problem statement from today's arc agi test puzzle (Puzzle ID: 36a08778):↵
↵
↵
↵
↵
This can easily be solved with a simple dfs/bfs given the input prompts and output the resulting solution. The input colors can obviously be replaced by numbers and the idea itself is pretty simple. ↵
↵
I dont think this question should be harder than 1300 probably. ↵
↵
We can probably incorporate this style in other tags if we are a bit more creative.↵
↵
Any thoughts?
↵
So as we all know that general llms can still not solve the arc agi test with a very high success rate <16% for the best model which in my opinion even a newbie will be able to solve with atleast >80% accuracy. ↵
↵
So my idea is simple incorporating arc agi benchmark style in the new problem statements. one particular example problem statement from today's arc agi test puzzle (Puzzle ID: 36a08778):↵
↵
↵
↵
↵
This can easily be solved with a simple dfs/bfs given the input prompts and output the resulting solution. The input colors can obviously be replaced by numbers and the idea itself is pretty simple. ↵
↵
I dont think this question should be harder than 1300 probably. ↵
↵
We can probably incorporate this style in other tags if we are a bit more creative.↵
↵
Any thoughts?
