So I know this is not a popular idea but how about changing the problem statements a bit atleast at lower division/ elo. ↵
↵
So as we all know that general llms can still not solve the arc agi test with a very high success rate <16% for the best model which in my opinion even a newbie will be able to solve with atleast >80% accuracy. ↵
↵
So my idea is simple incorporating arc agi benchmark style in the new problem statements. one particular example problem statement from today's arc agi test puzzle (Puzzle ID: 36a08778):↵
↵
↵
↵
↵
This can easily bedonesolved with a simple dfs/bfs given the input prompts and output the resulting solution.↵
↵
I dont think this question should be harder than 1300 probably. ↵
↵
We can probably incorporate this style in other tags if we are a bit more creative.↵
↵
TAny thoughts?
↵
So as we all know that general llms can still not solve the arc agi test with a very high success rate <16% for the best model which in my opinion even a newbie will be able to solve with atleast >80% accuracy. ↵
↵
So my idea is simple incorporating arc agi benchmark style in the new problem statements. one particular example problem statement from today's arc agi test puzzle (Puzzle ID: 36a08778):↵
↵
↵
↵
↵
This can easily be
↵
I dont think this question should be harder than 1300 probably. ↵
↵
We can probably incorporate this style in other tags if we are a bit more creative.↵
↵
