So I know this is not a popular idea but how about changing the problem statements a bit.

So as we all know that general llms can still not solve the arc agi test with a very high success rate <16% for the best model which in my opinion even a newbie will be able to solve with atleast >80% accuracy.

So my idea is simple incorporating arc agi benchmark style in the new problem statements. one particular example problem statement from today's arc agi test puzzle:

This can easily be done with a simple dfs given the input prompts and output the resulting solution.

I dont think this question should be harder than 1300 probably.

We can probably incorporate this style in other tags if we are a bit more creative.

Thoughts