So I know this is not a popular idea but how about changing the problem statements a bit atleast at lower division/ elo.
So as we all know that general llms can still not solve the arc agi test with a very high success rate <16% for the best model which in my opinion even a newbie will be able to solve with atleast >80% accuracy.
So my idea is simple incorporating arc agi benchmark style in the new problem statements. one particular example problem statement from today's arc agi test puzzle (Puzzle ID: 36a08778):
This can easily be solved with a simple dfs/bfs given the input prompts and output the resulting solution. The input colors can obviously be replaced by numbers and the idea itself is pretty simple.
I dont think this question should be harder than 1300 probably and can definitely used as a div 2 b atleast. We can also flag accounts which have not solved the easier questions and have managed to do div 2 e/f (rainboy is an exception).
We can probably incorporate this style in other tags if we are a bit more creative.
Any thoughts?
Auto comment: topic has been updated by supreme_999 (previous revision, new revision, compare).
Auto comment: topic has been updated by supreme_999 (previous revision, new revision, compare).
i think its okay upto Div4 and Div3, above that this will be just free points in Div2 and above
Yeah but that is the point I never said to do this change at higher elo. however this kind of question can definitely qualify for div 2 b imo.
Can't you solve it yourself then use AI for the other problems?
Yeah basically the thing I am trying to say is that we can try to create all questions <=1600 in the style of arc benchmark since even now mostly people who are lower than that mostly cheat to get the upper hand especially in div 3 where its the worst.
Frankly whenever I see a new question <=1600 it just looks like some kind of repetition of some previously known problem so questions like these will be a fresh new take.