Should we allow an Open AI agent to use their AI for testing during contests?
of course this will straightly against Rule Restricting the Use of AI
but maybe Mike can give an exception, exclusively for Open AI agent to use AI for testing on live contests
this will going to be really interesting I think, imagine AI become """really""" LGM
No.
Maybe we can set up a separate standings table and rating system for AI.
Then we wouldn't be able to see the performance and rating of AI compared to humans, though
We can merge the standings table together when displaying, but calculate the rating change separately.
bro is 24/7 sharing AI shit just to demotivate people here.i can tell you it doesn't work, find another way.
finally, brother found his family
This could be an interesting thing to do. Perhaps to make it very apparent that it is truly an AI the handle of the AI has to be starting with AI and what comes after that is either the name of the company, the name of the model, or something random to keep it secret :)
But there is one more thing we have to consider: Lots of Ais take TONS of attempts to solve a problem, like 50 submissions, which may overload the grading server. So we might need to make a server dedicated to AIs and AIs only.
MikeMirzayanov Any thoughts?
CF is a good benchmark for models, make a contest for models only, lets see teams participating, with models bounded by no of parameters allowed, RAM required, max power required etc etc, Who makes the most efficient model wins
Yes. Because right now all the alleged rating achievements of these models are "trust me bro"-based. First of all it would be cool to see a definitive proof of those ratings: link to an account with a large sample of contests. Also it would be fun to see the meltdown of the anti-ML crowd when eventually a model achieves number one spot and stays there permanently.