AmShZ's blog

By AmShZ, 6 weeks ago, In English

Hello everyone!

Have you ever wished that math and combinatorics problems had the same live contest experience as competitive programming?

We have, so we are building exactly that on Repovive!

After beta testing our new Math section, we are ready to host the Repovive Math Contest Grand Opening.

You can already try our beta math problems here: https://repovive.com/problems/math

The theme of our first contest will be Combinatorics. The round will contain 5 combinatorics problems to be solved in 2 hours and 30 minutes. The problem set is intended to be suitable for a wide range of levels, so everyone is welcome to participate.

The contest is rated for everyone.

Since this is the first large live test of this format, we would especially love to have you participate, try the judging system, and share your feedback afterward.

Prizes

We have an $800 prize pool for the grand opening!

  • 1st place: $250
  • 2nd place: $150
  • 3rd place: $100

There are also additional prizes:

  • First Accept: $25 for the first accepted solution on each of the 5 problems
  • Random Top 100: 4 participants from the top 100 will receive $25 each
  • Random Participant: 3 participants from the contest will receive $25 each

Rules

  • This is a mathematical problem solving contest. No programming is required.
  • You submit a written solution for each problem.
  • Your penalty is the time of your last accepted submission. Each minute counts as 1 negative point.
  • Wrong submissions do not add any extra penalty.
  • You may make at most 15 submissions per problem.
  • Your goal is to get as many problems accepted as possible within the contest.
  • Any use of AI is strictly prohibited, including using AI for translation.
  • The platform can translate problem statements into different languages for you.
  • You may write your solution in any language. The judging system supports solutions written in different languages.

How judging works

Instead of a traditional code judge, your written mathematical solutions will be evaluated by 5 GPT 6 judges.

You can write your proof and reasoning directly in text. The judges check whether your submitted solution correctly solves the problem.

Judging is completely binary. There is no partial score. Each submission is either Accepted or Rejected.

LLM based judging for mathematical reasoning has also been studied academically. For some background on the strengths and limitations of this approach, you can read the paper From Calculation to Adjudication: Examining LLM Judges on Mathematical Reasoning Tasks.

This contest is also an experiment for us. We want to see how well a live competitive format for mathematical problem solving can work, both technically and competitively.

We would really appreciate your participation and feedback.

See you on the leaderboard!

UPD1: Congratulations to all prize winners!

$250 first place: yusa kimura (fact493)

$150 second place: Kosuke Kaneshita (potato167)

$100 third place: 1434

$25 First Accept prizes

One prize for each problem:

$25 Random Top 100 prizes

Four winners:

$25 Random Participant prizes

Three winners:

That's $800 in total prizes. Random winners were drawn from all contestants who submitted during the round.

Congratulations to the winners, and thanks to everyone who took part in our first Math contest!

Winners, keep an eye on your email inbox for instructions on receiving your prize.

  • Vote: I like it
  • +209
  • Vote: I do not like it

»
6 weeks ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

Do you plan to add lean support?

  • »
    »
    6 weeks ago, hide # ^ |
     
    Vote: I like it +3 Vote: I do not like it

    It would be interesting if, rather than judging on freeform proof, you first provide freeform, you receive lean translation and confirm/clarify intent, then that is judged.

  • »
    »
    6 weeks ago, hide # ^ |
     
    Vote: I like it +7 Vote: I do not like it

    Yes! Lean support is currently under implementation and should be available in the future.

»
6 weeks ago, hide # |
 
Vote: I like it +3 Vote: I do not like it

Will written submissions be on paper or typed in latex?

  • »
    »
    6 weeks ago, hide # ^ |
     
    Vote: I like it +6 Vote: I do not like it

    Typed.

    You can write your solution in any language and any format you prefer, including plain text or LaTeX.

»
6 weeks ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

Hello, can this contest time be changed to a weekend? Preferably after the starter round on Sunday or another Sunday.

  • »
    »
    6 weeks ago, hide # ^ |
     
    Vote: I like it +1 Vote: I do not like it

    This contest has already been scheduled, so we probably won’t change its time.

    For the upcoming contests, though, we’ll definitely try to schedule them on weekends whenever possible.

»
6 weeks ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

what do you think about changing the grading to IMO/Putnam style (either 0-7 or 0-10 scale) instead of natural language feedback? I feel like natural language is giving too much information back to the users.

  • »
    »
    6 weeks ago, hide # ^ |
     
    Vote: I like it +7 Vote: I do not like it

    We may change both the binary grading and the grading scale in the future. This is our first math contest, so the rules and judging system may change quite a lot over time based on feedback.

    Also, the feedback currently shown in the beta is more detailed than what participants will receive during the actual contest, so it should not reveal as much information.

    The main reason we currently prefer binary grading is fairness. With something like an IMO-style 0–7 scale, we would need a much stricter grading protocol, and there could be variance between graders that makes the results less fair.

    If we become confident that our judging system can grade accurately and consistently on such a scale, I think it could be a good option.

    Thanks for the suggestion!

»
6 weeks ago, hide # |
← Rev. 3  
Vote: I like it +15 Vote: I do not like it

Isn't the feedback on rejected submissions a pretty significant bug? I just tested it and a WA submission gave me a specific mathematical hint identifying the flaw in my proof. Since wrong submissions have no extra penalty and there are 15 attempts, this effectively lets contestants use the judge as an interactive proof debugger: submit → get a hint → fix → resubmit

This seems quite different from normal contest judging and could potentially make some problems much easier

Rejected submission
Accepted submission

With 15 attempts and no WA penalty one could deliberately submit progressively incomplete proofs and use the judge to locate the missing pieces.

  • »
    »
    6 weeks ago, hide # ^ |
     
    Vote: I like it +5 Vote: I do not like it

    You are right to point this out.

    What you are seeing here is the training mode. During live contests, the judge will not provide these hints on rejected submissions, so it cannot be used as an interactive proof debugger in this way.

    We will also make this distinction clearer on the platform.

»
6 weeks ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

Interesting, with AI help now we can have math contest auto judge.

»
6 weeks ago, hide # |
← Rev. 2  
Vote: I like it +20 Vote: I do not like it

Is it allowed to write program by hand to investigate some property of the problem? Or only pen and paper?

  • »
    »
    6 weeks ago, hide # ^ |
     
    Vote: I like it +16 Vote: I do not like it

    No. As in standard math contests, you are not allowed to use programs or other computational tools to investigate the problem. You should solve it using only your own mathematical reasoning.

    Of course, this is not something we can always detect, so it is partly an honor-system rule between us and the participants. However, if we find clear evidence that someone used such tools during the contest, we may disqualify that user.

    Also, in your proof, you cannot justify a claim by saying that you checked it with code. Every step of the proof should be mathematically justified and follow logically from the previous steps.

    • »
      »
      »
      5 weeks ago, hide # ^ |
       
      Vote: I like it +38 Vote: I do not like it

      I couldn't find this restriction anywhere on the official rules page. Could you please explicitly add it there?

      Since Repovive is also a competitive programming platform, I don't think it would be obvious to participants that writing code to explore properties of a problem is prohibited. It would be helpful to have this restriction clearly stated in the official rules.

»
6 weeks ago, hide # |
 
Vote: I like it +3 Vote: I do not like it

I confirmed that I can get AC using Japanese in the beta version. This isn't against the rules, right?

»
6 weeks ago, hide # |
 
Vote: I like it +18 Vote: I do not like it

Wait, y'all actually cooked

»
6 weeks ago, hide # |
 
Vote: I like it +18 Vote: I do not like it

Is it allowed to google an unfamiliar definition and nothing else? I might not know the meaning exactly because I don't use that definition in life at all but I can know it in other words. Or I would like to try solving the problem after learning the definition. One more question: can it be added to type formulas in Typst format (https://typstpad.com example)? They are really convenient.

»
6 weeks ago, hide # |
 
Vote: I like it +8 Vote: I do not like it

PRO tip: if you cant get accepted, try translating into other languages (dont do it in actual contest tho)

Spoiler1
Spoiler2
Spoiler3
»
6 weeks ago, hide # |
 
Vote: I like it +3 Vote: I do not like it

Just for fun, try getting the shortest possible accepted solution to P1 and P3.

»
6 weeks ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

Please announce the random winner of Repovive Premier Round 7 — $300 in Prizes, Repovive Premier Round 8 — $300 Prize Pool and First Math contest.

Because there is a very long queue in your prize announcement, I think.

Thank you

»
6 weeks ago, hide # |
 
Vote: I like it +36 Vote: I do not like it

Am I correct in understanding that a separate rating, something like a “math rating” rather than the CP rating, will change?

»
6 weeks ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

If a proof gets rejected in the live round, is it just a no, or does it cost something on the scoreboard the way a WA does on Codeforces? The beta hints being off is already clear. I didn't see the penalty part.

»
6 weeks ago, hide # |
← Rev. 2  
Vote: I like it +17 Vote: I do not like it

Overall, I am satisfied with the contest and appreciate the interesting experience. However, I have some thoughts:

  • Regarding proofs that were rejected, it is unclear whether the rejection was due to a lack of detailed explanation (some points that is trivial by some but not by others) or critical logical error. Therefore, it would be preferable to have a feature that indicates the reason for rejection, without leaking the actual answer, during the contest.
  • Errors vary widely in nature, ranging from completely off-base proofs to those where the core idea is correct but the detailed reasoning is flawed. If these could be properly evaluated and awarded partial credit, it would allow for a superior tie-breaking method (like MO).
    • The level of detail in the proofs varies from person, so a time-based only tie-breaker feels a bit like a golf contest with natural language.
»
6 weeks ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

Can we have the leaderboard?

»
6 weeks ago, hide # |
← Rev. 2  
Vote: I like it 0 Vote: I do not like it

This contest is an awesome idea! I enjoy it a lot.

Would there be official editorial be published (or hint at least)? I didn't find anything on the page.

(upd. nvm, I found it at the problem section instead of contest section)

»
6 weeks ago, hide # |
 
Vote: I like it +13 Vote: I do not like it

This is going in the history books. I can't wait for the next one!

»
6 weeks ago, hide # |
 
Vote: I like it +13 Vote: I do not like it

The leaderboard for y'all (you can also see problems from the dashboard and the solutions from the leaderboard by tapping the scores of the user you wanna see solution of without registering): https://repovive.com/contests/math-round-1/ranking

»
6 weeks ago, hide # |
 
Vote: I like it +12 Vote: I do not like it

This is very very cool! I ran into a case where the AI was stupid though (and suspect that it might be common?):

For B on the opening contest contest I submitted the following:

Spoiler

This got rejected for the following incorrect reason:

Spoiler

And got accepted after I added the following:

Spoiler

I didn’t do the live contest so I’m not sure how the feedback works, but I think that it’s possible that quite a few submissions got rejected not because of errors/lack of detail but just cus the judge hallucinated?