AGRU's blog

By AGRU, history, 9 months ago, In English

I came across this blog from anthorpic about how they tackled technical evaluations for filtering candidates https://www.anthropic.com/engineering/AI-resistant-technical-evaluations . They also released a modified version of the take home https://github.com/anthropics/original_performance_takehome along with claude performance, for everyone to try and beat it. So everyone lets post our scores here.

  • Vote: I like it
  • -5
  • Vote: I do not like it

»
9 months ago, hide # |
 
Vote: I like it 0 Vote: I do not like it

Interesting. I wonder if pieces of the challenge got into the training set gradually.