Repository navigation
upload reference file for gpt-4-0125-preview as judge to mitigate wrong reference answers by gpt-4 - #3158
upload reference file for gpt-4-0125-preview as judge to mitigate wrong reference answers by gpt-4#3158Zhilin123 wants to merge 1 commit into
Conversation
Zhilin123
changed the title
|
@Zhilin123 thanks for the PR and generating these results. very helpful. we're working on fixing this too. Since changing judge model affects result quite a lot, we are still reviewing it. we plan to open a new repository that contains this new version MT-bench v1.1. but will definitely take your change into account. for more context on why there's error in reference answer: we explain it here |
|
You're welcome! I do understand that each benchmark comes with its limitations and your team's work on Vicuna Bench and then MT Bench were helpful to many people to understand the general capabilities of models using automatic metrics (for some perspective to others following the thread - MT Bench came out in Jun 2023 when GPT-4 was the strongest model). Looking forward to MT Bench v1.1 - if there's an approximate timeline for its release, please let me know! |
@infwinston any news / ETA about this? Is it related to https://github.com/lm-sys/arena-hard and if yes, is the plan to include (updated) MT-Bench questions as a quicker & cheaper "sub-benchmark" -- or is MTBench v1.1 going to be something completely different? |
|
@odelalleau thanks! recently we've been working hard on a pipeline to generate our next generation benchmark (the Arena-Hard as you mentioned), which we believe offers significantly better separability than MT-bench. So we'll recommend you to try it out. Here is the blog post draft. we plan to release it later this week. after that we'll add MT-bench-v1.1 in the new repo. |
|
Thanks @infwinston -- Arena-Hard definitely looks like a very interesting benchmark and I expect we will be using it for some of our models, but we (at NVIDIA) also believe there is still a need for a cheap & reliable (and static) benchmark like MT-Bench. There are many situations where one just wants a quick informative signal on model quality without eating too much of their OpenAI credits, and the improved MT-Bench from this PR is a great fit for this (a significant improvement over the older version, while being something like ~20x cheaper than Arena-Hard). MT-Bench also offers scores across a small range of categories, which is helpful to validate "at a glance" whether some technique / data is moving the needle in the expected direction (while from what I can tell of Arena-Hard, it seems like there are 250 categories with only 2 prompts in each, so we can't really analyze performance per category). As a result, it'd be great to also release this improved MT-Bench to the community. And it'd be best that it comes from your team so as to avoid a situation where multiple third parties would push forward their own "improved" version (which has already started with https://github.com/InflectionAI/Inflection-Benchmarks -- not sure if there are more already). What do you think? |
|
got it, yes it makes sense and sorry for the delay as there's a lot going on right now. |
|
Sounds great, thanks @infwinston! |
Why are these changes needed?
We (two Applied Scientists with graduate degrees in Artificial Intelligence) recently manually vet through the reference answers for the default gpt-4 judge. To our surprise, we found that the answers to 13/30 reference answers were wrong for at least one of the two turns.
These questions have ids of 104, 105, 109, 111, 113, 114, 120, 122, 124, 125, 126, 128 and 130.
This inaccurate reference answers lead to mt bench scores on the math, coding and reasoning categories to be misleading.
To solve this, we looked into using the more powerful, recent
gpt-4-0125-previewmodel as an alternate source of reference answers. Specifically, we generated answers using the model, verified the answers manually and repeated the process until we got the correct answers. For some questions such as 116, we tried as many as 50 times but for most questions, the model was able to reach a correct answer within 5 tries.Intuitively, having correct reference answers as well as a stronger model as the judge would allow the judge model to more accurate determine the goodness of a model's score. To verify this empirically, we measured the
gpt-4-0125-previewMT Bench score for 10 popular models1 on LMSys leaderboard as well as their regular MT Bench score (if not found on the leaderboard). Then, we correlated the Chat Arena Elo score withgpt-4-0125-previewMT Bench; and separately with regular MT Bench score. The detailed number are below.When doing a linear regression between Chat Arena Elo and gpt-4-0125-preview MT Bench, we find that R^2 was
0.819while for Chat Arena Elo with regular MT Bench, it was0.703.Given this, we believe
gpt-4-0125-previewwill be better as a default MT Bench judge in terms of predicting its performance in the real world (proxied by Chat Arena Elo). The auxiliary advantages forgpt-4-0125-previewrelative togpt-4are:gpt-4-0125-previeware typically 3-30 times (for different usage tiers) as much as forgpt-4allow--parallelto be set much higher without running into errors, saving the end-user time.Related issue number (if applicable)
Closes #2988 , #3053
Checks
format.shto lint the changes in this PR.Footnotes
We avoided the
gpt-4-0613andgpt-4-0125-previewmodels as due to their role as judges, minimizing self-preference biases. ↩