While using a chatbot to rank chatbot responses isn't ideal, we can at least hope that if it makes mistakes it'll make the same mistake across all models it's ranking.