AlpacaEval 2.0
Meta AI’s groundbreaking work introduces a self-improving language model that pioneers the generation and use of its own training data. This autonomous method empowers the model to upgrade its abilities iteratively, surpassing notable counterparts like Claude 2, Gemini Pro, and GPT-4 0613 in AlpacaEval 2.0 rankings. Here’s how it operates: Initialization: It begins with an adept pre-trained language model and a seed of human-labeled training data. Self-Instruction Creation: The model autonomously crafts new prompts from the seed data, then formulates a range of possible answers....