Blog

I Conducted Experiments With the Alpaca/LLaMA 7B Language Model: Here Are the Results

I Conducted Experiments With the Alpaca/LLaMA 7B Language Model: Here Are the Results

Background

On February 24, 2023, Meta Research released LLaMA: a foundational, 65-billion-parameter large language model. Actually, there were three models: LLaMA 65B and LLaMA 33B were trained on 1.4 trillion tokens, while the smallest LLaMA 7B model was trained on one trillion tokens.

Then on March 13, 2023, a group of Stanford researchers released Alpaca 7B, a model fine-tuned from the LLaMA 7B model.