When the codes of Meta’s LLaMA were leaked on GitHub, it gave researchers across the globe access to the first GPT-level large language model (LLM). What followed is a host of LLMs giving open-source AI a whole new dimension. LLaMA set the stage for models like Stanford’s Alpaca and Vicuna-13B to arrive, thus making it an open-source champion.
However, now, as it appears, we might have a new contender, called Falcon. Developed by the Technology Innovation Institute (TII) in Abu Dhabi, United Arab Emirates, Falcon offers better performance than LLaMA. It has three variants-1B, 7B, and 40B.
According to the institute, FalconLM is the most powerful open-source language model to date. Its largest variant, Falcon 40B, which has 40 billion parameters is relatively smaller than LLaMA, which has 65 billion parameters.
Source-Link: analyticsindiamag
CHUCKYSCARNAGE 