Image by author
Introducing Llama 3
Meta recently released Llama 3, one of the most powerful “open” ai models to date.
Llama 3 is available in 2 sizes: Llama 3 8B, which has 8 billion parameters, and Llama 3 70 B, with 70 billion parameters.
These are relatively small models that barely exceed the size of its predecessor, Llama 2. However, it seems that Llama 3 focuses on quality rather than size, as the model was trained with over 15 trillion data tokens. .
Due to the increase in the amount of training data and advances in training techniques, Llama 3 performs significantly better than Llama 2, even though they are the same size.
This will make it easier to run Llama 3 on local machines.
How does Llama 3 perform among other open models?
Here is a table showing the performance of Llama 3 against other language models on various benchmarks:
Fountain: Goal
Here's what these benchmarks mean:
- MMLU (Massive Multitasking Language Understanding): A benchmark designed to understand how well a language model can perform multiple tasks. The model's performance is evaluated in a variety of subjects, such as mathematics, computer science, and law.
- GPQA (Graduate Level Google Test Questions and Answers): Evaluates a model's ability to answer questions that are difficult for search engines to answer directly. This benchmark assesses whether ai can handle questions that typically require human-level research skills.
- human evaluation: Assesses how well the model can write code by asking it to perform programming tasks.
- GSM-8K: Evaluates the model's ability to solve written mathematical problems.
- MATH: Tests the model's ability to solve middle and high school math problems.
On the left, we see a performance comparison between the smallest model, Llama 3 8B, versus Gemma 7B It and Mistral 7B Instruct, two open source models of similar size.
Llama 3 8B outperforms language models of comparable size in all benchmarks on the list.
Llama 3 70B was compared to Gemini Pro 1.5 and Claude 3 Sonnet. These are two next-generation ai models released by Google and Anthropic and are not open source.
Curiously, technology/ai/google-gemini-next-generation-model-february-2024/” target=”_blank” rel=”noopener”>Gemini Pro 1.5 It is Google's flagship model. It is said to perform better than its current most capable model, Gemini Ultra.
As the only openly available model on the list, it's impressive to see the Llama 3 70B outperforming the Gemini Pro 1.5 and Claude 3 Sonnet in 3 out of 5 performance tests.
Meet MetaAI: the smartest, freely available ai assistant
Call 3 also powers ai.meta.com/meta-ai/” target=”_blank” rel=”noopener”>Meta aian artificial intelligence assistant capable of complex reasoning, following instructions and visualizing ideas.
It has a chat interface that allows you to interact with Llama 3. You can ask it questions, conduct research, and even have it generate images.
Unlike existing LLM chatbots like ChatGPT, Gemini and Claude, Meta ai is completely free to use. Its most advanced model is not hidden behind a paywall, making it a powerful free alternative to existing ai assistants.
Meta ai is integrated into the Meta suite of applications such as facebook, instagram, WhatsApp and Messenger. You can use it to perform advanced searches on these platforms.
According to Mark Zuckerberg, Meta ai is now the smartest ai assistant available for free.
Unfortunately, Meta ai is currently only available in select countries and will be rolled out to users worldwide in the near future.
If it's not available in your country yet, don't worry! I will show you two other ways to access Llama 3 for free.
Getting started: how to access Llama 3
Here are two other ways to access Llama 3 for free:
Accessing Llama 3 with a hug face
hugging face is a community that helps developers build and train machine learning models. The organization focuses on democratizing access to ai and provides access to cutting-edge machine learning models for free.
To access Llama 3 on Hugging Face, you must first create an account on Hugging Face by registering.
Then navigate to HugsChat; The Hugging Face platform that makes the best ai models in the community available to the public.
You should see a screen similar to this:
Fountain: HugsChat
Simply select the wheel icon and change your current model to Meta Llama 3 as shown below:
Fountain: HugsChat
Then select “Activate” and you can start interacting with the model.
Accessing Lllama 3 with Ollama
Ollama is a tool that allows you to run language models on your local machine. With Ollama, you can easily interact with open source models like Llama, Mistral and Gemma in just a few steps.
To access Llama 3 with Ollama, simply navigate to the Ollama website and download the tool. Follow the installation instructions you see on the screen.
Then, navigate to your command line interface and type the following command: ollama run llama3:70b
.
The model should take a few minutes to download. Once this is done, you can type your directions into the terminal and interact with Llama 3, as shown in the following screenshot:
Image by author
Summary
Llama 3 is the latest openly available model from Meta. This LLM outperforms similarly sized models launched by Google and Anthropic and currently powers Meta ai, an ai assistant built into Meta's suite of products.
To access Llama 3, you can use the ai.meta.com/meta-ai/” target=”_blank” rel=”noopener”>Meta ai chat interface, interact with the model through HugsChator run it locally using Be.
Natasha Selvaraj is a self-taught data scientist with a passion for writing. Natassha writes on all things data science, a true master of all things data. You can connect with her at LinkedIn or look at it Youtube channel.