Meta Presentation: New AI Assistant, Llama 3.2 Models, and More

Meta unveiled a number of AI innovations at its annual Meta Connect 2024 event, including new versions of the large language model Llama 3.2, the Meta AI voice assistant, an update to Ray-Ban smart glasses, and more.  

The Llama family of large language models has been updated to version 3.2. Neural networks have become multimodal - they are able to process text and images. 

The compact Llama 3.2 11B and the larger 90B can analyze graphs and charts, label images, and identify objects in pictures. For example, given a company's annual income chart, the models can quickly identify the most productive months. After analyzing a park map, the AI ​​will suggest the length of a trail or a change in terrain.

The other two versions of the model, Llama 3.2 1B and 3B, are more compact. They are designed to work on smartphones and are used for simple tasks such as summarizing and rewriting paragraphs. 

Meta AI assistant gets a voice. Users can ask questions and get voice answers on Messenger, Facebook, WhatsApp and Instagram. 

Smart glasses from Ray-Ban and Meta have received an update - real-time video processing using artificial intelligence. Thanks to this, you can ask the glasses questions about what they see. Reminders, translation functions and integration with music apps have also been added. 

Meta AI has been trained to edit photos, answer questions about images, and share them in chats. The functionality has become available thanks to the multimodality of Llama 3.2. 

By sending an image to the AI ​​assistant, you can ask it to make changes, such as removing an object or updating the background.

Meta AI is available on Instagram. 

The event featured the Orion glasses. They are lightweight and have a neural interface for control, and can also track hands and eyes. They use small projectors built into the temples. The product is positioned as a continuation of Ray-Ban smart glasses and is still being developed.

Another new gadget is the Meta Quest 3S. This is a cheaper alternative to the Quest 3. The new mixed reality headset costs $300, which is $200 cheaper than the standard version. The base model comes with 128 GB of storage and a lower-quality display.

The company is testing a translator mode, where AI takes original content, translates it into another language, and lip-syncs the creator accordingly. 

To recap, in July Meta unveiled a collection of new Llama 3.1 AI systems , including the “long-awaited” 405B, “the first open-source, cutting-edge model.”