AI Eyewear Opportunities With Multimodal Llama 3
Meta's own Ray-Ban smart glasses now support the multimodal version of the Llama 3, according to official Meta news. With these smart glasses, if you are bored in the car, you can ask Meta to play some music. They can also translate languages you don't understand. Or if you're out and about and can't get your hands free, Meta can send a voice message to a friend. Walk up to a building and call Meta to tell you more about it. Even video calling, live streaming, science, whatever you want, AR glasses can do it. meta has been testing multimodal AI on Ray-Ban Meta smart glasses since last December and has already rolled out the new functionality on glasses sold in the US and Canada.
In addition, there are also a lot of practical features updated, with multimodal AI support Meta glasses, is expected to become the hottest AI hardware this year.
The glasses come with a 12-megapixel camera and five microphones, and the integration of the Meta AI assistant means you can do even more with them. It can describe anything you see. Just say, "Hey Meta, take a look at this and tell me what it is?" and use voice commands to take control. If you look at a pile of ingredients on the kitchen counter, Meta can quickly create a relevant recipe.
For AR glasses, real-time translation will be a killer app. If you're travelling, try reading a French menu. Without consulting your mobile phone, the smart glasses can provide real-time translation. It can even read gestures in different languages, making it a must-have travel accessory. In addition to the multimodal Llama 3, Meta has also announced that the smart glasses will be integrated with WhatsApp and Messenger for hands-free video calling.
Users can connect the glasses to Apple Music for hands-free control of Apple Music to play any song, playlist, station or artist. You can also get personalised recommendations based on your listening history. In addition to listening to podcasts, Meta Glasses can now experience even more music. As for video calling, you can talk to friends and family on WhatsApp and Messenger and share the view during a video call. This feature is currently being tested on a small scale and is not yet fully available.
A pretty clear demo of the video calling feature can be seen in a short video posted by Zuckerberg. In the video, he talks about the new Skyler frames and gold chains with Eva Chen, who is in charge of Instagram fashion. A number of new eyewear styles have also been released. The new Skyler frames feature a signature cat-eye design inspired by the iconic jet-set fashion era, designed for smaller faces. The Ray-Ban Remix platform offers hundreds of customisable frame and lens combinations.
Meanwhile, several fashionable frame designs are available exclusively with prescription lenses.
