Meta's New AI Capabilities: From AI Assistant to Image Transformation
Discover the exciting new AI capabilities that Meta has introduced! From an advanced AI assistant to image transformation tools, Meta is harnessing the power of generative AI to enhance its technology. In this article, we will explore the various ways that Meta is using AI to empower users to be more creative, expressive, and productive. Whether you’re interested in the AI assistant, AI personality chatbots, or the AI Studio platform for businesses and creators, Meta’s new AI capabilities are sure to captivate you. Keep reading to learn more!
Meta Unveils a Array of Innovative AI-Powered Features Across Messaging Apps, Meta Quest 3, and Upcoming Ray-Ban Meta Smart Glasses. These cutting-edge features, spanning from an AI assistant to advanced image editing, leverage the potential of generative AI to enhance the allure of Meta’s technology.
As Meta puts it, these new AI experiences and features are designed to empower users with tools for greater creativity, expressiveness, and productivity. These exciting AI-centric revelations were unveiled during Meta’s annual Connect conference, where the company also introduced its latest mixed reality headset and revealed plans for a partnership with Ray-Ban to launch smart glasses.
All the AI technology is rooted in Llama 2, Meta’s latest series of open-access AI models launched in July. This expansive language model is engineered for generating text and code in response to prompts, leveraging a blend of publicly accessible data, as outlined by Meta. The company further revealed its plan to introduce Llama 3 in 2024.
Additionally, Meta unveiled Emu, its novel image generator, at the Connect event. Emu will serve as the driving force behind various AI applications, including AI stickers and image editing. Now, let’s delve into the exciting array of new AI applications that Meta has in store.
Bolstered by Bing: Meta's AI Assistant
Meta’s AI Assistant is engineered to provide instantaneous information and create lifelike images from text prompts within seconds. Whether assisting in group trip planning, answering general knowledge queries, or conducting real-time web searches via Microsoft’s Bing, this AI Assistant is your go-to resource.
Leveraging the capabilities of Llama 2, Meta meticulously curated specialized datasets grounded in natural conversations, ensuring that the AI responds in a conversational and amicable manner.
Ahmad Al-Dahle, VP of GenAI at Meta, explained, ‘With Meta AI, we recognized an opportunity to expand this capability beyond just crafting poems. Underlying Meta AI, we’ve developed an orchestrator that adeptly discerns a user’s intent from a prompt and seamlessly directs it to the appropriate extension.
The initial extension will offer real-time information retrieval through Bing-powered web searches for queries. “Whether you’re interested in the history of Eggs Benedict, its recipe, or where to find it in San Francisco, Meta AI enables access to the latest information through its search capabilities,” stated Al-Dahle.
The AI Assistant will initially launch in beta on WhatsApp, Messenger, and Instagram in the U.S., with plans for integration into Ray-Ban Meta smart glasses and the Quest 3 VR headset in the near future.
Conversations with AI-Based Celebrity Personalities
Meta has introduced 28 AI personality characters, each inspired by famous figures across sports, music, social media, and more. These AI personalities, akin to specialized chatbots, are available for messaging on WhatsApp, Messenger, and Instagram. Each character embodies a celebrity or influencer:
- “Bru” channels football star Tom Brady to discuss sports.
- “Tamika,” inspired by tennis player Naomi Osaka, engages in Manga conversations.
- “Zach” portrays YouTube personality Mr Beast with humor.
- “Luiz” adopts the persona of MMA fighter Israel Adesanya to delve into MMA topics.
- “Billie” embodies the role of a big sister, inspired by model Kendall Jenner.
Meta’s AI personalities are powered by Llama 2 LLM, primarily drawing knowledge from information predating 2023. Meta has plans to integrate its Bing search function into these AI personalities in the near future.
These characters are set to gain voice capabilities next year, adding an audio dimension to their interactions. However, as of now, there is no audio component; any video elements are generated through AI-driven animations. Meta initially recorded individuals representing the various AIs and employed “generative techniques” to unify these diverse animations into a seamless experience.
Meta has not disclosed specific details regarding how it compensated celebrities for the use of their likenesses.
Meta’s AI Studio platform for creators and businesses
Meta’s AI Studio platform is set to empower businesses in constructing AI chatbots for Meta’s range of messaging services, encompassing Facebook, Instagram, and Messenger.
Commencing with Messenger, AI Studio aims to enable companies to “develop AIs that align with their brand’s principles and enhance customer service interactions,” as stated by Meta in a recent announcement. During the presentation, Meta CEO Mark Zuckerberg clarified that the envisioned use cases primarily revolve around e-commerce and customer support.
Initially, AI Studio will be available in alpha, with Meta planning to expand the toolkit further starting next year. In the future, content creators will also be able to leverage AI Studio to build AIs that “expand their virtual presence” throughout Meta’s apps. Meta emphasized that these AI creations would require the creator’s approval and direct control.
Meta has plans to introduce a sandbox in the upcoming year, allowing anyone to experiment with developing their own AI, a capability that Meta intends to integrate into the metaverse.
AI stickers by Emu
CEO Mark Zuckerberg has unveiled the forthcoming arrival of generative AI stickers to Meta’s suite of messaging apps. This feature, driven by Meta’s newly developed foundational model for image generation, known as Emu, will empower users to effortlessly craft distinctive AI stickers within seconds across various Meta applications, including WhatsApp, Messenger, Instagram, and even Facebook Stories.
Zuckerberg highlighted, “Every day people send hundreds of millions of stickers to express things in chats. And every chat is a little bit different, and you want to express subtly different emotions. But today we only have a fixed number — but with Emu now you have the ability to just type in what you want.”
To utilize these stickers, users can simply input their desired image descriptions into a text box. The feature was demonstrated within WhatsApp, where Zuckerberg showcased imaginative requests like “Hungarian sheep dog driving a 4×4,” for instance. Meta reports that, on average, it takes just three seconds to generate multiple sticker options for instant sharing.
Initially, this feature will be accessible to English-language users and is set to roll out gradually over the course of the next month, according to the company.
AI Image Editing: Transform Your Photos and Add Custom Backdrops
Meta has exciting plans for Instagram users in the U.S., as they’ll soon gain access to two innovative features: “restyle” and “backdrop,” both empowered by the Emu technology.
The “restyle” feature enables users to unleash their creativity by reimagining the visual styles of images. During a demonstration, Zuckerberg showcased edits on a photo of his dog, Beast, transforming it into origami and cross-stitch styles using AI. Users can achieve these transformations by simply inputting prompts like “watercolor” or even more detailed requests like “collage from magazines and newspapers with torn edges,” as Meta explained in a blog post.
On the other hand, “backdrop” offers the capability to change the scene or background of images through the use of prompts. Meta is committed to transparency, and AI-generated images will include indications that AI was employed “to reduce the chances of people mistaking them for human-generated content.” The company is also exploring various forms of visible and invisible markers for this purpose.
Addressing safety concerns, Al-Dahle emphasized, “If you’ve spent any time interacting with conversational AI, you’re likely aware that they have the potential to provide inaccurate or inappropriate responses. This potential applies to our AI as well.”
He further explained that Meta invested “thousands of hours” in red-teaming and refining prompts to train their AI assistant and characters to avoid problematic subjects. Red-teaming involves an iterative process of trying to prompt the model to generate harmful content, implementing corrective measures, and repeating this process to improve safety continuously.
In addition to these efforts, Meta is taking transparency seriously by releasing system cards alongside its AIs. These system cards aim to provide users with insights into “what’s inside and how they were built,” enhancing understanding and accountability.
In conclusion, Meta’s new AI-powered features and products have the potential to revolutionize the way we interact with technology. From the AI Assistant that provides real-time information and image generation to the AI personality chatbots based on celebrities, Meta is harnessing the power of generative AI to enhance our creativity and productivity. The AI Studio platform also offers businesses and creators the opportunity to build their own AI chatbots and extend their virtual presence. With a commitment to transparency and safety, Meta is working towards providing users with a seamless and accountable AI experience. The future of AI with Meta looks promising, and we can’t wait to see what innovations they bring next.
What are your thoughts on Meta’s decision to create AI personality chatbots based on famous people? Do you see this as a positive addition to messaging apps, or do you have concerns about privacy and impersonation? Share your insights below.