Mark Zuckerberg, Co-Founder and CEO of Meta Platforms, in July 2021.
Kevin Deitch | Getty Images News | Getty Images
Meta has trained and will release a new big language model for researchers, CEO Mark Zuckerberg announce Friday.
model, It’s called LLAMAaims to help scientists and engineers explore applications of artificial intelligence such as answering questions and summarizing documents.
Meta’s release of its new model, developed by the Fundamental Artificial Intelligence Research (FAIR) team, comes as big tech companies and well-capitalized startups alike race to promote advances in AI technologies and integrate the technology into commercial products.
Large language paradigms support applications such as OpenAI’s ChatGPT, Microsoft’s Bing AI, and Google’s unreleased Bard.
In his post, Zuckerberg said that LLM technology could eventually solve math problems or conduct scientific research.
“LLM has shown a lot of promise for text generation, conversations, abstraction of written material, and more complex tasks like solving mathematical theorems or predicting protein structures,” Zuckerberg wrote Friday.
Below is an example of the output of the system, from: meta sheet:
summoned: This is the recommendation letter I wrote for the application for the Feed the Dragon job at Magic Unicorn Corporation: Dear Recruiter,
Answer: I’ve known ___ for 2 years, and I think she would be an excellent dragon feeder for the Magic Unicorn Corporation. ___ Has the ability to remember and process large amounts of information, an important skill for a Dragon Feeder. ___, as an accomplished knight, has a deep understanding of how to kill dragons and how to use each dragon’s weaknesses against him. This means that she knows what kinds of foods each dragon likes and what kinds of foods are dangerous for each dragon. This knowledge and experience will be invaluable as she feeds the dragons. I am confident that ___’s competence, skill, and experience will make her an excellent employee. Please contact me at (___)___-___ if you have any questions. I look forward to hearing from you.
Best Regards,
Honorable Knight
Sir George
This is the model’s rendering of a fictional scene from “Seinfeld”:
summoned: (a funny scene between Jerry and George where George presents his new watch to artificial intelligence)
Answer: George: “But you see, Jerry, it’s more than just a clock. It’s a little computer. You can program it any way you want. It has a world stopwatch, an alarm clock, a calculator, a database and a language translator. It also has a word processor, And a spell checker, and a full ten-function calculator, and a personal digital assistant, and a modem. I think even a cappuccino.”
Jerry: “Where do you get this stuff?”
George: “From my ad copy. Look, Jerry, it’s not a watch. It’s an organizer and a personal assistant and a dictaphone. You can play chess against it. And, you know, if you like, you can program it to speak foreign languages. It’s a microprocessor, Jerry.”
Jerry: “George, if you had one of those, would you wear it?”
George: “I’m wearing it now.”
Jerry: “I don’t see anything on your wrist.”
George: “It’s because he’s a microprocessor.”
Meta says its LLM is distinguished in several ways from competitive models.
First, it says it will come in multiple sizes, from 7 billion parameters to 65 billion parameters. Larger models in recent years have expanded the technology’s capability, but it costs more to run, a phase researchers call “inference.”
OpenAI’s Chat-GPT 3 contains 175 billion parameters, for example.
Meta also said it will make its models available to the research public and will take submissions from researchers. The base models for Google’s LaMDA and OpenAI’s ChatGPT are not public.
“Meta adheres to this open model of research and we will make our new model available to the AI research community,” Zuckerberg wrote.
“Certified food guru. Internet maven. Bacon junkie. Tv enthusiast. Avid writer. Gamer. Beeraholic.”
More Stories
Nintendo is launching a music app with themes from Mario and Zelda, and more importantly, a Wii Shop channel
The Google Pixel Tablet 3 will take another step towards replacing your laptop
Apple still excels at building the best computers