Zuckerberg posted on Instagram today to explain that Meta will incorporate the new Meta AI assistant, powered by Llama 3, into products including Whatsapp, Instagram, Facebook and Messenger.
Meta said in the blog post announcing Llama 3 that it has focused heavily on improving the training data used to develop the model. It is fed seven times more data than its predecessor, Llama 2, the company said. Some AI experts note that the figures released by Meta also point to the creation of Llama 3 requires a huge amount of energy to power the required servers.
The growing capabilities of open-source AI models have made some experts worry that they could make it easier to develop cyber, chemical or biological weapons — or even become hostile to humans. . Meta does release tool which it says can help ensure Llama doesn't make potentially harmful statements.
Others in the AI field say that Meta's Llama model not as open as they could be. The company's open source license on the models places some restrictions on what researchers and developers can build.
“It's great to see more models publicly dropping their weights,” said Luca Soldaini, a senior applied research scientist at the Allen Institute for AI, a nonprofit lab. “But the open community needs access to all the other parts of the AI process—its data, training, logs, code, and evaluation. This is what will ultimately accelerate our collective understanding of these models.”
Stella Bidermanan AI researcher involved EleutherAI, a nonprofit open-source AI project, said Meta's license for Llama 2 limited the experiments AI researchers could run with it, and added that the Llama 3 license was even more limited. more restrictive. “Meta releases weight but is very limited in what you can do with them,” Biderman said.
Part of the model's license states that companies with “more than 700 million monthly active users” must apply for a special license from Meta—a provision seemingly designed to prevent the project from helping the company's closest competitors.
Even so, Llama 3 looks set to spark a new round of AI experimentation. Clement Delange, CEO of cover face, an open repository of AI models, including Llama 3, says developers have created more than 30,000 variations of Llama 2. “I'm sure we'll see a bunch of new models too based on Llama 3,” he said. “Meta's great community move.”
