SiliconANGLE

Microsoft releases Phi-4 language model trained mainly on synthetic data

Microsoft Corp. has developed a small language model that can solve certain math problems better than algorithms several times its size. The company revealed the model, Phi-4, on Thursday. The ...
ZDNet

Beware of AI 'model collapse': How training on synthetic data pollutes the next generation

To feed the endless appetite of generative artificial intelligence (gen AI) for data, researchers have in recent years increasingly tried to create "synthetic" data, which is similar to the ...
Nature

AI produces gibberish when trained on too much AI-generated data

As generative artificial intelligence (AI) models — from Open AI’s ChatGPT to Meta’s Llama and beyond — become more available, the amount of AI-generated content on the Internet is swelling.
The Economist

Training AI models might not need enormous data centres

Once, the world’s richest men competed over yachts, jets and private islands. Now, the size-measuring contest of choice is clusters. Just 18 months ago, OpenAI trained GPT-4, its then state-of-the-art ...