Researchers at Microsoft have unveiled smaller AI models that can run on devices as compact as smartphones or laptops.

This advancement marks a significant turn from the current trend of accessing advanced AI models, such as ChatGPT, only through the cloud due to their large size.

Take aways:

  • Significant Development in AI: The small AI model unveiled by Microsoft, named Phi-3-mini, is a high-performing yet compact model that measures up successfully against GPT-3.5, the OpenAI model behind ChatGPT. This development proves AI models can display advanced abilities without compromising size.
  • Potential Use Cases: Small AI models can boost the responsiveness and privacy of AI applications by reducing dependency on the cloud. This could lead to possible integrations of AI applications into a device’s operating system, enhancing data privacy, and reducing latency or outages.
  • Future of AI: Rather than increasing the size of AI models, efforts are being made to improve their abilities by being selective in their training. This approach hints at a future where AI models’ aptitudes can be enhanced not merely by scaling up, but by furnishing them with the appropriate resources.

References:

Pocket-Sized AI Models Could Unlock a New Era of Computing – Wired