Thinking Allowed

medical / technology / education / art / flub

showing posts for 'gpt-3'

Inside a radical new project to democratize AI

A group of over 1,000 AI researchers has created a multilingual large language model bigger than GPT-3—and they’re giving it out for free.
Source: technologyreview.com

China’s GPT-3? BAAI Introduces Superscale Intelligence Model ‘Wu Dao 1.0’ | Synced

The Beijing Academy of Artificial Intelligence (BAAI) releases Wu Dao 1.0, China’s first large-scale pretraining model.
Source: syncedreview.com

Phrase of the day: Scaling Kubernetes to 7,500 Nodes

Scaling Kubernetes to 7,500 Nodes: We've scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALL·E, but also for rapid small-scale iterative research such as Scaling Laws for Neural Language Models. Scaling a single Kubernetes cluster...
Source: openai.com