"Artificial intelligence learned how to generate text and art better than ever before, while computer scientists developed algorithms that solved long-standing problems." Links to further papers and discussion on topics including: Tackling "P versus NP" Emergent behaviours in large language models...
Source: quantamagazine.org
Scaling Kubernetes to 7,500 Nodes: We've scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALLĀ·E, but also for rapid small-scale iterative research such as Scaling Laws for Neural Language Models. Scaling a single Kubernetes cluster...
Source: openai.com