OpenAI News
Organizational update from OpenAI
It’s been a year of dramatic change and growth at OpenAI.
Topics: Models
Concept
Models
OpenAI News
OpenAI licenses GPT-3 technology to Microsoft
OpenAI has agreed to license GPT-3 to Microsoft for their own products and services.
Topics: Models
OpenAI News
Generative language modeling for automated theorem proving
We explore the application of transformer-based language models to automated theorem proving. This work is motivated by the possibility that a major limitation of automated theorem provers compared to humans -- the generation of original mathematical terms...
Topics: Models
Entities: Models
OpenAI News
Learning to summarize with human feedback
We’ve applied reinforcement learning from human feedback to train language models that are better at summarization.
Topics: Models
Entities: Models
OpenAI News
OpenAI Scholars 2020: Final projects
Our third class of OpenAI Scholars presented their final projects at virtual Demo Day, showcasing their research results from over the past five months.
Topics: Models
OpenAI News
Procgen and MineRL Competitions
We’re excited to announce that OpenAI is co-organizing two NeurIPS 2020 competitions with AIcrowd, Carnegie Mellon University, and DeepMind, using Procgen Benchmark and MineRL.
Topics: Models
OpenAI News
Image GPT
We find that, just as a large transformer model trained on language can generate coherent text, the same exact model trained on pixel sequences can generate coherent image completions and samples. By establishing a correlation between sample quality and...
Topics: Models
Entities: Models
OpenAI News
OpenAI API
We’re releasing an API for accessing new AI models developed by OpenAI.
Topics: Models
Entities: OpenAIModelsOpenAI API
OpenAI News
Language models are few-shot learners
Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typically task-agnostic in architecture, this method still requires task-specific...
Topics: ModelsInfrastructure
Entities: ModelsInfrastructure
OpenAI News
OpenAI Microscope
We’re introducing OpenAI Microscope, a collection of visualizations of every significant layer and neuron of eight vision “model organisms” which are often studied in interpretability. Microscope makes it easier to analyze the features that form inside...
Topics: Models
OpenAI News
OpenAI standardizes on PyTorch
We are standardizing OpenAI’s deep learning framework on PyTorch.
Topics: Models
OpenAI News
Scaling laws for neural language models
We study empirical scaling laws for language model performance on the cross-entropy loss. The loss scales as a power-law with model size, dataset size, and the amount of compute used for training, with some trends spanning more than seven orders of...
Topics: ModelsInfrastructure
Entities: ModelsInfrastructure