DALL·E, ChatGPT, Whisper and MentalHealthBench: Expanded Access and New AI Features

A neural network called DALL·E creates images from text captions for a wide range of concepts expressible in natural language. Outpainting has been introduced to extend creativity and enable DALL·E images of any size, helping tell a bigger story.

To share DALL·E 2 with a broad audience while reducing risks associated with powerful image generation models, various guardrails have been put in place to prevent generated images from violating the content policy. A new technique is also being implemented so that DALL·E generates images of people that more accurately reflect the diversity of the world’s population.

In the DALL·E 2 research preview, more than 3,000 artists from more than 118 countries have incorporated DALL·E into their creative workflows. Early access artists helped discover new uses for DALL·E and served as key voices in decisions about it. Early users have created over 3 million images to date and helped improve safety processes. The waitlist is expanding by adding up to 1,000 new users each week, and 1 million people from the waitlist will be invited over the coming weeks. Users can create with DALL·E using free credits that refill every month, and buy additional credits in 115-generation increments for $15.

Other AI tools introduced alongside DALL·E include ChatGPT, a model that interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer follow-up questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests.

Whisper is a trained and open-sourced neural net that approaches human-level robustness and accuracy on English speech recognition. MentalHealthBench is an expert-informed benchmark for evaluating helpful and safe AI responses across realistic mental health conversations.