Beginner Basics

Plain-English explainers: tokens, context windows, hallucinations, fine-tuning, RAG and agents.

A Brief Introduction to Gender Bias in AI

AI gender bias appears in embeddings, face classifiers, language models, and image systems; 2016-2023 studies show it can be measured and mitigated.

0 views

Imperfect reward functions in real-world settings

This article introduces reward misspecification in reinforcement learning: reward functions are only proxies for our true goals, and powerful optimizers exploit gaps between what we write and what we …

0 views

Artificial intelligence and computing power

Since 2012, the computing power used to train the largest AI systems has grown more than 300,000-fold, doubling every 3.4 months—a pace far exceeding Moore's Law's two-year doubling period. Because gr…

0 views

Improved language models and what they mean

This article explains OpenAI's GPT-2, a large-scale unsupervised language model trained only to predict the next word. Despite no task-specific training, it generated coherent paragraphs, set language…

0 views

Training GPT-2 Based on Human Feedback

This article reviews OpenAI's early experiment fine-tuning a 774M-parameter GPT-2 model using human feedback. Labelers taught the model to match their preferences, but narrow instructions led to unint…

0 views

CLIP: Linking language and visual data

CLIP is a neural network that learns visual concepts through natural language supervision rather than fixed-label datasets. Like GPT-2 and GPT-3's zero-shot capabilities in language, CLIP accepts cate…

0 views

DALL·E: Generating images from text descriptions

DALL·E is a neural network that creates images directly from text descriptions. It can render a broad range of concepts expressed in natural language, combining distinct ideas to produce novel, realis…

0 views

Introducing new GPT-3 features: Editing and insertion

OpenAI released new versions of GPT-3 and Codex that go beyond forward-only text completion. The models can now edit existing text and insert new content at specific points within a document. This ena…

0 views

Mitigating bias and enhancing safety in DALL·E 2

OpenAI is introducing a new approach to mitigate bias and enhance safety in DALL·E 2, enabling the image generation model to create images of people that more accurately reflect the true diversity of …

0 views

Say Hello to Whisper

Whisper is OpenAI's newly released open-source neural network for automatic speech recognition (ASR). It stands out by combining accuracy with robustness, achieving near human-level performance on Eng…

0 views

Meet ChatGPT: A New Introduction

This article introduces ChatGPT, a language model designed for natural dialogue rather than single-shot commands. Its conversational format lets it answer follow-up questions, admit mistakes, challeng…

0 views

How should AI systems act, and who gets to decide?

OpenAI explains how ChatGPT's behavior is shaped through training, data, and guidelines, and outlines plans to improve it over time, offer users more customization, and invite public input on decision…

0 views

Advancing the governance of AI

OpenAI and other leading AI labs have made voluntary commitments to safer AI development, covering safety testing, security measures, and transparency. These pledges create public accountability, shap…

0 views

Educating with Artificial Intelligence

A comprehensive guide helps teachers at all tech levels use ChatGPT in the classroom. It offers ready-made prompts for lesson planning, quizzes, and differentiated materials, explains how the AI gener…

0 views

Introducing GPTs: A New Era Begins

OpenAI's GPTs let anyone build custom versions of ChatGPT by combining instructions, uploaded knowledge files, and capabilities like web browsing, DALL·E image generation, and code interpretation—no c…

0 views