Research on aligning AI with human values and intent, and reports documenting model failures.