The document discusses how AI assistants like Alexa and Siri are advancing to become more helpful, harmless, and honest using techniques from Constitutional AI. Researchers are developing new techniques grounded in ethics to ensure AI systems respect human values like privacy, agency and fairness as they become more autonomous. Constitutional AI provides a framework to align advanced AI with human preferences through value-aligned training, model self-supervision, and model interpretability.