End-user computing has become an area of major importance to organizations over the past several years. As non-professional computer users come to rely on computer systems to perform more and more of ...

Currently, mainstream AI alignment methods such as Reinforcement Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO) rely on high-quality human preference feedback data.