https://josedavidbaena.com Production notes and source-backed analysis on distributed systems, messaging infrastructure, open-source internals, and model engineering. en-us josedab@gmail.com (José David Baena) josedab@gmail.com (José David Baena) Wed, 09 Sep 2026 00:00:00 GMT https://josedavidbaena.com/blog/distilled-engineering/distilled-dpo-on-policy-alignment https://josedavidbaena.com/blog/distilled-engineering/distilled-dpo-on-policy-alignment Build a bounded on-policy loop that turns a distilled student's validated failures into DPO pairs without leaking holdouts or erasing safety behavior. Wed, 09 Sep 2026 00:00:00 GMT josedab@gmail.com (José David Baena) distillationrlhfdpopreference-optimizationfine-tuningllmsafety