Open model safety: lessons from training and evaluating Beam

November 5, 20267 min read

Key Takeaways

  • Beam optimizes the safety-utility tradeoff at the frontier. The model achieves high rates of refusal on dangerous requests while maintaining compliance on legitimate ones, demonstrating that open models can simultaneously maximize both safety and helpfulness without sacrificing either.
  • Through Project Iris, Reflection is releasing open-source safety research, evaluation artifacts (e.g. Iris Safety Evaluations), and tools that researchers, developers, policymakers, and enterprises can freely use and build upon, widening access to safety best practices and knowledge.

Building safe open models requires a thoughtful approach to data, a deep understanding of how to evaluate potential harms, and the tools to mitigate them. For Beam, Reflection’s first open-weight model, we prioritized safety training to reduce harmful assistance while preserving useful responses to legitimate requests, including responses involving sensitive subjects.