Inside Stream AI Moderation for Live Video & Audio

TL;DR

  • Stream AI Moderation runs on a copy of the call. It samples camera frames and live captions and scores them with the same models as chat.
  • It acts right after a violation is detected, since WebRTC is too fast to block a frame first.
  • Rules escalate in steps. Repeated violations lead to a warning, then a mute or blur, then a kick. Flagged calls go to the same review queue as chat.
  • Other video setups work, too. Send frames and captions to the Moderation API, and apply mute and kick yourself.

The challenge: Live video does not give you a queue. A frame that leaves the camera on WebRTC is on someone else's screen in a few hundred milliseconds. You cannot hold the segment, score it, and then decide whether to publish it. By the time a model returns, the moment has already aired.