Sentinel is Roblox’s open-source AI solution to protect children

Roblox this week revealed more information about Sentinel, its AI solution designed to detect potentially dangerous chat messages. Specifically, it’s designed to detect potential grooming or child endangerment by spotting patterns in chat messages. As of this week, Roblox is making Sentinel open-source so that other platforms can use it.

According to Roblox’s announcement, Sentinel will put seemingly innocent chat messages into a larger context to spot possible harmful patterns: “We have developed Roblox Sentinel, an AI system built on contrastive learning that helps us detect early signals of potential child endangerment, such as grooming, allowing us to investigate even sooner and, when relevant, report to law enforcement.”