Microsoft just filed a patent for an AI product that would be able to transform live video in real time to alter speakers’ words and faces.
The patent, as first flagged by patent-tracker Patentlyze, is described by its inventors as a “near real-time artificial intelligence (AI) enhancement of video or augmented reality (AR) presentations of live events.”
Using AI agents, the system would identify and alter or remove certain words, while editing a speaker’s face and mouth to match. The agents would rely on set parameters or user profiles to make the changes, and would also edit the video and audio just before and after a removed or replaced word to allow for “smooth transitions.”
In an era of media and the internet increasingly defined by AI-fueled deepfakes, disinformation, and information-muddling slop, the system described in this patent may represent a new world of filtering tools that subtly alter reality as it takes place, in this case on a highly-personalized level. Viewers, the patent suggests, could consume whatever live event they want to without hearing what they don’t want to hear.
