The new technology, titled Near Real-Time Artificial Intelligence (AI) Enhancement of Video or Augmented Reality (AR) Presentations of Live Events, is designed to modify content in real time. The system can operate during both standard video broadcasts and augmented reality sessions.
Neural network capabilities and technical features
The artificial intelligence will be able to perform several functions: remove filler words, smooth out speech hesitations, and translate the audio track into other languages. At the same time, the neural network will synchronously adjust the speaker's lip movements to the new audio track so that the visual sequence matches the modified speech.
Correct algorithm operation requires time to process the data stream. Because of this, viewers will receive the image with a technological delay.
Development status and risks
At the moment, the legal status of Microsoft's application remains uncertain. There is conflicting information regarding its fate: according to one report, the US patent office rejected the initial claim on July 29, 2026, allowing for revisions, while according to another, the application has been approved and is awaiting fee payment.
Context
Microsoft is an American technology corporation holding leading positions in the field of software development and artificial intelligence systems.
