Interactive Virtual Reality Broadcast Systems And Methods

What is this patent about?

’014 is related to the field of interactive virtual reality (VR) broadcast systems. The patent addresses the problem of replicating the experience of live musical performances during situations, such as pandemics, where social distancing is required. Traditional broadcast systems lack the interactive elements that make live performances engaging, such as audience feedback and the ability for performers to connect with the audience's energy.

The underlying idea behind ’014 is to create a virtual environment that mimics a live performance, capturing and transmitting both the performance itself and the audience's reactions in real-time. This is achieved by using sensors to track performers' movements and expressions, generating 3D VR avatars that mirror these actions, and then synchronizing these avatars with audio data. Simultaneously, audience feedback is captured and fed back to the performers, creating a closed-loop interactive experience.

The claims of ’014 focus on a method comprising receiving audio and visual performance data, generating a VR broadcast, receiving audience feedback data from multiple audience devices, synchronizing the audience feedback data with the VR broadcast in real time, transmitting the VR broadcast with the synchronized audience feedback data to the audience devices, and outputting the VR broadcast with the synchronized audience feedback data to the audience members. The claims also cover transmitting performer feedback data to the audience devices, creating a two-way communication channel .

In practice, the system uses a VR system controller to manage the entire process. Performers are equipped with facial expression sensors (e.g., cameras) and body movement sensors (e.g., accelerometers or LIDAR) to capture their actions. Microphones capture the audio. This data is then used to animate 3D VR avatars in a virtual environment. Audience members use VR headsets or other devices to view the performance and provide feedback through cameras and microphones on their devices. This feedback is then displayed to the performers, for example, on AR glasses, allowing them to react to the audience in real-time.

’014 differentiates itself from prior approaches by creating a truly interactive VR experience. Instead of simply broadcasting a performance, it incorporates real-time audience feedback and allows performers to respond, mimicking the dynamic interaction of a live show. The use of 3D VR avatars allows performers to appear closer together in the virtual environment than they are in reality, overcoming the limitations of social distancing. Furthermore, the system allows audience members to select different viewpoints and zoom in on specific performers, enhancing the viewing experience.