Nvidia has introduced a new cloud-based suite of GPU-accelerated AI video conferencing software with the goal of improving streaming video quality and enhancing the overall video conferencing experience. Nvidia Maxine is a cloud-native video streaming AI platform that enables service providers to bring new AI-powered capabilities to the more than 30 million web meetings expected to take place every day. By running the new platform on the company's GPUs in the cloud, video conferencing service providers can offer users new AI effects, including eye gaze correction, super resolution and shadow removal. noise, facial reignition, etc. One of the best things about Nvidia Maxine is that end users can take advantage of all these new features without the need for specialized hardware, since the data from their video conference calls is processed in the cloud instead of on their local devices. Nvidia Vice President and General Manager of Accelerated Computing Ian Buck provided additional information on the company's new platform in a press release, saying: "Video conferencing has become a part of daily life, helping millions of people to work, learn, play and even see a doctor. NVIDIA Maxine integrates our most advanced audio, video, and conversational AI capabilities to bring revolutionary efficiency and new capabilities to the platforms that keep us all connected. "
nvidia maxine
The Nvidia Maxine platform is also capable of drastically reducing the bandwidth required for video calls, as artificial intelligence software analyzes each person's key facial points during a call and then intelligently resurrects the face in the video. the other side. By using the company's new AI-based video compression technology running on Nvidia GPUs, developers can reduce video bandwidth consumption to one-tenth of the requirements of the H-broadcast video compression standard. .264. This not only reduces costs for providers, but also provides a smoother video conferencing experience, even for users with less than ideal internet speeds. Maxine will also help make video conferencing more like a face-to-face conversation, as service providers will be able to leverage Nvidia's research on generative antagonistic networks (GANs) to deliver a variety of new features. Some of them include facial alignment to make people appear to be facing each other during a call, gaze correction that helps simulate eye contact, and animated avatars with realistic animation automatically driven by your voice and tone. emotions in real time. With the Nvidia Jarvis SDK, developers can even integrate virtual assistants that use cutting-edge AI language models for speech recognition, language understanding, and speech generation. These virtual assistants can also take notes, set actions, and answer questions using human voices. At the same time, additional conversational AI services such as translations, closed captioning, and transcription help ensure that participants know what is being discussed on a call. Computer vision AI developers, software partners, startups, and computer manufacturers building audio and video applications can now apply for early access to the Nvidia Maxine platform.