What you need to know
- NVIDIA announced the RTX Broadcast Engine, a set of SDKs leveraging AI tech to enhance livestreams.
- These SDKs enable virtual greenscreens, style filters, and augmented reality effects.
- NVIDIA is working with OBS to integrate RTX Greenscreen.
- Twitch Studio, Discord, and Elgato received integration for NVIDIA Video Codec SDKs this month, allowing for faster, higher-quality streaming.
Ahead of TwitchCon 2019, NVIDIA announced a new set of SDKs to make the lives of game streamers everywhere much easier. The RTX Broadcast Engine will leverage AI capabilities to offer virtual greenscreens, track facial features to use with AR effects, and utilize various style filters to transform the look of your camera feed into an entirely different style, like that of your favorite painting — Van Gogh's Starry Night was used as an example.
Virtual greenscreens mean that you'll no longer need to go out and buy a physical greenscreen, which can become costly and difficult to maintain if you simply don't have the space for it. The RTX Broadcast Engine transforms your background into anything you want with real-time background removal, creating a more professional looking stream and one that offers much more privacy over broadcasting part your bedroom to the world.
RTX AR will detect and track facial features, modelling the surface of a face, to use real-time augmented reality effects. Streamers will even be able to control a 3D animated character with their likeness, should they choose to do so.
Style filters are popular on smart phones and social media apps, but they're making the jump to game streaming to offer a more personalized experience and increase engagement with a streamer's audience. Once again, this will use real-time AI technology to transfer and stylize your video feed.
In addition to working with OBS to integrate the RTX Greenscreen, three other apps — Discord, Twitch Studio, and Elgato — revealed that integration with NVIDIA's Video Codec SDK made its debut this month. Twitch Studio has enabled higher-quality streaming, Discord now allows you to stream directly to your Discord chat channel through "Go Live," and Elgato will leverage the software in its 4K60 Pro MK.2 capture card to enable recording 4K at 60FPS in High Dynamic Range.
Powered by NVIDIA Turing
An RTX 2060 is the base card you should be using to get the most out of the RTX Broadcasting Engine since it needs tensor cores to work effectively. An ASUS ROG STRIX GeForce RTX 2060 can support up to four monitors.
