Video: VR 360° Live Streaming Workflow
Much more than HD or 4K, delivering an immersive 360° or virtual reality (VR) experience in a live streaming environment introduces new levels of complexity to the streaming workflow, beginning with capture and continuing all the way to output. In this excerpt from his presentation at Streaming Media East 2016, Wowza Systems Senior Director, Technical Marketing Ryan Jespersen describes the key elements in the live streaming workflow for VR 360° video: camera and rig, stitching, processing and delivery, and output.
Learn more about 360 VR live streaming at Streaming Media West.
Read the transcript of Jespersen's remarks:
Ryan Jespersen: What really happens in a typical workflow is you have the camera and the rig. Whether you're using a 6 GoPro system, a 12 GoPro system, or a 16 GoPro system, you're talking about a huge amount of mini HDMI to HDMI cables. You need some way to capture that into a device, such as a Magewell USB native HDMI-to-USB 3. You can plug that in, but you need a laptop that has all those inputs. You need 6 USB 3 inputs, or 12, or 16; you need multiple cards to be able to capture it all. It becomes a hell of a rig to be able to maintain.
Now VideoStitch has come out with the Orah, Giroptic has come out with their 360° camera, and they're building all-in-one devices that combine the camera rig and the videostitching in the same device and make it a lot more portable. As this industry matures, and more people come to VR and 360°, that's going to become the case.
However, VideoStitch still sells their Vahana VR software. If you want to bring your own rig and you're looking at this for 4K film production, fyou're bringing these really, really high-end cameras. You can still use our software and be able to stitch that together if you have a machine that's strong enough to be able to process all these graphics and stitch it together. In a traditional case, a lot of the stitched video that comes out is over RTMP, but as you see more and more IP camera models are using a Power Over Ethernet (PoE) switch at the back. You need a power or PoE injector to be able to power the device and then transfer the data over a network. That traditionally is done over RTSP, so it's a very low-latency protocol. RTMP and RTSP are very good for transmitting low latency. However, you can't deliver directly to devices that RTMP requires the flash player. RTSP is not available without using VLC.
If you want to deliver live VR streams to an iPhone, or you want to deliver to devices on the internet, you need to to repackage it to Apple HLS or MPEG DASH, or one of these HTTP streaming protocols that have 20-30 seconds of latency to them. It gives us a scalability and the device reach to be able to get out there.
That's where Wowza fits in. With Wowza, we can do Wowza Streaming Engine, which is what we're doing today in a local environment. You can deploy that software in the cloud on your own data center or you can use our SaaS service or a Wowza Streaming cloud service that's pretty much a deployable virtual model that has a CDN built into it, and then be able to deliver to all of these users all around the world.
Here's an example of a 6-camera GoPro rig. You have some that are 4-camera, you have some that are circular, and then people are taking the same idea and using extreme high-production cameras. What's funny is, you see a GoPro video, and do you really think that GoPro ad that they just spent $5 million for was done using GoPros? Hello no. They're using RED or other extremely high-resolution cameras to create these beautiful scenes that sell us on GoPro. Having said that, with this particular camera rig, you're talking about extremely high resolution on each of these devices but you still need a way to transfer that, capture it, and then stitch that together. That's where VideoStitch with their Vahana software comes in, and there are other vendors out there that create that stitching software as well.
Here's an example of a 16 GoPro rig. This GoPro rig alone, I think, cost in excess of $5,000. It's not a cheap setup. This slide shows the VideoStitch Orah. This is just a screenshot of what the Vahana VR software looks like. In this example, you can see we have 6 different feeds from 6 different GoPros. You can see the resolution. In this example, it's coming in at 1280x960. It's then stitching that together and you can control the encoding and the bitrate. You can control the final resolution of the output, all of those different steps when stitching it together, and then you can transmit that over RTMP to a streaming server that they can then scale that to a global or even local audience.
Related Articles
NBC News 360 VR Video Specialist Edwin Rogers discusses the unique ability of live 360 VR streaming as a news platform to put viewers in the center of the action at world events in this clip from Live Streaming Summit.
05 Oct 2017
Richard Lucquet of Verizon discusses the ongoing impediments to processing and delivering a truly immersive 360 VR experience using existing technologies.
26 Jan 2017
Drea Bernardi of AOL Partner Studios discusses the new approach to visual storytelling demanded by VR production in this excerpt from her presentation at Streaming Media West 2016.
23 Jan 2017
Streaming Media EVP Dan Rayburn discusses the shifting emphasis in the CDN market from delivering bits to providing a complete ecosystem.
24 Aug 2016
Streaming Media EVP Dan Rayburn discusses why using multiple CDNs make sense for some content owners and not for others.
22 Aug 2016
Plex's Greg Edmiston, HBO's John Narus, and Machinima's James Glasscock discuss the challenges of controlling and standardizing the user/viewer experience across the diverse device landscape.
17 Aug 2016
Ooyala analyst Jim O'Neill and Machinima SVP James Glasscock discuss why content owners and broadcasters are recognizing the need to get on board with OTT in the face of cord-cutting.
15 Aug 2016
V-Factor Technologies' Jeremy Bennington explains how content providers can monitor live video delivery in real time and ensure consistent quality across different encoding profiles.
10 Aug 2016
Vimeo's Anjali Sud, StreamVPG's Scott Farb, and CME Group's Scott Szczurek discuss the latest marketing and branding content creation trends at Streaming Media East 2016.
08 Aug 2016
Vimeo VP of Platform Marketing Anjali Sud discusses successful (and not-so-successful) strategies for building branding campaigns with on-demand online video.
03 Aug 2016
MP & Silva's William Mao discusses the pros and cons of opting for an ad-based VOD model vs. building a subscription service.
27 Jul 2016
Virtual reality video has uses beyond entertainment and gaming. Here's how it's making a different in the fields of advertising, medicine, and professional sports.
27 Jul 2016
Frost & Sullivan's Avni Rambhia discusses issues with latency, bandwidth, user experience, encoding, reach, and quality facing content creators as they make the leap into live VR.
20 Jul 2016
Streamroot's Erica Beavers makes the case for adaptive bitrate streaming and explains how to deliver the best possible user experience via ABR encoding.
18 Jul 2016
Panelists from NBC, Flix, and comScore discuss which OTT business models will and won't work going forward, and whether or not you need scale to be successful.
13 Jul 2016
Google's Serge Kassardjian, Whistle Sports' Brian Selander, and Recurly's Dan Burkhart discuss the challenges of differentiation in the OTT services market.
11 Jul 2016
RLJ Entertainment's Titus Bicknell describes how Acorn TV used an innovative strategy for adapting long-tail marketing to identify revenue streams in a broader assortment of niche content markets.
06 Jul 2016
Should you be delivering HEVC? It depends on what you're delivering and who you're trying to reach. Frost & Sullivan analyst Avni Rambhia breaks down the key issues of sticking with AVC vs. migrating to HEVC in this clip from Streaming Media East 2016.
04 Jul 2016
Panelists from Streaming Media, Beamr, Brightcove, Verizon, and Yahoo! discuss the balance between encoding quality and bandwidth at Streaming Media East 2016.
29 Jun 2016
Twitter Manager of Content Strategy and Planning Nina Mishkin provides 3 strategic tips on how to leverage Twitter to get your videos seen, expand your reach, and grow your brand.
27 Jun 2016
Once you've decided on the bitrates that you want to deliver, it's time to determine the best resolution for each one, from 360p on up to 1080p. Streaming Learning Center's Jan Ozer shows you how.
24 Jun 2016
Streaming Learning Center's Jan Ozer explains how to choose data rates and resolutions for adaptive bitrate streaming to most effectively meet client expectations and end-user needs.
22 Jun 2016
Companies and Suppliers Mentioned