Google Offers High Quality ‘Jump’ 360 Video Stitching with Improved 3D

Google this week introduced a new “High Quality” option for their Jump Assembler, an automated 3D 360 video stitching service for creators shooting with Jump cameras. The new approach brings more accurate stitching with enhanced depth maps resulting in sharper 3D output.

In a blog post this week, Google software engineer David Gallup detailed the new High Quality stitching option for creators using the Jump Assembler. He explained that the prior method uses an “optical flow” approach, which uses pairs of cameras to match pixels between each camera’s perspective, and then interpolate the view from one camera to the other.

While the old method will still be available, the new High Quality algorithm expands the number of cameras which can contribute to determining the distance to objects. As Gallup puts it, “[…] the new multi-view stereo algorithm computes the depth of each pixel (e.g., the distance to the object at that pixel, a 3D point), and any camera on the rig that sees that 3D point can help to establish it’s depth, making the matching process more reliable.”

Side by side photos of the output from both the original method and the new method shows cleaner stitching, especially with thin, isolated objects, which are notoriously difficult to stitch reliably:

Standard stitching left vs. High Quality stitching right | Image courtesy Google

The High Quality stitching option not only makes for more accurate alignment of overlapping views, it also produces a much cleaner depth map, which improves the 3D effect when viewing the content and makes VFX work easier for creators. Gallup shared a comparison:

Depth map from Standard stitching left vs. High Quality stitching right (brighter areas are closer to the camera) | Image courtesy Google

In the depth maps you can see not only a significantly sharper outline of the subject, but also much better detection of the rods, which are almost ‘invisible’ to the depth map with the Standard method.

.IRPP_kangoo , .IRPP_kangoo .postImageUrl , .IRPP_kangoo .imgUrl , .IRPP_kangoo .centered-text-area { min-height: 100px; position: relative; } .IRPP_kangoo , .IRPP_kangoo:hover , .IRPP_kangoo:visited , .IRPP_kangoo:active { border:0!important; } .IRPP_kangoo { display: block; transition: background-color 250ms; webkit-transition: background-color 250ms; width: 100%; opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; background-color: #eaeaea; box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -moz-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -o-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); -webkit-box-shadow: 0 1px 2px rgba(0, 0, 0, 0.17); } .IRPP_kangoo:active , .IRPP_kangoo:hover { opacity: 1; transition: opacity 250ms; webkit-transition: opacity 250ms; background-color: #e6e6e6; } .IRPP_kangoo .postImageUrl , .IRPP_kangoo .imgUrl { background-position: center; background-size: cover; float: left; margin: 0; padding: 0; } .IRPP_kangoo .postImageUrl { width: 30%; } .IRPP_kangoo .imgUrl { width: 100%; } .IRPP_kangoo .centered-text-area { float: right; width: 70%; padding:0; margin:0; } .IRPP_kangoo .centered-text { display: table; height: 100px; left: 0; top: 0; padding:0; margin:0; } .IRPP_kangoo .IRPP_kangoo-content { display: table-cell; margin: 0; padding: 0 10px 0 10px; position: relative; vertical-align: middle; width: 100%; } .IRPP_kangoo .ctaText { border-bottom: 0 solid #fff; color: #1ABC9C; font-size: 13px; font-weight: bold; letter-spacing: .125em; margin: 0; padding: 0; text-decoration: underline; } .IRPP_kangoo .postTitle { color: #34495E; font-size: 16px; font-weight: 600; margin: 0; padding: 0; } .IRPP_kangoo .ctaButton { background-color: #e6e6e6; margin-left: 10px; position: absolute; right: 0; top: 0; } .IRPP_kangoo:hover .imgUrl { -webkit-transform: scale(1.2); -moz-transform: scale(1.2); -o-transform: scale(1.2); -ms-transform: scale(1.2); transform: scale(1.2); } .IRPP_kangoo .imgUrl { -webkit-transition: -webkit-transform 0.4s ease-in-out; -moz-transition: -moz-transform 0.4s ease-in-out; -o-transition: -o-transform 0.4s ease-in-out; -ms-transition: -ms-transform 0.4s ease-in-out; transition: transform 0.4s ease-in-out; } .IRPP_kangoo:after { content: “”; display: block; clear: both; }

SEE ALSO
Google’s ‘Welcome to Light Fields’ VR App Reveals the Power of Volumetric Capture

Gallup says that 360 filmmakers using the Jump Assembler can now access the new High Quality option through the Jump Manger program for their next stitch.

The post Google Offers High Quality ‘Jump’ 360 Video Stitching with Improved 3D appeared first on Road to VR.

Be the first to comment

Leave a comment

Your email address will not be published.


*