Facebook Filter for 360° Videos

As you may know Facebook open sourced its ffmpeg filter to convert 360° videos. The source code is available on GitHub and has to be compiled into ffmpeg. This is quite a hassle if you just want to a quick check of the tools capability.

To save you some trouble I converted a test video in every available output layout. Kudos to Finwe for releasing their 360° test images and videos and giving me permission to publish the transformed images.

I converted the equirectangular input video with following command:

ffmpeg -i Orion360_test_video_2048x1024.mp4 -vcodec rawvideo -vf transform=input_stereo_format=MONO:cube_edge_length=512:output_layout=cubemap out.avi

Some of the videos got distorted but I think setting the width and height parameters should solve this issue.

Input

Orion360_test_image_2048x1024

a 2048×1024 equirectangular mp4, CC BY-ND by Finwe

stereo version (one eye colored, one grayscale)

stereo version (one eye colored, one grayscale)

Output

cubemap

cubemap

The well known cubemap format, but with all six faces in row. This may cause trouble with some encoders and decoders that are limited resolution wise.

cubemap_stereo

cubemap_32

cubemap_32

A more compact form but otherwise identical to cubemap.

cubemap_32_stereo

cubemap_180

cubemap_180

I found no documentation about this format but it seems the front half of the cube has double the resolution than the back half. You would need another test video to figure this layout out.

cubemap_180_stereo

flat_fixed

flat_fixed

This format might be useful for streaming the video dependent on your viewing direction. You would need to create several videos in this format with different pitch and jaw angles.

flat_fixed_stereo

plane_cubemap

plane_cubemap

Like cubemap but with another face order. This makes more sense to me because there are less “seams” (left, front, right and back are all in “correct” order). I would assume the video can be better compressed this way.

plane_cubemap_stereo

plane_cubemap_32

plane_cubemap_32

Like cubemap_32 but with the face order of  plane_cubemap.

plane_cubemap_32_stereo

plane_poles

plane_poles

I have no idea why you would want to use this format. Any comment on this would be appreciated.

plane_poles_stereo

plane_poles_6

plane_poles_6

Like plane_poles but with equal resolution for every face.

plane_poles_6_stereo

plane_poles_cubemap

plane_poles_cubemap

Like plane_cubemap but with less resolution of the top and bottom faces.

plane_poles_cubemap_stereo

Update 27.01.2016

I uploaded a stereo (top/bottom) version too. As far as I can tell the filter is just stacking both eyes on top of each other. I had to downscale some of the stereo images because of their file size.

« »

© 2017 Miracula's Blog. Theme by Anders Norén.