View Full Version : 360 VR for Most of Us


Pages : 1 [2]

Mark Rosenzweig
May 6th, 2016, 08:32 PM
As far as the viewing issue, I have figured some things out that maybe helpful in regards to viewing issues on an iPhone. I recently purchased an sp360 4K, and can see this issue being a confusing problem for some customers.

I was on your YT link, not the Vimeo. When I click on the red arrow play button inside the video, that is when the video opens and just starts playing flat.

So I clicked on the curved arrow in upper right, and it shows some choices. Clicking on the three dots opens a window asking if to open the vid in YT app. Perfect playback.

I also happened to click on the title above the video window (YouTube (Short URL). Same as above, opens a small window asking if to open in YT app. Plays fine.

So your vid is fine, just a little hassle to auto play on iPhone I guess. I wonder what the difference in the code is between these three choices. And if there is a way to force the YT app to open rather than going through the extra steps. Massive confusion to viewers on iPhone if not, unlike the non-issue of your android (don't have one to test).

Thanks for the info. The usual war between Google and Apple?

And, there is a firmware update from April 28.

Mark Rosenzweig
May 7th, 2016, 10:12 AM
There are no problems stitching with little artifacting close subjects using the dual Kodak 360 4K kit and the stitching software. However,

with the Kodak Stitching Software you have a lot of controls over the stitch, but you cannot stitch different parts of the scene differently. Parallax means that very close subjects cannot stitch the same way far subjects do - this is the issue with close subjects. So, when you get the close subject to stitch correctly, the far one is not. If no subjects get very close this is not an issue.

This short video illustrates the issue: the first part stitches based on the very close subject; the second on the far subject. The guy up close is right at the stitch line (90 degrees to the two cameras and smack in the middle - the worst case).

Kodak 360 4K Test Video: Stitching Issues When There are Close and Far Subjects on Vimeo

This is just the Vimeo version (choose 4K), which makes it easy to see (no need to rotate around).

Sophisticated stitching programs may be able to correct both the far and near subjects simultaneously - this video shows all the information is there to do so because of the large overlap between the two lenses.

Seth Bloombaum
May 7th, 2016, 10:28 AM
The Campus Tour 360 Video has two close encounters that enable judging how close subjects can get. In both cases the subjects get very close (less than 2-3 feet) right at the stitching area.

At 5:38 in a man walks quickly right by the rig; he passes less than 2-3 feet from the camera at the part where stitching must take place. You can see what happens; there is only a very slight, brief artifact. You have to make sure you are looking at the right part of the scene (he comes from behind the camera and walks by to the camera's left).

At 9:45 a group of men come within 2 feet of the cameras and stop and stare and then go on, again at a stitching point. They come from behind the camera and to the left. There is no artifacting at all.
I'm seeing some stitching errors.

In the first scene, pan left of the topiary "125" in the flowers, tilt down and look at the sidewalk. There are some lines that don't meet. This is a typical stitching error in panorama work.

In the third scene, at 5:38 there's a tiny bit of error at his feet at his closest approach.

The fourth scene, where the camera is placed in a sort of rosette pattern in the sidewalk, the stitching software appears to have been confused by the pattern. At 6:20, 7:05, and 9:45 there is significant ghosting of passers-by. These kinds of errors are also common in panorama stitching, but these are pronounced.

What's confusing about this is that the error at 5:38 is tiny, almost imperceptible, but at 6:20 it is dramatic, at a further distance. So, apparently, there is significant potential for stitching errors out of the Kodak software (scene 4), but, the stitch can also be almost perfect in another scene (scene 3).

Do you have tools in the Kodak software to correct stitching errors, or is it a simplified interface with few or no controls? Can the corrections of one stitch be applied to another?

For all my detailed nit-picking, I have to say I'm extremely impressed with what you're doing with this camera array and software. In shooting and post of still panos I have had to invest so much learning time, experimenting with multiple solutions both in shooting and stitching, to produce panos without stitching/parallax errors. And that's just a single frame at a time...

Hmm. Which may point to the possibility of batching video frames through a "stills" stitcher like PTGui, or the video stitcher from Autopano, which both have full sets of controls... I wonder if the Kodak software can do better... Or if PTGui or Autopano can do better with the Kodak camera files.

Seth Bloombaum
May 7th, 2016, 10:49 AM
Thanks for posting this - I was working on the YT file when you put up this test.
...with the Kodak Stitching Software you have a lot of controls over the stitch, but you cannot stitch different parts of the scene differently. Parallax means that very close subjects cannot stitch the same way far subjects do - this is the issue with close subjects. So, when you get the close subject to stitch correctly, the far one is not. If no subjects get very close this is not an issue.

...Sophisticated stitching programs may be able to correct both the far and near subjects simultaneously - this video shows all the information is there to do so because of the large overlap between the two lenses.
That test clarifies things quite a bit.

To my understanding, there is no stitching method that will correct the parallax "ghosting" seen in this test. I could imagine, merging two different stitches using traveling matte composite methods in AE or something.

Having near and far subjects in a scene is quite important in panorama work, IMO. However, there is no single-camera video method that eliminates parallax error in shooting, as we can do in stills.

Note that the Ricoh Theta S, on the same principle as the Kodak rig, has smaller parallax error, but at a mostly unacceptable cost of image quality. As small sensors and ultra fish-eye lenses (wider than 180-deg) improve a smaller camera like the Theta may catch up to the current Kodak 360 image quality.

My sense is that one must shoot around the parallax limitations of the Kodak array. Near and far may be an important composition concept, but, at the seam areas, one or the other must be low-detail. If a person is close and in the seam area, the background content must have low detail to avoid showing stitching errors.

That fourth scene in the YT clip, which you extracted for the short Vimeo stitching test, shows the worst situation possible. Action at the seam. Near is quite near. The need for detail in the middle ground. The quite demanding pattern in the concrete, extending from near to far.

I say shoot around these challenges!

And, it will be worse with a GoPro array, because the NPP / "nodal" points will be significantly further away, meaning significantly more parallax in the shots.

Noa Put
May 8th, 2016, 03:29 PM
Now THIS looks fun:

https://youtu.be/0wC3x_bnnps

Mark Rosenzweig
May 8th, 2016, 05:54 PM
[QUOTE=Noa Put;1914146]Now THIS looks fun:

Yes, that was fun, and even amazing. But if one needs $500,000 to make good use of 360 VR (and I am confident this spectacle cost something like that (the choreographer's fee alone may be that)), it kind of makes the point of what's the use of 360 VR for "most of us". Also I am still unconvinced that the six GoPro cameras improves quality over the two Kodaks, for this same rarified use.

I think this is a more useful, and interesting, example of a real world 360 video, which is also technically not bad either (this is not put here to make a political statement - the point is this transports one effectively to areas one has interest in seeing) :

https://youtu.be/ecavbpCuvkI

Seth Bloombaum
May 8th, 2016, 06:16 PM
I think this is a more useful, and interesting, example of a real world 360 video, which is also technically not bad either (this is not put here to make a political statement - the point is this transports one effectively to areas one has interest in seeing) :
This is the best storytelling I've seen in VR video - thanks for sharing it!

The environments of these children are so important to their stories, the immersive look at environments is very engaging.

Dan Brockett
May 8th, 2016, 08:12 PM
Honestly, that Go Pro video suffers BECAUSE of the VR IMHO, the VR doesn't enhance the experience much. It would be much more impressive in a traditional flat, well shot and edited piece that showcased the jumpers and stunts, mostly from a third person POV, not as a first person view from the person doing the jumps, although that is a good cutaway for a few seconds. But there is little feel of the grandiosity of the setting or stunts. And the YouTube terrible and glitchy compression detracts. I have a pretty healthy connection and it was still trailing picture to sound and then would catch up, reminds me of trying to stream video in 2002. It was possible but pretty challenging.

The NY Times piece works better although it still doesn't compel me to watch more than the :30 of the VR experience. To me, both of these pieces still seem like a solution in search of a storytelling challenge. I am sure that others mileage will vary. Still looking for that elusive "must see" VR piece. The best I have seen so far is the Google Stories piece "Help". Through the Google Spotlight Stories app, it looks amazing, even on my small iPhone 5S screen. The motion is crystal clear and fluid and it uses the iPhones accelerometer and compass really well to track the action. If we could get that same quality level experience on streaming, then I think VR would be more successful.

Noa Put
May 9th, 2016, 12:01 AM
Well, the snow stunt video is much fun to watch for a little while but gets boring very quickly, I just also watched "the displaced" and while you can consider this as a professional attempt at 360vr I much prefer a normal shot documentary, I also didn't watch it completely and just browsed through the video for an impression of the VR, not for the story they where trying to tell while I probably would have watched it completely if shot with regular videocamera's and would have gotten a better understanding of their message. VR will remain just a novelty for me that sometimes is fun to watch but looses my attention real quick.

Noa Put
May 9th, 2016, 04:12 AM
Here is another one where I find 360vr has a purpose

https://youtu.be/TCXp9Y5uPn4

Mark Rosenzweig
May 9th, 2016, 03:59 PM
Philip Bloom has just started playing with the dual Kodaks. Here is his first attempt:

https://youtu.be/CsxWPgdzLrQ

He stitched in the Kodak program and then upscaled to 8K before uploading to YouTube to minimize compression by YouTube. He says to watch in 4K (not 8K).

Maybe he will come up with a novel use (this is not it).

Mark Rosenzweig
May 15th, 2016, 07:46 PM
Stanford Dish Hike in 360 on a Cloudy Day.

Flat file (view in 4K):

Kodak 360 4K 360 4K Video: The Stanford Dish Hike in 360 on a Cloudy Day on Vimeo

360 VR version (view in 4K):

https://youtu.be/N6d6fZhFwHs

Mark Rosenzweig
May 29th, 2016, 07:26 PM
Beach in 360:

Vimeo flat file:

Kodak 360 4K Video: West Haven Beach in 360 (Flat File) on Vimeo

Select 4K.

YouTube for panorama viewing or VR 360:

https://youtu.be/W0L7C2bq7WM

Select 4K.

Mark Rosenzweig
June 3rd, 2016, 11:31 AM
From a high urban butte.

Vimeo flat file:

Kodak 360 4K Video: East Rock in 360 (Flat File) on Vimeo

Select 4K.

YouTube for 360 panorama viewing:

https://youtu.be/_jvF3mj79Dc

Select 4K.

Marty Hudzik
June 8th, 2016, 09:11 AM
Great thread. Learning a lot about something I really personally don't care for but I am being forced to learn due to company wanting to add this to our list of services. This whole concept flies in the face of everything that I have spent years learning about composition and lighting and creating a feel based on camera angle and composition. Not to mention that I am used to having tons of lighting and grip equipment just off camera that is now just about impossible! Feels like the art portion is going away. I hope not. Anyway....on to my questions.

Started dabbling with a Ricoh Theta which is seriously consumer level but got our feet wet. Was easy to use at was a single camera solution with 2 lenses on opposite sides and created a 1080P video with essentially 2 spherical images, one on each half of the frame. Was super easy and created well stitched videos.....but at extremely low resolution.

We recently moved up to the Kodak SP360 4k dual kit and while the increase in resolution is quite noticeable, it still seems a little soft. Also....the issue with distance parallax is bugging me. If the distant objects are aligned then people or closer object near the stitching point are either doubled or disappear in the seam itself. I do not remember seeing this issue with the Ricoh theta. It is bothering me to no end.

Is this normal with most 360 VR??? Or is it specific to the Kodak 360 only? I see the same thing in several of the Kodak samples posted here so I don't think it's just my specific unit.

Any input??? Thanks. Hoping to make regular contributions and ask a ton of questions as I get these projects rolling.

Thanks again.

Mark Rosenzweig
June 8th, 2016, 10:54 AM
It's the standard parallax problem with two lenses that are separated. All the multi lens cameras/rigs have this issue. Here is a demonstration:
Kodak 360 4K Test Video: Stitching Issues When There are Close and Far Subjects on Vimeo
This is the flat file version. First stitching is to have the *very* close guy intact, but the far guy is split. The next stitches so the far guy is intact. Same exact clip. The lesson: keep your subjects at least 3 feet from the camera.

Marty Hudzik
June 8th, 2016, 11:18 AM
I am experiencing this with subjects more than 3 ft away. I caught myself walking out of the shot and there was essentially 2 versions of me that merged at about 12-15 ft away finally. I'll have to do some more testing. I could eliminate some of this by calibrating the stitching in the Kodak software but it made the further horizon objects double. Also.....as people moved closer and further they would split and rejoin. On the seams only of course.

3 ft limit I can handle. 10-15 ft is going to be tougher to keep people out of for corporate shots where we want to see people moving around and working in the VR environment.

Thanks,

Seth Bloombaum
June 8th, 2016, 12:40 PM
As you've noticed when comparing the Ricoh Theta to the Kodak SP360 footage, this will vary between cameras, or should I say, between camera rigs.

First, both rigs have some parallax error that can't be corrected with conventional stitching, and correction using traveling mattes in After Effects or something would be cost/time prohibitive in most cases.

That the Theta is better on this than the SP360 has entirely to do with the distance between the so-call No Parallax Point (NPP) aka. Entrance Pupil of the two lenses. The Theta is such a tiny thing, the NPPs can't be spaced more than about .75" / 2cm. The SP360's NPP distance looks to be a little over 3" / 7.5cm (I don't have one of those in front of me to measure).

If you want perfect stitches for near and far subjects in the same shot, the distance between the two NPPs must be 0. This is achievable in still spherical photography with multiple exposures, rotating the camera about the lens's NPP. So far as I know, there is no current video camera technology... well, almost none, because if you're willing to sacrifice some image height, (your sphere has no image info looking up and down, it's less than 180-deg high), there is some mirror lens tech that will give you a seamless 360 around. (https://www.0-360.com/)

A GoPro camera array will be even worse than the SP360, due to the greater distance between NPPs, and many more seams that show the parallax error.

What to do?

Choose near or far and stitch for it. Compose to that limitation.

Set up so that there is no meaningful near/far content in the seam area. Compose to that limitation.

Explore creating multiple stitches, and painfully merging them together in After Effects, with lots of rotoscoping. (I can't imagine doing this, myself)

I'm saying shoot around the limitation, until someone comes out with new technology.

It's kinda' tough to depend on new tech in this case, though, because although spherical video is young, spherical stills have been with us for 15 years or more, and nobody has come up with a single-shot solution, other than the 0-360 lens and the Ricoh Theta approaches.