View Full Version : Canon XF100 Tests & Practical Limits


Philip Lipetz
March 4th, 2011, 01:31 PM
Here are a few of my XF100 tests in 1080p24.

XF100, XF105 Practical Review, Shooting Limits on Vimeo

http://www.youtube.com//watch?v=41PVcdkyBFI

It is available for download. No post processing.

My attitude to testing is to forget the charts, forget post processing, just find what are the limits of the camera when I shoot. These are the practical tests I do to find the limits of whatever cam I am using. Not careful tests like Barry Green might make, not attempts at artistry but exercises to know the camera and what how it acts as an extension, or barrier, to what I see.

Like any instrument the XF100 makes beautiful music within limits, BUT THE XF100 FALLS APART RAPIDLY OUTSIDE THOSE LIMITS. There is significant noise above 6dB, and the color balance shifts away from red to green with lower light, and DR + saturation + resolution (!) take significant hits.

Forget the charts and static shots that will look good in low light because they bury these problems, this is a high maintenance cam that begs for light, not run and gun, and rewards you with fabulous color gradients.

There is noise even at lower dB settings. Work within the limits of light and you get a film like experience, the noise actually seems like film grain once you have the more natural color gradients provided by the 4:2:2 color of the XF100, up to twice the color information of normal video cams. Step outside those limits and the noise becomes more than film-like grains, unacceptable.

So, the camera is caught within the narrow boundaries imposed by having a single small 1/3" sensor - and that is a shame because the camera is a delight to use and is worthy of being more broadly useful.

Within the limits you will make great films, but those limits more closely resemble the conditions used by cinema cameras on controlled sets, not the flexible conditions usually encountered when shooting with a small highly portable camera such as the XF100.

HOWEVER, DO NOT FORGET THE GLORIOUS COLOR that this camera can give you with proper light. There is nothing like this at this price range. As Brain C. Weed (Cowpunk42) has pointed out for the XF300, you have to choose between wider operating conditions and the possibility of unprecedented color quality under optimal conditions. The 4:2:2 color flows smoothly and gives a user experience that seems more film like. Nothing in this price range comes close to matching it.

Despite its small size, this is a cinema cam, not a ENG or EFP cam, and certainly not a tourist cam. Like the GL2, also a simultaneously flawed but high quality cam, the XF100 opens the possibility of low cost filming resembling film stock. It will lead to many microbudget films.

The resolution is far far better than any of the dSLRs that are currently the darling of microbudget film making. With a 1/3" sensor it does not have shallow depth of field that is the current rage. But will that rage last? Decades ago there were few shallow DOF shots in big budget films. Today big budget films are reverting to deep, not shallow, DOF shots because 3D filming demands deep DOF. This means that soon shallow DOF will no longer be associated with quality films, and that is when the XF100 and XF105 will shine.

Are they as good as the XF300 and XF305? No, those cams have more color information and it shows. But the XF300 series is exceptional. The real question is the XF100 as sharp as an EX1? Yes, within its shooting limits. But none of this matters unless you can live with those limits.

With the XF series Canon has declared that codecs are the true value in cameras, not sensors. The 4:2:2 codec in the XF series is their statement, and it shows. Subtile color gradients come alive, color banding goes away, with the 4:2:2 codec. Live within the XF100's limits and you can make films that would have required equipment costing more than twice as much. The barrier to quality film making has been lowered with the XF series. THe XF series may enable a quiet revolution that empowers as many filmmakers as the dSLR revolution did.

Charles W. Hull
March 4th, 2011, 11:10 PM
Very good testing Philip - indeed this is better than charts and numbers. You do a very nice job of showing what the camera can and can't do well. This will be a fantastic cinema cam. You give up too easily on ENG and run and gun; in the right hands it will be a good tool because of its small size and the codec.

Noa Put
March 5th, 2011, 04:49 AM
It looks to me that low light is the achilles heel of this camera, that +12db looked awefull. that very fine grain is visible in many shots, even that 3db sharpness closeup shows visible grain.

Pat Reddy
March 5th, 2011, 09:16 AM
Thanks for the test Philip. In good light the image is indeed breathtaking. Do you have a sense for how this camera compares with the XH-A1 in terms of noise in poor lighting?

Pat

Jim Martin
March 5th, 2011, 12:35 PM
Phil-
Could you be more specif.....just kidding. Thanks for the great post!

Jim Martin
FilmTools.com

Philip Lipetz
March 5th, 2011, 03:06 PM
Is the XF100 better than the JVC HM100, or the Panasonic HMC150? Yes. Does it have unprecedented ability for custom settings for nearly every aspect of recording? Yes.

This was not a negative review, GLORIOUS COLOR, but rather statement of it's optimal operating conditions where it is a class leader. And that range is greater than the other baby pro cams, so i am comparing it to cams that cost twice as much. To even consider such a comparison says a lot about the XF100

Philip Lipetz
March 5th, 2011, 03:13 PM
Phil-
Could you be more specif.....just kidding. Thanks for the great post!

Jim Martin
FilmTools.com

Jim got this camera into the hands of our team. It might be the first consumer delivery in America, or close to it. He was great to work with, not a salesman but a person who understands filmmaking. Highly recommended.

The XF series, both XF305 and XF105, are getting some amazing placements within the broadcast industry, and I would not be surprised to find that Jim is a major force behind this uptake.

Philip Lipetz
March 5th, 2011, 03:15 PM
Thanks for the test Philip. In good light the image is indeed breathtaking. Do you have a sense for how this camera compares with the XH-A1 in terms of noise in poor lighting?

Pat

Have not shot with that camera but would be shocked if the XF is not better.

Philip Lipetz
March 5th, 2011, 03:21 PM
Very good testing Philip - indeed this is better than charts and numbers. You do a very nice job of showing what the camera can and can't do well. This will be a fantastic cinema cam. You give up too easily on ENG and run and gun; in the right hands it will be a good tool because of its small size and the codec.

Many people have told me this. Perhaps they are right. To me an ENG cam should have at least 18x zoom, and perhaps better low light. There are rumors that international new organization has bought a few hundred JVC HM100s, and the XF is definitely a better camera, if that is an ENG camera then this also is.

Rob Katz
March 5th, 2011, 04:36 PM
philip-

thank you for taking the time to share your thoughts and efforts.

be well

rob

Noa Put
March 5th, 2011, 04:45 PM
Have not shot with that camera but would be shocked if the XF is not better.

Hopefully someone out there could present a side by side with a xh-a1 comparison in low light, the xh-a1 produces quite some grain at +12db but from what I can judge in your video 12db with the xf100 looks quite ugly as well. It looks like it's even worse then on a xh-a1. We"ll just have to wait and see.

Andy Solaini
March 5th, 2011, 07:16 PM
Interesting video Philip. Your observations seem justified but is there a video camera in the same price range that doesn't have these issues? Or is it just not possible to get all these things in a small sub-£3000 camera?
I'm not saying at all that you are wrong I'm just trying to gauge where the XF100 sits in regards to the nearest competitors.

Andy S

Philip Lipetz
March 5th, 2011, 11:43 PM
Without direct tests done simultaneously I can only guess. I believe that at it's best the XF100 is astounding, and is better than cams in class above this. Certainly better than cams in this class. The price you pay is that in marginal conditions it is marginal.

I am experimenting with a custom setting that appears, looking at the viewfinder, to cut down noise. Now I need to shoot with it.

Also, I did a short shoot at 6dB under harsh florescent lights. Will do a simple correction and post it. I have done Panasonic GH1 videos in the same room, so would love to compare them. I thnk I might be surprised. Hope so!

Charles W. Hull
March 6th, 2011, 12:42 AM
I am experimenting with a custom setting that appears, looking at the viewfinder, to cut down noise. Now I need to shoot with it.

I'm interested to see what you find.

I did some shots with various gain settings this evening in poor light. The best was to just leave the gain at zero, to underexpose, and to bring up the gain in post. The noise is much less than increasing camera gain and the color is much better. I don't know if this makes any sense, I will try to do some more controlled testing.

I used two different methods in post to up the gain. The gain control in FirstLight, and Levels in PP5. They both gave about the same result.

Andy Wilkinson
March 6th, 2011, 05:02 AM
This is great input Philip. Thanks for sharing and I look forward to seeing more when you have the time.

Philip Lipetz
March 6th, 2011, 08:24 AM
I will be slightly delayed in posting new material, took my mother to hospital. First, will be shoot at the low light limits, then audio and new settings tests.

Geoff Tompkinson
March 8th, 2011, 10:32 AM
Hi Philip,

Could you post some real world tests on how good the OIS is on this camera. And how much cmos Jello effect is produced when moving the camera. This is a major problem with dslrs like the 5dmk2 and is supposed to have been much improved in this camera.

I am hoping to use the camera for a lot of pov style shooting from cars and aircraft and need to know if this is going to be a big problem.

Thanks,

Geoff

Charles W. Hull
March 8th, 2011, 02:29 PM
Hi Philip,

Could you post some real world tests on how good the OIS is on this camera. And how much cmos Jello effect is produced when moving the camera. This is a major problem with dslrs like the 5dmk2 and is supposed to have been much improved in this camera.

I am hoping to use the camera for a lot of pov style shooting from cars and aircraft and need to know if this is going to be a big problem.

Thanks,

Geoff
Geoff, I measured rolling shutter with Gunnar Thalin's method and got 31%. This is pretty low for a CMOS camera, obviously much lower than a 5DMk2. I also shoot from aircraft and expect the XF100 will do a good job, but I have not had a chance to try it from the air yet. In just trying some shots with the camera moving around, there is a little jello but it corrects nicely with deshaker set at 31%. My experience is that it should tolerate some mild turbulence with that correction. Chuck

Stephen Boss
March 9th, 2011, 12:26 AM
Thanks Philip, I was waiting for someone to finally put up a test like this. Unfortunately, this cams performance appears to be a bit less than what I had hoped. I still think the infared mode is cool though... if only I had stuff to shoot in infared.

Erik Norgaard
March 9th, 2011, 10:54 AM
Hi Philip:

Nice systematic testing. I noted too when I was on the street significant noice towards the useless with 12dB gain. Possibly usable footage w. 6dB gain. However, on Gran Via, the main street of Madrid, I shot with 0dB gain at night. I guess cars and street lights all add up to a good lighting.

I don't know if this is a fair test, I suppose most cameras will have this issue, anyway, autofocus wobbling:

XF100 Autofocus wobbling (http://player.vimeo.com/video/20835052)

Erik

Lou Bruno
March 9th, 2011, 11:45 AM
Take the IAF off and do a re-test. You should see a difference in focus searching.

Geoff Tompkinson
March 13th, 2011, 09:16 AM
Geoff, I measured rolling shutter with Gunnar Thalin's method and got 31%. This is pretty low for a CMOS camera, obviously much lower than a 5DMk2. I also shoot from aircraft and expect the XF100 will do a good job, but I have not had a chance to try it from the air yet. In just trying some shots with the camera moving around, there is a little jello but it corrects nicely with deshaker set at 31%. My experience is that it should tolerate some mild turbulence with that correction. Chuck

Thanks for getting back to me on this Charles. I work in after effects and am not familiar with Gunnar Thalin's method. As a comparison what does the 5Dmk2 rate on this scale?

Could you post some footage from the XF100 with the camera moving around so I can try to stabilize with Prodad Mercali in AE ?

It seems almost impossible at the moment to get any sample footage from this camera.

Thanks

Geoff

Charles W. Hull
March 13th, 2011, 05:15 PM
Thanks for getting back to me on this Charles. I work in after effects and am not familiar with Gunnar Thalin's method. As a comparison what does the 5Dmk2 rate on this scale?

Could you post some footage from the XF100 with the camera moving around so I can try to stabilize with Prodad Mercali in AE ?


Geoff, there is a very capable rolling shutter plug-in for After Effects, it is Rollingshutter, see www.thefoundry.co.UK/products/Rollingshutter . It sells for around £300. Prodad Mercali cannot handle rolling shutter issues.

The 5Dmk2 has a rolling shutter of around 70-75% on the scale I mentioned, so it is much worse than the XF100. Whenever you have any pointing shake with the 5D you are in trouble. There is a program that runs on virtualdub that does a truly amazing job with this problem, it's called Deshaker, and Thalin is the author. Check his write up and instructions at www.guthspot.se/video/Deshaker.htm. Both virtualdub and Deshaker are freeware.

Deshaker has the other unique characteristic that it can stabilize without changing the video size - there is no magnification or loss of resolution. This is done by borrowing from the previous and following frames. So it is a fascinating program for pov shooters.

I'm traveling - when I get back I'll try to post an example. (edit -those links were hand entered on an iPad so you may need to Google to find Rollingshutter and Deshaker)

Erik Norgaard
March 15th, 2011, 03:15 PM
I don't know if this is a fair test, I suppose most cameras will have this issue, anyway, autofocus wobbling:

XF100 Autofocus wobbling (http://player.vimeo.com/video/20835052)


Take the IAF off and do a re-test. You should see a difference in focus searching.

I've done some more testing on this and it is most definitely a low light issue. It happens with all three auto-focus speeds, I.AF, M.AF and AF. It's not related to aperture and it's not related to gain.

I did a test of all AF speeds with F 4.8, F4.0 and F3.2. When the wobbling effect happened it happened for all AF speeds. In this case, at F3.2 it disappeared. So to test that it was not related to aperture I used an ND4 filter and the wobbling came back. I also tried different gain settings, same thing.

Now, I don't find the video I posted particularly low lit, but the lesson is that if you want to use AF you need lots of light.

BR, Erik

Lou Bruno
March 15th, 2011, 06:46 PM
This issue has been around for some time as it relates to auto-focus and lowlit situations. This has occurred in my XL-2 and both of my XH HD cameras. I just tested the XF-300 and YES...it is a focus hunting issue. As I mentioned, when the IAF is set to OFF, there is somewhat less hunting. I have also observed this in some earlier JVC SD cameras, namely the 5100 camera. I will test the XF-100 as well.

Erik Norgaard
March 16th, 2011, 01:55 AM
Now, I don't find the video I posted particularly low lit, but the lesson is that if you want to use AF you need lots of light.

I'll admit though that the oranges lack clear contrast lines, though the green/orange should do - maybe the AF works on a luminance/BW, and the green/orange does not produce enough contrast in BW?? So, maybe this issue appears in any low contrast situation, be it high key or low key. I guess I need to do more testing.

BR, Erik

Philip Lipetz
March 16th, 2011, 05:28 AM
Today the. 6dB low light video goes up. One reason that it took so long was I used AF and there was subtle focus shifting at low light, rounds shots. Really subtle, not easily visible in small edit window but clear in full screen. Seems that it happens most with horizontal pans, not vertical. Was in instant AF mode. Will have to redo with instant off.

Deborah Gallegos
March 17th, 2011, 06:27 AM
... I used AF and there was subtle focus shifting at low light, rounds shots. Really subtle, not easily visible in small edit window but clear in full screen.
...
Was in instant AF mode. Will have to redo with instant off.

Saw your latest Vimeo test, Philip...great stuff!

Sooo... do you recommend AF at all in low light or does it have to be MF? I understand you all are saying IAF does NOT do well in low light.

Thanks!
Deborah