View Full Version : Raw samples of Canon XF300 & Sony EX1R
Tans Mark July 20th, 2010, 08:08 AM Dear Alister,
Thank you for the XF305 vs EX1. To be honest this test is confusing for me. The Xf300/305 and EX1 samples I had seen so far (from various sources linked to various thread in this forum) showed that the XF300/305 has sharper and more detailed image.
Your test showed that in most cases the EX1 has sharper / detailed image.
So who is right at the moment ? Until know it was clear that the XF is better, but you showed that EX1 is better.
Alister Chapman July 20th, 2010, 08:40 AM Don't confuse the very fine noise from the XF305 with true picture detail. It took me a while to work out what I was actually seeing, but the extremely fine noise and grain that exists throughout the XF305's footage can give the impression that there is more detail in the 305 footage than there really is, especially when viewed as a frame grab where the noise is static. The grain tends to add a fine texture to everything. In my tests I was looking at the foliage and trees and thinking the XF305 was resolving more detail as the foliage appeared to have more "texture". But closer examination shows that there is no more real detail than from an EX1, what I was interpreting as detail and foliage texture was in fact noise.
I would expect both cameras to have almost exactly the same resolution as both are using 1920x1080 sensors with a good Bi-refringent filter to control aliasing, thus both cameras should resolve almost exactly the same. Looking at the same clips I then looked at the car and brickwork. The car is very revealing as the 305 noise almost adds a texture to the smooth panels which remain clean and smooth on the EX1R. At the same time the registration plate on the car is easier to read in the EX1 shot than the XF305 and the brickwork shows more true subtle detail in the EX footage, some of which is being masked by noise in the 305.
The differences are largely down to noise, noise reduction and differences between the detail correction and sharpening circuits used in the cameras, but the very fine XF305 noise can be somewhat misleading making some parts of the image look more detailed than they really are. You can simulate the effect in Photoshop by taking an image and using the "add noise" filter to add fine noise to an image.
Laurence Janus July 20th, 2010, 09:48 AM Many thanks for the review Mr Chapman, the most informative yet.
I hope you can get your hands on one for longer next time.
Tom Roper July 20th, 2010, 10:11 AM I've used Imatest to measure the resolution of the EX1. It can resolve all the way to the nyquist limit, more than 1000 lines. I was testing at the center, there could be differences at the borders and at different iris openings, but I would expect that any major difference in the sharpness comes down to processing of the detail and noise circuits. If one cam should appear markedly sharper than the other, it probably owes to processing. You should be able to achieve the desired sharpness look without aliasing, up to the limit of 1080i/p format.
Brian Woods July 20th, 2010, 10:11 AM The car is very revealing as the 305 noise almost adds a texture to the smooth panels which remain clean and smooth on the EX1R. At the same time the registration plate on the car is easier to read in the EX1 shot than the XF305 and the brickwork shows more true subtle detail in the EX footage, some of which is being masked by noise in the 305.
The differences are largely down to noise, noise reduction and differences between the detail correction and sharpening circuits used in the cameras, but the very fine XF305 noise can be somewhat misleading making some parts of the image look more detailed than they really are. You can simulate the effect in Photoshop by taking an image and using the "add noise" filter to add fine noise to an image.
Thanks for the side by side tests, Alister. My observations looking at the CP & PP versions:
The car seems to show much more aliasing than in the PP EX1 shot compared to the 305, especially when viewed at 200%. It looks like the PP you use really increases sharpness and adds more aliasing and no more actual detail. The brickwork on the right side of the framegrab, maybe due to the noise in the 305, looks much more even & detailed in the 305 shot. I don't see more true subtle detail in the EX1 shot - in fact, it's quite the opposite. I see a lot of areas where the EX1 smoothed over fine detail and created big blocks of solid brown, whereas on the 305, when viewed at 200%, it looks like I can see the white cement between the bricks without any of the "smoothing" or "blockiness" that the EX1 frame has.
In the default versions, everything is pretty even except a l noise in the sky in the 305 shots, but also more shadow detail (again, in the brickwork & buildings to the right).
The noise of the default grabs is an interesting issue because clearly there is a more of it in the 305 shot, and in framegrabs it doesn't seem ideal. However, in motion this kind of noise would never be a problem - there really isn't that much of it anyway. Taking the sharpness level to -3 seems to mitigate most of. At least here in LA, the first thing every post house does when they get digital footage is add noise to it, anyway - especially Sony XDCAM footage, which can have a "metallic" smooth look to it.
Brian Woods July 20th, 2010, 10:41 AM And before anyone jumps on me about this, here is what I'm looking at (taken from the CP/PP grabs). There is definitely more fine detail in the 305 shot than in the EX1 shot, and it isn't an illusion of noise. Look at the brickwork and you'll see smoothing and blockiness in the EX1 shot. Also pay attention to the white siding at the top compared to the 305.
Just a disclaimer - this is viewing at 200%, and is heavy nit-picking. But if you want to find a difference between the cameras, this is where to look.
Alister Chapman July 20th, 2010, 10:52 AM At least here in LA, the first thing every post house does when they get digital footage is add noise to it, anyway - especially Sony XDCAM footage, which can have a "metallic" smooth look to it.
Really? Why? Noise makes footage harder to grade, eats codec bandwidth, messes up narrow bandwidth television broadcasts and interacts with TV sharpness settings to potentially create a real mess. The very last thing you want to do is add noise. That's a terrible way to treat any material.
Les Wilson July 20th, 2010, 10:55 AM ...Cognitive load is... whatever it is. Once you learn a camera, you can operate it like the back of your hand, and they're all different. I've never picked up a new camera that I didn't have to take some time to learn, and I've never met a camera that was so complex I couldn't chew gum and walk at the same time with it. ...What I like about the Canon is that it does have 13 user-assignable buttons (2 of them on the right index finger above the record button), so if you don't like where something is, put it where you want it. ... Obviously easy access to auto-iris is important to you; for me, I very rarely use it.
As for ergonomics, I guess it all comes down to personal preference anyway.
The XF does have cache recording, although I've not used it yet and can't say how long it's for.
A hard stop iris would be nice, though.
Like any camera, it takes learning and getting to know it, and once you do it competes very favorably against the Sony EX1R (and the vice versa is also true - it ultimately comes down to personal preference & individual need). I would see no challenge for anyone using this camera for weddings, events or news - after all, that's pretty much what it's been designed for.
Simply defined cognitive load is the amount of mental "energy" something takes. Talking on the cell phone while driving is a demonstration of the impact to driving skills caused by the cognitive load of talking on the cell phone... driving skills drop in various amounts for different people and individual circumstances due to cognitive load.
Ergonomics does not come down to personal preferences. There are good and bad ergonomics. Having 13 assignable buttons versus the EX1R's 4 isn't necessarily better ergonomics, it's a functional characteristic (feature). Like function keys on a computer keyboard. They are ergonomically neutral. Like you point out, they CAN be used to improve operational ergonomics. And, the buttons themselves have ergonomic issues such as easiness to locate, tactile feedback, engraving, grouping etc. The membrane buttons on the original EX1 under the handle had poor ergonomics because of the poor tactile feedback of membrane buttons and they were changed to real buttons on the EX1R. Canon has legendary build quality and didn't make that mistake...kudos to Canon.
You can test a camera's operational ergonomics against various populations and evaluate the results to determine which designs are more reliable, faster, easier etc for various operations...whatever is important. Alister looked beyond the imaging block to other characteristics and took a decently broad look at various ergonomic issues beyond marathon holding and zoom mode switching....kudos to Alister.
The auto iris button is a great example of ergonomics. Sony located it in the same place it exists in most professional lenses. This facilitates ease of learning for those used to it there. Having available assignable buttons in another location is flexible but not necessarily better ergonomics. Right away, you have confusability issues finding the correct one (more cognitive load), reliability issues (how many times to people make mistakes, familiarity issues (relearning it after not using the camera for a time) efficiency ... all these things can be tested...again, it's not a question of functional equivalence, some approaches are ergonomically better than others....cognitive load often is a good indicator but not the only one.
The iris ring is another example. They both have them but the EX has stops and Alister felt the XF's was sluggish. These characteristics affect how hard/difficult they are to operate to get the desired results. The harder they are, the more cognitive load they take to operate and the less cognitive abilities you have available for other things (like driving haha). Taking your hand off the zoom ring on the XF to switch modes is another issue. The XF has smooth slow zooms (reliable, easy whatever) the EX1R doesn't (twitchy, stutters at slow speeds etc).
The XF cache record is for 3 seconds. The EX1R's is programable up to 15 seconds. These are functional characteristics. How they are activated is ergonomics.
Ergonomics was a perfectly valid thing for Alister to evaluate and make a conclusion about. It may have no value to you but it's not personal preference.
But I think we're off topic of this thread at this point. There's a thread for likes and dislikes that might be better:
http://www.dvinfo.net/forum/canon-xf-series-hd-camcorders/481991-likes-dislikes-ex-owners-now-have-xf.html
Brian Woods July 20th, 2010, 10:58 AM Really? Why? Noise makes footage harder to grade, eats codec bandwidth, messes up narrow bandwidth television broadcasts and interacts with TV sharpness settings to potentially create a real mess. The very last thing you want to do is add noise. That's a terrible way to treat any material.
It's mostly houses that work on narrative shows with digital aquisition, where they have the budget for that sort of thing. They do it with RED footage, DSLR footage - basically anything that's not 35mm that they want to look more like 35mm
Alister Chapman July 20th, 2010, 11:40 AM Adding noise is strictly taboo in the UK as it messes up the narrow bandwidth transmissions used for Digital TV broadcasts. The broadcasters go to great lengths to filter out any noise prior to compression for broadcast and as a result any noise tends to degrade the overall broadcast image.
Brian, going back to the brickwork, I concur with your observation that the XF305 handles the brickwork better than the EX1R. There is some blocking in the EX footage that is not apparent in the 305 footage around the darker coloured bricks. A lot of the "texture" on the bricks with the 305 footage is noise and varies greatly from frame to frame there is some blocking on the lighter coloured bricks, but not the darker ones with the 305. I'm not sure whether what your seeing on the car is aliasing or a result of the 4:2:0 color sub sampling, possibly it's a bit of both. It's quite interesting to see the subtle differences in the codecs behaving differently with different coloured bricks. It's not really all that surprising that the 35Mb/s codec of the EX1 is not quite doing such a good job as the 50Mb/s of the 305.
The EX1R with NanoFlash at 50Mb/s does not produce any blocking on the brickwork and is also less noisy, at 100Mb/s is really nice, but that's not what we are discussing here.
Brian Woods July 20th, 2010, 12:01 PM I think the UK has much higher & more rigid standards than it's US broadcast counterparts. Honestly, you'd be amazed at what can be considered acceptable for broadcast over here; and sometimes the decisions that are made are obviously counter-intuitive and do lead to problematic broadcasts. Then again, sometimes it works, too - the House episode shot entirely on the 5d mark II was a good case of that. They spent as much on post with that episode as they do with their normal 35mm film post, and were really able to subdue the natural DSLR artifacts (color banding, moire, aliasing, etc) while still giving it a pleasing filmic texture.
Going back to the comparison, I think you're right, the color sampling is probably what's at play when viewed so closely, and I would imagine that at the same sampling rate, the EX would not produce the blocking and would still be less noisy.
David Heath July 20th, 2010, 12:36 PM Adding noise is strictly taboo in the UK as it messes up the narrow bandwidth transmissions used for Digital TV broadcasts. The broadcasters go to great lengths to filter out any noise prior to compression for broadcast .......
Yes, exactly. I suspect in the case Brian talks about, those who wish to add the noise make all their judgements on footage in the edit suite, where the compression is still relatively light.
It's quite conceivable that adding noise may be felt to give a nicer "look" there - then when it looks bad on transmission it's a case of oh well, the standards of those broadcasters are so low..... It's been said many times that it's not sufficient to judge camera pictures in isolation, straight out of the edit suite - it has to be done as part of a chain.
Les Wilson July 22nd, 2010, 01:12 PM I remember noticing how the Sony clips from my TRV-900 lacked the pink of human skin tones when I moved off my Sony TRV-900 to a Canon XL1s but I chalked it up to moving to a better camera. Is this just a PP setting or what?
Ken Hull July 22nd, 2010, 09:45 PM Is it just my imagination, or are these CGI images? They look a lot like a rendering I saw for a Lightwave 3D how-to book a few years ago.
Ken
Cristian Adrian Olariu July 23rd, 2010, 12:59 AM Well, it's just your imagination. These are frames from actual footage recorded on those camcorders.
Alister Chapman July 23rd, 2010, 01:02 AM There is a big difference in the lighting, white balance and exposure between the two shots which doesn't help making an accurate assessment. But Sony cameras do tend to have a lot of yellow in them. At the same time Canon's cameras tend to have a little too much red (giving a pink hue to clouds etc). It's easy enough to adjust these out in the Matrix of either camera however.
Sony have always tried to make all their cameras have similar colorimetry from todays latest cameras to early tube cameras and I think this is where the yellow bias comes from. It may also be a bias that favours Asian skin tones.
When I used to have a Canon H1 I used to run with a CP with some -R in the matrix for a more neutral look. With the EX1R I use various PP's for different jobs, but they almost always start off from something like this:
R-G +6, R-B +10, G-R -6, G-B -8, B-R -15, B-G -10
Peter Moretti July 23rd, 2010, 01:03 AM Well, it's just your imagination. These are frames from actual footage recorded on those camcorders.
Those pictures have zero value. I'm surprised Chris hasn't just removed them.
Andrew Stone July 23rd, 2010, 07:28 PM Haha, those are definately CGI based images. Les, I don't know where you acquired those images but they are certainly not from a video camera. Alister's comments would have been a good analysis if they were in fact real. haha. In point of fact, the CGI photo attributed as the Sony based image has more in common with the idiosyncrasies of Panasonic based output than Sony.
Any discussion on this is completely ridiculous. If it was a Sony camera, as Alister has pointed out obviously it wasn't white balanced. Sony cameras never pushes out this kind of yellow skin on a properly balanced camera or even one that is off and set for daylight but shooting under tungsten. It's just preposterous. haha.
Les Wilson July 23rd, 2010, 09:18 PM The stills I posted are screen grabs from the clips that are the substance of this thread And were posted in the beginning. . I believe they are from the zip files. I'm not saying they aren't CG just saying where I got them from
Peter Moretti July 24th, 2010, 12:46 AM Yes Les, not to shoot the messenger. Thanks for posting the grabs b/c downloading those files can be a PITB.
Alister Chapman July 24th, 2010, 01:21 AM The reason they look odd is that they are I believe mannequins not real models.
Ken Hull July 24th, 2010, 01:30 AM Now that I have downloaded and examined the video file, it is obvious that they are mannequins. No CGI involved.
Ken
Peter Moretti July 24th, 2010, 03:24 AM I realize they are mannequins. I use mannequins sometimes as alternatives for stand-in's. It's not the subjects, it's the conclusions that could be drawn from watching the subjects that would be false.
This side-by-side simply does not accurately reflect the differences in capabilities of both cameras.
|
|