View Full Version : abrupt highlights clipping


Pages : 1 2 3 4 5 [6] 7

Leonard Levy
March 4th, 2008, 10:45 AM
Piotr,
I tried to emulate the shot you took with the trees at the beginning of this thread and wasn't able to do it but I will try again when the sky is different if it still seems to be a problem.

I was quite concerned about it and do agree that the effect you showed was unacceptable, not normal in a professional video camera.

I confess I got lost in this thread and stopped following it as most of the responses that got into discussing histograms ( a complete waste of time IMHO) post processing, and correcting with lighting or exposure have seemed pretty irrelevant . Also I'm confused by the frame grabs you posted just above of the house and trees. Both of those looked fine to me though maybe I didn't look hard enough. Are those supposed to display the effect you're describing ?

At any rate, you might try just setting a manual knee at around 93 - 95 and see if that helps. I'll check where I put my slope as that might be relevant but i think the default was probably OK.

The auto knee on this camera is overly aggressive and when activated above 100% will suddenly start compressing things that are below 100%. This is not good. Most good video techs will tell you they hate auto knees in general and I know I have seen auto knees out of the shop from Sony on expensive professional cameras that are set way way off.

Adam Wilt told me the other day that he has detected a flaw in the knee (not just the auto knee) on the EX. If I heard him correctly, he said that when an image has high saturation the knee acts strangely and begins working on the highlights then as they get brighter it abruptly stops working and the level jumps up. I don't know if this might be connected to what you observed, but who knows.

For my own part can you simply repeat when this occurs - i.e what gammas, knees, what zebra points, etc. and also confirm for me that you haven't done any post processing at all to the original images. I'm sorry if this is already stated in this thread but it is very long and I seem to remember that maybe you retested a few times.

Lenny Levy

Piotr Wozniacki
March 4th, 2008, 11:07 AM
Thanks Lenny for re-joining in.

You're right that the discussion has drifted away from the main subject; and no - my last two grabs are NOT showing the abrupt clipping (they've been posted to show how - with Auto Iris ON - the bandwidth may be wasted in the highlights when Cine gamma is used, and how much more punchy the STD1 gamma is).

It's a pity you stopped participating in the discussion, as - at some point - I felt a bit isolated in my opinion about the abrupt clipping (as shown at this thread beginning) being unacceptable. Some users kept telling me it's absolutely normal, yet nobody posted his own example of it! Now you're telling me you can't reproduce it - strange...

Your idea of asking Adam Wilt to express his opinion crossed my mind earlier, but I have no idea how to contact him - can you share a contact you have (you can e-mail me if you prefer). Cheers

Piotr

PS. Lenny, with my camera it's absolutely simple and easy to reproduce the problem; in fact it's enough to leave the camera with auto iris on - sooner or later, with some trees against the sky, it will appear (more often with STD gamma, and Knee auto; I can "stretch" highlights past it into complete blown-up area by deliberately overexposing, or underexpose a little to be at the safe side. With Cine gammas, I'm on the safe side most of the time - but it can happen as well).

Leonard Levy
March 4th, 2008, 12:22 PM
it's absolutely simple and easy to reproduce the problem; in fact it's enough to leave the camera with auto iris on - sooner or later, with some trees against the sky, it will appear

If you can be a bit more specific it would help me try to reproduce it.
Is this against blue sky only? against blue mixed with clouds , completely cloudy as well, etc.?

Does the zoom length matter? Where on the IRE or zebra settings does this occur?
Does the gamma or knee setting matter once you are up into the zebra areas?
I don't care what happens on auto exposurethat just muddies up understanding it for me. Just want to know if the knee or cine gammas make a difference when you are in the slightly overexposed areas where this occurs.

Lenny

Piotr Wozniacki
March 4th, 2008, 01:07 PM
If you can be a bit more specific it would help me try to reproduce it.
Is this against blue sky only? against blue mixed with clouds , completely cloudy as well, etc.?

Doesn't matter whether the sky is half-clear or cloudy - it is always bluish cast around the tree branches. In fact, it DOES NOT happen when the sky is deep blue, as this is safely below 100 IRE.

Does the zoom length matter?

Usually happens at full wide, but I can't see direct relation to zoom position - apart from the fact that when I'm zoomed in, I'm more likely to notice it in the LCD and adjust exposure to avoid it


Where on the IRE or zebra settings does this occur?

Just below 100%


Does the gamma or knee setting matter once you are up into the zebra areas?

No. Whatever gamma, knee, slope, matrix etc. it CAN happen; but obviously as I said earlier it's easier to be avoided with "safe" gammas like the Cine2, or with Knee set lower than default on STD gammas, etc.

Leonard, I have e-mailed Adam Wilt with a kind request for his opinion; I attached an example grab and the link to this thread. However, if you are in touch with Adam, please ask him to take a look at it.

Piotr Wozniacki
March 4th, 2008, 03:27 PM
OK - so I've just got a response from Adam Wilt. While I don't feel authorized to quote it here (seems like Adam is still looking into the problem, and will have more to say about it soon), I'd just like some of you guys to know that I'm not being paranoid about it; Adam confirms that the "abrupt clipping" - while present on all EX1's he's seen - just doesn't happen on other cameras.

Which is exacly what I've been saying. Now, let's wait for what Adam is going to tell us about it; in the meantime I've learned how to avoid it when possible, or live with it when necessary. Let's hope the future firmware will address it.

Leonard, I'd like to thank you for backing me up and encouraging to contact Adam, rather than accept what others were saying about this flaw being "a normal thing"...

Steven Thomas
March 4th, 2008, 05:06 PM
Piotr, you brought this thread full circle. It was already brought up earlier in this thread that Adam saw that saturated highlights show more hue shift and harsh clipping than he'd like. Adam also mentioned he would explore it more later.
Piotr, I don't believe no one disagrees that it can look bad when it clips.
I believe most do not care since they are not having an issue. If it clips, we back off.


Here again is what Adam Wilt wrote in his review:

"I’ve found that the EX1’s knee does a fine job except when highlights are strongly colored. Saturated highlights show more hue shift and harsh clipping than I’d like. I’m exploring this further out of curiosity, but even if the knees were perfect I would still shoot with cine gammas, because I prefer the progressive compression to the look of a traditional knee"

Tom Roper
March 4th, 2008, 09:53 PM
Piotr,

You mention that the phenomenon is observable when auto-iris is on. Can it occur if you used auto-shutter, or just auto iris? In other words, is the effect related to highlight clipping at the upper end of exposure, or possibly diffraction, which could happen with a small aperture but would not happen from a fast shutter?

I hope my question is not confusing. One thing I'd like to understand, is if the problem could be avoided by using a fixed aperture with shutter priority, instead of the other way around.

Piotr Wozniacki
March 5th, 2008, 02:51 AM
Piotr,

You mention that the phenomenon is observable when auto-iris is on. Can it occur if you used auto-shutter, or just auto iris? In other words, is the effect related to highlight clipping at the upper end of exposure, or possibly diffraction, which could happen with a small aperture but would not happen from a fast shutter?

I hope my question is not confusing. One thing I'd like to understand, is if the problem could be avoided by using a fixed aperture with shutter priority, instead of the other way around.

No Tom - it's no connected with aperture values (and possible diffraction). It can occur with any aperture, as long as you don't move away from the exposure range that it's occuring in - by either slightly opening aperture (to blow out completely), or closing it (to stop clipping completely). And of course, you can achieve the same with shutter speed, if keeping constant aperture is yur priority (though you cannot be as precise as with the iris ring).

PS. Since this thread has drifted off its main subject, here is a grab to remind what we're talking about. And what Adam wrote to me when he saw this picture (I've just got his permission to publish, so that more users can benefit):

Hi Piotr,

What you are seeing is normal for STD gammas on the EX1, and it is
exactly the thing I found peculiar. You are right in observing that
it doesn't happen on other cameras, but it is there on all EX1s I've
seen.

I hope to have more to say about it soon, but for now, my advice is
not to trust the STD knees to protect or roll off your highlights
smoothly. Instead, use CINE gammas where important parts of the scene
are bright, like the sky in your image, and switch to STD gammas only
when you have control of the lighting, as in indoor interviews, or
when you do not care if the highlights blow out sharply.

CINE4 is very close in linear scene response (before the knee or the
curve) to STD3, so you might set up two Picture Presets, one on STD3
and one on CINE4 but with all other parameters the same. Switch
between them, using CINE4 for contrasty exteriors and long shots, and
STD3 for close-ups of bright faces where CINE4's desaturation is less
pleasing.

Cheers,
Adam Wilt

Tom Roper
March 5th, 2008, 08:36 AM
... here is a grab to remind what we're talking about.

I remember. I've read closely since day one. Thank you for diligently maintaining these observations. And now you have Adam Wilt on board.

But as for the photo, the shift to cyan behind the branches seems like it's cast over other parts of the image as well.

Although confirmed it's not normal behavior with other cams, somewhere else I've seen it before. I think my original JVC GR-HD1 may have had this tendency.

Anyway...you're on the right track.

Regards,
Tom

Piotr Wozniacki
March 5th, 2008, 09:15 AM
Tom,

You're right about the cast. To prove it doesn't matter, I have posted above another grab with totally different colours (more red than cyan), and with the sky area only in one corner (as opposite to the previous ones where the sky dominated the scene). Still the same behind the trees...

I am totally aware the white balance (or colour matrix) is not neutral in either of the grabs, but - being opposite to each other - it shows my point that you cannot avoid the abrupt clipping with bluish patches (unless carefully watching and adjusting your exposure just for that, which is not practical).

And one more thing that needs stressing: this phenomenon - while easily explainable using laws of physics - is in fact very annoying and ugly. In other cameras it's handled in a fashion more pleasing to the eye. Why it is different on the EX1 beats me; unfortunately - while a bit safer like Adam says - the Cine gammas do NOT completely get rid of it at all. In fact, I just did some more tests with the safest one, the Cine2 (said in the manual to safely compress the highlights) - and while indeed the picture never even touches 100 (the zebra at 100 never shows up), the trees against the overcast, grey sky still create the artefacts around them.

I'd like to kindly ask knowledgeable people like Bob, Bill or Alexander to stop preaching that this is normal, and instead post their own examples of the phenomenon. I can't understand how people can leave with this - the clipping algorithm implemented in the EX1 is flawed IMO. It just seems unable to clip precisely around the very edges of darker (unclipped) objects, which are instead surrounded by ugly patches of unclipped sky... If this is how "broad dynamic range" is supposed to manifest itself, than no thanks - I prefer narrower range as in the V1E, or any other prosumer camera for that matter.

Yes I know the EX1 is capable of producing stunning pictures - I have shot lots of them as well, but only in very favourable or controlled lighting conditions (outdoors, with foreground lit generously against dark blue sky, or the opposite extremum: indoors, with low but controlled lightning). But in such conditions, even the HC1 I used to have is able of creating breath-taking imagery - and we're talking CineAlta here!

Unless my camera is indeed faulty, which only some examples from other people could help me to determine.

Steven Thomas
March 5th, 2008, 11:28 AM
Again,
I bring up Adam said this in his ORIGINAL review. It was brought up earlier in this thread maybe three times! Why bash on others for your problems. It's not ours.

Even Adam himself said to stick with the Cine curves during those shots.

If I saw this over exposure condition happening when composing the shot, I would readjust for the shot just like adjusting everything else, focus, aperture, focal length...ect..

Piotr Wozniacki
March 5th, 2008, 12:27 PM
Why bash on others for your problems. It's not ours.

Steven, with the above you're bashing me. Also, if this is not your problem - why post here at all?

If I saw this over exposure condition happening when composing the shot, I would readjust for the shot just like adjusting everything else, focus, aperture, focal length...ect..

Bullshit. None of the above can be considered overexposed, if the main subject was the foreground. They may show other settings' flaws (I was experimenting with WB / colour matrices extrema while taking them, NOT looking for the "abrupt clipping"), but certainly they're not generally overexposed! A "narrower latitude" camera ((like the V1, grabs of which I posted earlier in this thread as the comparison) would simply blow-out the sky; the EX1 blows it out partially as well, while leaving nasty patches around the contrasty objects. If you can't see this obvious flaw, see the optician.

If you still don't follow, I'll repeat it for you, Steven: with certain completely legal exposure levels, required to bring out darker foreground, the EX1 has problem with the compression algorithm, leaving unclipped boarders of bluish tint around darker objects where it should be blowing out like elsewhere in the sky (further away from these objects). It does so with all gammas; the cine gammas are only safer in that with auto iris this doesn't happen. But use manual iris to bring out some underexposed areas, and you can see the same "abrupt clipping" it does with standard gammas, even with auto iris on.

Did you understand now? Good, as this was my last effort to politely address your taunts.

Steven Thomas
March 5th, 2008, 01:19 PM
Piotr,
Have you happened to notice that you are really the only one complaining about this?

You wrote:
"Bob, Bill or Alexander to stop preaching that this is normal, and instead post their own examples of the phenomenon."

Maybe you're right, I'll let them speak for themselves, but I'm certainly under the impression they are not having issues, therefore, not going on with this rant.

Bob Grant
March 5th, 2008, 04:02 PM
As I suspect I'm one of the mentioned parties all I can say is the request to post our own examples borders on the absurd.

I can make an aircraft fall out of the sky without exceeding any of the acceptable control settings but it's not something one does more than once. This is why aircraft and many complex pieces of technology have an "envelope" of operation. It's why simply memorising a flight manual doesn't qualify you for a pilots licence, it's why memorising a camera manual doesn't make you a cameraman. It is why experience is everything.
Fortunately with a camera mistakes aren't as bad as they are with aircraft, automobiles and guns. The same logic still applies though, make mistakes by going outside the envelope and learn from them, yes there's not a lot published about where the limits of the envelopes are for each camera but then again we don't have air safety investigators studying smouldering piles of twisted metal like we do with bad images. So we have to learn from our own experiences.
Last night I shot a performance with my EX1, without even downloading the clips I know a lot of it is going to be crud. The camera did nothing unpredicatable, I operated it as well as it could be, the camera (heck any camera) simply could not cope with the flickering lighting, the very video system itself could not cope. For the record ultimately this was my mistake. From experience I now know that I should never of even agreed to attempt the shoot. Will I make the same mistake again, probably, I'm a sucker when a friend asks me to do something. Will you find me here posting examples of the crud I shot with 'please explains', good grief no.
So what would a professional have done if asked to shoot this. He would have insisted on two trucks and a crew of 10 to light and shoot this. Now he might have gotten away with it without that, just as I might have too. But I didn't and that's the difference between me and a professional. I take the risks and sometimes fail spectacularly, professionals don't, and I and the professional bill the client accordingly.

Now I know what a certain someone is thinking. "I didn't have these problems with my other camera". Well for sure. Learn to fly a 747 and you'll likely never have to worry about compressor stall like you will in a F18. That's why pilots get licences that are "qualified" for certain aircraft. It also shows that things built to extract more performance are also riskier to use, they take more experience to learn the dangers of, they are not easier, they're harder to work with.

It seems to me that the underlying false assumption is that because this camera has 'more' of this and 'more' of that it'll be easier to use. Wrong.

It might also explain why camera manufactures haven't unleashed the beast in their cheaper cameras in the past.

Piotr Wozniacki
March 5th, 2008, 04:28 PM
Last night I shot a performance with my EX1, without even downloading the clips I know a lot of it is going to be crud. The camera did nothing unpredicatable, I operated it as well as it could be, the camera (heck any camera) simply could not cope with the flickering lighting, the very video system itself could not cope.

Bob if your intention has been to address my problem by drawing a parallel then I'm afraid it failed, as I am talking about perfectly normal conditions, which "camera (heck any camera) simply should cope with" ;)


It seems to me that the underlying false assumption is that because this camera has 'more' of this and 'more' of that it'll be easier to use. Wrong.

I'm NOT making such assumptions; to the contrary - as a technical and cotrol freak rather than a creative videographer, I'm excited with the level of complexity this camera presents. I like it difficullt!

But a common sense tells me that while it indeed can do more (not necessarily easier), it should be doing the easy and obvious stuff no worse than other, lower-end cameras.

If you like analogies, a 1001 HP Bugatti Veyron can perform the same way as an average, 95 HP family car, but not vice versa. This camera even has the green button; never tried it but I'm sure that other than with perfect lighting, it cannot produce as good pictures in the "idiot-proof" mode as HC1 can, due to the effect I'm talking about. Do you think it's just OK?

Benjamin Eckstein
March 5th, 2008, 05:52 PM
Maybe for the sake of everyone's ego, temper, etc. this thread should be closed? Chris? It seems all points have been made and there is just a lot of bashing.

Bob Grant
March 5th, 2008, 06:34 PM
Snip...
Bob if your intention has been to address my problem by drawing a parallel then This camera even has the green button; never tried it but I'm sure that other than with perfect lighting, it cannot produce as good pictures in the "idiot-proof" mode as HC1 can, due to the effect I'm talking about. Do you think it's just OK?

Yes, I think it's OK.
And I think that's what many of us have been trying to tell you.
That's why I'm glad I can and still do still use a PD170.
Perhaps one day I'll truly master the EX1 and I will not need to use a 170 anymore.

Should I point out that the Veyron comes with a selection of keys?
You don't give the red key to your teenager children.

Nick Williams
March 6th, 2008, 01:21 PM
Hi,

It looks like this may be a discussion that I really have no business being involved in, but the title of the thread seemed appropriate for my question.

I shot some timelapse video this morning of the sunrise with an ex1 using some settings I downloaded from another thread here, I believe from Bill Ravens-

PP3: TC2 C1

To put it simply, I was curious to see what kind of gradient I would get as the sun came up. When I was playing back the footage on my macbook pro I noticed if I tilted the screen to an extreme degree, I saw 3 very distinct levels of color rising up from the mountains. But I really could only see that clearly by tilting my screen. I opened the file on my macpro and it definitely wasn't as prominent on this monitor, but I knew it was there.

My question is, is there something that can be adjusted to make the transition between these brightness levels maybe a little more gradual?

To show you guys I've adjusted the levels to make it easier to see what I'm referring to:

the adjusted movie clip here:
http://www.alienbedroom.com/timelapse/timelapse_adjusted.mov

original movie clip:
http://www.alienbedroom.com/timelapse/timelapse.mov


any info on this would be appreciated! or I'll happily move to another thread too.

thanks
nick

Steven Thomas
March 6th, 2008, 01:26 PM
Nick,
Using time lapse, this has been brought up before. I'm not sure why there's banding, but it's been seen before in the time lapse footage. I image it has to do with bit rate, anyone?

Bob Grant
March 6th, 2008, 05:51 PM
Nick,
Using time lapse, this has been brought up before. I'm not sure why there's banding, but it's been seen before in the time lapse footage. I image it has to do with bit rate, anyone?

Probably more to do with bit depth. This is an ongoing problem even without a camera when you try to wrangle images created with large bit depths into video with lower bit depths. I've seen some really ugly results from gradual gradients created in Lightwave when the sequence was bought into a NLE. The camera is trying to wrange 14bits per channel RGB into 8 bits. Banding and colour shifts at the bottom and top end of the range are to be expected.

What I suspect could be happening is the camera has been designed as a 10 bit system for the HD SDI output. The easiest way to get from 10 bit to 8 bit is to simply discard the two LS bits. This is does leave some issues that can be solved by dithering however dithering is adding digital noise, the last thing you might want in a mpeg-2 recording system.

We do have a SD SDI CRT monitor, I haven't seen how the SD downconvert from the EX1 looks on that but someone who has tells me it looks fantastic. It might be interesting to compare the signals coming out the SDI port to what gets recorded.

A lot of us were sceptical that Sony were truly sending a full 10 bit signal out the SDI port. Well maybe we've got want we wanted and might to some extent be loosing out in other areas. If it really is 10bit HD SDI I can see an expensive little box on my wish list. I'm not buying any 16GB SxS cards as yet, rather put the money towards a 10bit 3rd party recorder.

Nick Williams
March 6th, 2008, 08:02 PM
I see, that makes sense. So we might possibly see better results coming out uncompressed. Thanks for the insight guys.

Steven Thomas
March 6th, 2008, 08:18 PM
Actually,
The banding occurs during the time lapse footage, using the normal recording modes there's no issue. Well, other than the 8bit gradient capability itself.

Maybe someone will jump in to explain why this happening with the time lapse mode. This has been brought up before with image samples.

Steven Thomas
March 6th, 2008, 08:21 PM
I see, that makes sense. So we might possibly see better results coming out uncompressed. Thanks for the insight guys.


Since the SDI is 10bit vs the in camera 8bit and Sony is utilizing all of the SDI 10bits, this would offer smoother gradients. But, since this particular banding is present in the time lapse and not normal record mode, I'm not sure how the time laspse will look via SDI.

Nick Williams
March 6th, 2008, 08:41 PM
That's true, I figured that if an uncompressed signal may fix the banding issue that it probably wouldn't fix it on the time lapse side. I don't shoot a lot of sunrises or anything, so it shouldn't be a common problem for me.
But say that was the result of shooting normal speed.. would I adjust the knee or slope? To try and smooth those together? I'm just not familiar enough with those settings to know what to adjust. I guess if I wasn't shooting so close to blow out, that might help too.

Piotr Wozniacki
March 7th, 2008, 07:08 AM
OK guys - back to the topic. I had a sunny day today, so - after my trials with trees againt gray clouds - I made some tests with beautiful, deep blue sky this time...

The 3grabs show the same scenery with:

- STD1, knee manual at 95
- CINE4 (unfortunately - still some "abrupt clipping", Adam !)
- CINE2 (this one IS safe, but really very, very flat - see the next post).

Piotr Wozniacki
March 7th, 2008, 07:12 AM
And here is some more comparison:

- STD1 with auto knee, against
- safe CINE2

Obviously the auto knee seems to be doing better than manual at 95 (though this test is far from scientific, as the scenery is not identical - even more backlit; this made the zebra appear and allowed for iris adjustment while shooting). Therefore, below is again:

- STD1 knee manual at 95 (sorry the picture has wrong name - it actually IS manual at 95, not auto!)
- CINE2

Can you see the aureole around the roof and trees with STD1? And there was not even a trace of zebra there while shooting !!! Do you understand now why I think it's not good at all, and would do with some similars grabs of yours to compare?

The only gamma free of it is CINE2 -- but how flat it looks!

Go figure...

Tom Roper
March 7th, 2008, 09:41 AM
Hi Piotr,

Just of few observations I would make, you may want to choke me for saying them, but they are my honest impressions, and a little more general, a little less specific.

I think std 1 auto knee 2 is clipped in both the luma and chroma channels. The exposure of this scene breaks the dynamic range. My judgment in this case is that cine 2 looks flat but only by direct comparison to cine1. On its own merit for video, (not a screen shot), I think it actually still remains on the margin for oversaturation in the chroma channels, and quite contrasty.

Std1 auto knee 2 is more excessive. Look at the blue cast in the shadows, and the color shift on the bricks. The gray and pink sunlit bricks turn to blue and purple.

I think it may be possible to increase the luma exposure in cine 2 to bring out some detail in the shadows, and not clip the highlights. Cine 2 shows less tendency to clip the chroma, thus the colors do not shift as radically when transitioning between sunlit and shadow areas in the midtones (i.e. the bricks).

I think there is excessive chroma saturation in all the screen shots. What that does is open the possibility for colors that bleed at the edges. I see some of that in your pictures. Your EX1, while being noted for lower CA than my XH-A1 for example, is nonetheless overemphasizing the CA that is there. Look at the edge along the roof gutter on the right in cine4.jpg, and along the gutter and rooflines at the upper left in std 1 auto knee 2.jpg.

One characteristic that distinguishes Canon's ugly red/green fringing from Sony is that Sony's fringing when it does appear, is purple/bluish/green. I think it is preferable usually but works against you when the backdrop is a blue sky. And some of the hue shift at the point of highlight clipping in the area of the branches may actually be minor CA that is overemphasized or clipped due to an overall oversaturation of the color channels. In other words, what begins as a minor optical blue fringing, when oversaturated in the chroma channel bleeds over into an amorphous bluish blob against a clipping sky highlight behind. I think I see minor blue CA that in some areas of the picture is clipping into prominence by overall high gain or saturation in the chroma channel.

...that's what it LOOKs like to me. You have the camera and vectorscope displays, so I may be all wrong, just sharing my visual observation.

Speaking on a personal preference, I very much like high contrast, color saturated images. And I have my XH-A1 presets set up for this generally. It may even be more "forgiving" in the sense, of color or exposure latitude. It does seem to more gracefully handle exposure/chroma gradients in the type of high contrast, bright outdoor scenes that you are testing. But that said...I believe the recent pictures above from you take contrast and saturation a bit too far. If it was me, I would try and go back to a baseline, decrease the saturation and dynamic range, and see if there is a decrease in the tendency for the colored highlights to bleed, and perhaps with that, the abrupt highlight clipping. I think you can still do that and still retain saturated high contrast video with punch. I think it can be a mistake to make too many judgments from side by side still images. As an anecdote, I used to sell hi-fi speakers as a junior, doing A-B listening comparisons. Invariably, people would purchase the "louder" sounding speaker even if the sound coming from it was colored. We can make the same mistake when doing A-B's on still images coming from a video camera. In my own work, (which is more play than work since it's hobby, not occupation), I constantly compare my video to video from others, Discovery HD Channel, HDNet, CBS etc. The eyes can fixate on something wrong, and overcorrect for it. Extended viewing of a broad range of material, visuals and sounds are what prevent fixations.

My judgment is that your colors are extremely vivid, to the point of imparting color casts in various parts of the image. Again, refer back to the bricks. It's not just a white balance issue. It's a case of shifting balance, bricks that show the correct color in the sun, taking on a hue in the shadows. I can't tell you what to do, only what I would do. And if it was me, I would try re-doing some of your tests at lower color saturation gains. Just my $0.02

Tom

Tom Roper
March 7th, 2008, 09:51 AM
Just to add...


In the old days of film, we used to call color shifts caused by under or over expsoure "reciprocity failure." That's how I would describe std1 autoknee 2.jpg.

It works both ways, color shifts due to under or over exposure.

Louder isn't always better.

Michael H. Stevens
March 7th, 2008, 10:05 AM
Piotr:

I think with all these pictures you are trying to sell your beautiful house!

Seriously, forget CINE2 unless for broardcast, you know it is just CINE1 truncated. For bright scene like you have shoot show us CINE1 or 3. I too was thinking why does everybody go HiSat. I have found on my scopes that the blue often clips when the luma is fine and HiSat makes this worse. Try C1 & 3 with normal or cinema matrix.

Mike

Piotr Wozniacki
March 7th, 2008, 11:10 AM
Tom and Mike,

Thanks for your comments. You're absolutely right - these grabs were taken from my experimental shootings with PPs varying in the gamma used, but having all the same, highly saturated colour matrix. Even though I do like it contrasty, rich and juicy, some of them are indeed oversaturated even to my eye, and I have since modified the PP's accordingly.

However, with deep blue sky it was not that easy to clip the highlights as it was with dull wheather and overcast sky, so I made it more difficult for the camera by increasing the chroma... And the peculiarity of "abrupt clipping" appeared again - even with the Cine4 that Adam recommended as safe in this respect. Only Cine2 seems completely safe (at least as luma is concerned - chroma can still be clipping, as Adam pointed out).

Well, I guess I also owe some positive comments to this machine: were it not for abrupt clipping, the contrast range and colour saturation could be really considered absolutely fantastic. What needs to be said is that even with this level of colour gain (+25 with the Hisat matrix) as well as detail amount present, there is almost no mosquito noise or other artefacts that with the HDV codec on my V1E would have spoiled the image completely.

PS. Just received an e-mail from Adam with a couple of invaluable remarks and observations. One of the most important is that with Cine2 - even though it's safe in that its luma never exceeds 100% - the chroma is clipping nevertheless in the high 90-es. So, beware of that! This confirms your comments about the chroma (especially blue channel) clipping, which I can also see in Vegas scopes.

I will be trying now the Cinema matrix.

Paul Kellett
March 7th, 2008, 11:40 AM
Piotr,what picture profile are you getting most satisfied with,i'm using bill ravens but i presume you've strayed a bit from that now.
Are you trying to get a profile which you can use all the time or different profiles for different situations,ie,profile for overcast day,profile for sunny day etc.
If you could post your profile(s) that'd be great.
Thanks,Paul.

Piotr Wozniacki
March 7th, 2008, 12:05 PM
Paul, I am still experimenting to find my optimum PPs. When I'm ready, I'll post them.

No, I'm not using Bill's right now; all my colour matrix coefficients (pairs) are zeros (default). Perhaps I will fine-tune them later, when I settle down with the choice of matrices and gammas. Finally, I'll play with detail etc.

Yes, I always have a set of PPs for the most typical sceneries; here is the convention I've been using with cameras capable of fast switching between 6 PP's:

PP1: low-light indoors contrasty (STD1)
PP2: low-light indoors flat (STD4)
PP3: bright outdoors flat (Cine1)
PP4: bright outdoors contrasty/backlit (Cine4)
PP5: dull/low-light outdoors flat (TBD)
PP6: dull/low-light outdoors contrasty/backlit (TBD)

Paul Kellett
March 7th, 2008, 12:41 PM
Thanks Piotr.
No Hisat on any of them,correct ?

Paul.

Piotr Wozniacki
March 7th, 2008, 12:56 PM
Thanks Piotr.
No Hisat on any of them,correct ?

Paul.

Actually Paul, as I mentioned earlier, the grabs posted today are ALL Hisat-based (plain at +25, with no individual pairs modification).

Whether or not my finall PPs will be Hisat I don't know yet - will try the Cine matrix over the weekedn (if the weather is like today :)

Paul Kellett
March 7th, 2008, 01:05 PM
Thanks Piotr.

Piotr Wozniacki
March 7th, 2008, 01:27 PM
I have shifted the STD1 knee 95 slightly towards red in Vegas, to get rid of the bluish tint in shadows. It's better now, I think.

The conclusion is: each preset needs its individual colour balancing!

Wayne Zebzda
March 7th, 2008, 01:55 PM
Hi Piotr,
A little off topic but...
How close can you get your V1 to match up with the EX1 as a B cam ?
Aloha,
Wayne

Piotr Wozniacki
March 7th, 2008, 02:40 PM
Unfortunately, I sold my V1E - one of the silly things I've done lately :) So, no B camera!

But of course I do have plenty of HDV stuff, shot with it - and it actually intercuts quite well, especially with the SP mode material from the EX1.

But even in SP mode, the EX1 codec is cleaner - especially in low-light and with fine detail. To me, the difference is quite obvious; colours you can grade to match, but the increased mosquito noise in the V1E can be noticed.

That said, to the casual viewer the combined renders look great.

Sebastien Thomas
March 7th, 2008, 03:44 PM
Don't know if you've been through this article, but have a look there : http://prolost.blogspot.com/2008/02/digital-cinema-dynamic-range.html

Benjamin Eckstein
March 7th, 2008, 04:16 PM
Don't know if you've been through this article, but have a look there : http://prolost.blogspot.com/2008/02/digital-cinema-dynamic-range.html

Whoa! Stick that under my pillow and hope it makes more sense in the morning. Very interesting though.

Bob Grant
March 7th, 2008, 04:44 PM
Don't know if you've been through this article, but have a look there : http://prolost.blogspot.com/2008/02/digital-cinema-dynamic-range.html

Mandatory reading. The reply (way down the page) from Jason Rodriquez explains the issue very well. Keep in mind that the discussion relates to cameras recording 10bitLog and beyond. Even then they don't come close to 35mm neg.
My thanks to Sebastian for posting the link. What a breath of fresh air in this thread to read something by people who do the hard yards required to understand what they are working with. And my hat goes off to Stu for his work modelling the issue in AE.

Michael H. Stevens
March 7th, 2008, 08:16 PM
I just had to comment on this. Did you read what Piotr said regarding the blue-clipping? He said Adam Wilt confirmed what I said! That made my day.

Bill Ravens
March 7th, 2008, 09:41 PM
Irrelevant.....Red is RAW, the EX1 is not.

Piotr Wozniacki
March 8th, 2008, 02:21 AM
Don't know if you've been through this article, but have a look there : http://prolost.blogspot.com/2008/02/digital-cinema-dynamic-range.html

Thanks Sebastien for the link - great reading!

Michael H. Stevens
March 8th, 2008, 09:47 AM
Whoa! Stick that under my pillow and hope it makes more sense in the morning. Very interesting though.

This article reinforces a lot of my observations as spoke of in the "under-exposing" post. Even with the EX1 roll-off curves more highlight detail is obtained with about a stop underexposure with the middle brought up in post. This article is very relevant as long as you realise the difference in the Panalog and Red curves vis a vie the EX1's hyper gammas.

Piotr Wozniacki
March 9th, 2008, 08:37 AM
This article reinforces a lot of my observations as spoke of in the "under-exposing" post.

As I see it, this hasn't been the unambiguous conclusion at all. Jason Rodriguez, whom Bob is referring to, says in his comment to the article:

"Hi Elliot, you're right, you want to expose "to the right" to maximize signal to noise ratio".

Your "under-exposing" theory is good for getting more headroom for highlits, but brings in the danger of getting too close to the "noise floor".

So frankly, no definite conclusion from this article to me...

Michael H. Stevens
March 9th, 2008, 09:03 AM
As I see it, this hasn't been the unambiguous conclusion at all. Jason Rodriguez, whom Bob is referring to, says in his comment to the article:

"Hi Elliot, you're right, you want to expose "to the right" to maximize signal to noise ratio".

Your "under-exposing" theory is good for getting more headroom for highlits, but brings about the danger of getting to close to the "noise floor".

So frankly, no definite conclusion from this article to me...

Actually, the article says 1.25 stops down will give the headroom with little noise. Anyway, to is Sunday, another test day and now Cineform NEO-HD is fixed for me I'll be testing this along with my HiStat test to day. I'm also ASKING here. To exposure at this level where should the Zebras be? IE how many Zebra percents is one and a half stops? Is this Doug Jensen's 95?

Bill Ravens
March 9th, 2008, 09:13 AM
Mike...

Keep an eye on your shadows. I think you'll see some pretty bad noise, even at 1 stop under. As I've been saying all along, expose to the right.

Piotr Wozniacki
March 9th, 2008, 09:13 AM
It's my opinion that the zebra should still be at 100% (as this is the only setting possible with Zebra 2; Zebra 1 is adjustable, but will span a +/- range thus cluttering your view).

Michael H. Stevens
March 9th, 2008, 11:30 AM
It's my opinion that the zebra should still be at 100% (as this is the only setting possible with Zebra 2; Zebra 1 is adjustable, but will span a +/- range thus cluttering your view).

Very good point Piort. I knew this and totally forgot the problem of the Zebra #1 95 being 90-100. I'm mystyfied how a cut-off point (as a Zebra setting is) can have a range?

Maybe, if you set Zebra #1 to 100, then when zebras FIRST appear you are at 95?????????