![]() |
Re: FS5 - Macro blocking codec issue in 4k??
"Also, Mark II would solve the EVF issue IF THEY BASED IT OFF A CAMCORDER DESIGN, NOT A DSLR DESIGN. (Bad Sony! Bad!)"
What do you mean, camcorder design or DSLR design? The electronic principles are the same. Raw sensor readout, deBayer and gama/color and noise reduction processing and codec encoding. Aside from programmed time recording restrictions, the same circuits will be used for either DSLR or Camcorder. Yes, sensor noise will be different when you change that out. Noise reduction algorithms will be different but everything else will be the same. A DSLR is just a software crippled camcorder in a photo camera body. (A photo camera body that is less capable of handling heat too) |
Re: FS5 - Macro blocking codec issue in 4k??
In the case of the A7s II, they have to do that so as to not overuse power or overheat the chips. It's not simply the case of swap the heatsinks and it should work, the chips were engineered with limitations in mind. Camcorders have more FPGAs than ASICs, and those can handle way more heat and load over time.
Only active cooling in the FS5 is the Sensor. On the FS7 I believe it's both on the main FPGA and the Sensor. |
Re: FS5 - Macro blocking codec issue in 4k??
Just curious, how come you know so much about this? Are you an engineer at a cameracompany?
|
Re: FS5 - Macro blocking codec issue in 4k??
I would really hope we can get more FS5 sample uploads here. I'm ready to pull the trigger and buy the FS5 next month and I really want to see if this is a real problem or not.
Could there be some models out there with bad sensors and others that are fine? (A simple quality control issue) If you purchased your FS5 within the last 30 days, you seriously might want to inspect closely what your camera is recording around the edges. Maybe you have a unit that has this problem? If anybody does see something, please upload some samples! Sony understandably is not going to lift a finger to do anything if they only see two or three bad videos out there. CT |
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
|
Re: FS5 - Macro blocking codec issue in 4k??
Just did extensive testing on the FS5 trying to reproduce the problems some are seeing.
Here is a long boring video but if you are investigating this you may want to watch. You can download the original UHD file loaded to Vimeo but that is not the same as original it is compressed about ten fold. Contact me directly if you want the direct out of camera file or the simultaneously recorded Odyssey O7Q+ file I will provide those if you like. This is only the internal UHD file, frankly I see almost no difference in the ProRes version from the 07Q+. The profile I used is a new one I made, partly because I am having some issues with FCPX clipping above 100ire. So I used CINE2 in this test, I do state in the video it is CINE1 and that is wrong. Though CINE one is very similar it allows up to 109ire. Anyway this shows iso 800,1600 and 3200 with some custom settings in my PP3 These settings are: Gamma CINE2 Black Gamma: Middle -4 Sat: +4 Color: Cinema Detail: -7 Everything else standard PP3 settings. The interesting thing is the Odyssey file is the same on the scopes and noise vise there is very little difference. If you want to see the O7Q+ file contact me, the vimeo compression will delete any difference. I am viewing this both on a TOL iMac and an Eval Monitor, not a TV the Eval monitor is a professional piece of equipment and it shows a very true picture and the video is fed by a SDI out from my UltraStudio for Thunderbolt. |
Re: FS5 - Macro blocking codec issue in 4k??
I downloaded this video and didn't notice anything strange around edges when viewing on a 1080 monitor.
However, when I did a zoom/crop and looked at it with a 1:1 pixel view. I DID then notice some of this odd "splotchy" edging. I really can't say for sure, but could this be a result of some kind of line skipping at the sensor read-out stage? I could be way off but I don't feel like is a compression problem at all. Could it be a strange, improper RGB de-Bayering problem? Weird. I have never seen this on my A7s-II, RX10-II or X70. Not even at 400% zoom/crop. What is the FS5 doing that it's cousins are not? EDIT - I have been looking at this sample a little closer and have noticed that the artifacts seem to occur stronger on horizontal lines much more than vertical lines. I'm uploading a zoomed in clip from your file at 1/4 speed. What shutter speed did you use for this? Was it 1/30 second? It seems that the shutter speed and motion blur are helping to cover this artifact a bit. Can you try another shot at a very high shutter speed? I think if you take it above 1/200 or something like that, it will make these ugly edges pop right out in a slow motion inspection. https://drive.google.com/file/d/0B60...ew?usp=sharing Check the slow motion video above. again, a faster shutter speed will reveal more. CT |
Re: FS5 - Macro blocking codec issue in 4k??
It doesn't have anything to do with line skipping or de-bayering. It has to do with a mis-tuned noise reduction algorithm, which is hard coded to one of the onboard ASICs.
Bayer artifacts and line skipping tend to show the "rainbow effect" but the examples I've seen (primarily Alex's) show less rainbow effects on hard edges and more "ghosting" and loss of detail, more prominent with a poorly tuned noise reduction algorithm. Also, protip, turn off "Smart Resampling" in Sony Vegas when you slow motion a clip. That eliminates the blur. |
Re: FS5 - Macro blocking codec issue in 4k??
Thanks for the tip in Vegas. I had completely forgotten about that! ;-)
Do you believe that the code that is hard programmed into these ASICs chips have no ability to be adjusted at all? I mean, there is no code that Sony placed there that says: "Apply this ASICs FIXED noise reduction pattern or calculation at a strength of X or Y",...lets say 1-10 variable amounts. Forcing all the video through a completely fixed and hardware locked circuit path would be a very cheesy way of doing it. I have to believe (hope) that there has to be some kind hardware programmed code that allows for some minimal degree of noise reduction variability. (like "color saturation", "shapness" or "contrast" 1 thru 100) I can see the noise pattern characteristic being permanently "baked" in the chip. If Sony cant change the noise pattern, couldn't they at least "ramp-down" how much of that reduction algorithm is actually applied in final processing? (and possibly reducing the problem?) That Tesla500 channel is awesome. Really sweet stuff there. Have you been able to see the inside of the FS5 yet? Or, have you been able to identify the chips the FS5 uses from technical documents? I really hope we all can shed a larger spotlight on this in the weeks to come. I might be holding off on my FS5 purchase after all! :-( CT Edit: The A7S-II got a firmware update this month. One of the Sony stated fixes was "image quality improvements". I did a few short (original firmware) recordings with the lens cap on to record all black and different ISO settings. I then upgraded to the new firmware and did the same recordings with the lens cap on. I DID notice some slight noise changes between the firmware versions. When I heavily stretched the contrast in both blacks upward, I saw that the original firmware had very faint "horizontal" noise "lines" while the pattern with the new one was more "dot and spot" looking. Could they have modified the noise reduction process between the two firmware? |
Re: FS5 - Macro blocking codec issue in 4k??
I just did some testing with my fs5 on a large tv and I found three gammas that look excellent in 4K. Rec709 800%, slog2 and slog 3. In my opinion this will cover most any shooting situation with these. They looked completely usable to about 6400 and pretty decent even up to 10,000. The other gammas, the blocky mess on some edges is very apparent, but completely gone on the three mentioned above. Worth taking a look for yourselves, but I feel much better knowing there is a gamma outside of slog that looks great at 4K.
|
Re: FS5 - Macro blocking codec issue in 4k??
Can you upload some short samples to a Google Drive or Dropbox?
So your camera DOES show these blocky eges in other standard Rec709 settings? SLOG and Rec709 800% are great for grading. However, there are times when you want to give out a "baked in" finished look. So it seems the FS5 is stuck in UHD SLOG and Rec709 800% ?? We gotta get more samples and proof to Sony ASAP. Thanks! |
Re: FS5 - Macro blocking codec issue in 4k??
Yeah it shows the nasty edges at 3200 and above on other gammas. Below 3200 and it completely goes away. I think you could get a pretty good look with 709 800% and adjusting the profile if you wanted the baked in look. I actually prefer 800% over the standard 709 gamma
|
Re: FS5 - Macro blocking codec issue in 4k??
Wow, uggg,...well? I guess maybe we can add your FS5 to the list of problem cameras.
Have you contacted Sony about it yet? I am really hoping that this issue gets reported and makes its way up the Sony tree and up to Japan. If it doesn't exist in SLOG or Rec709 800% than maybe there is hope that they can correct it in standard Rec709 gamma? FS5 owners need to also be very aware of this problem too. It sucks to see everything fine on your small camera monitor only to get shocked when you see it in your NLE at home. Not good! |
Re: FS5 - Macro blocking codec issue in 4k??
As long as you understand the camera and its limitations it's an awesome camera.
|
Re: FS5 - Macro blocking codec issue in 4k??
True....
But having a limitation of not being able to record standard Rec709 without horizontal edge artifacts, something that even my cell phone can do properly,...is a very embarrassing problem for a $5,500+ pro camera. On the FS5, does Rec709 800% force a minimum ISO? My AS7-II forces it at 1600 ISO. (Same as SLOG) Ouch!.... |
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
|
Re: FS5 - Macro blocking codec issue in 4k??
Wow Jack.....if what you are saying about the FS5 is true, Sony has one Hell of a defect on it's hands here with a camera that they really want's to sell allot of in 2016.
If Sony cant repair this problem what are they going to do? Can they try to sweep this under the rug and pretend it's not happening? More and more problem samples will come out and complaints are sure to grow and grow. I'm definitely looking for more FS5 owners out there to shoot more straight line tests with motion. Better yet, if somebody can shoot a resolution chart and "tap" or "wiggle" the camera and post it in UHD, that would be awesome. This is depressing...... |
Re: FS5 - Macro blocking codec issue in 4k??
Sorry I am new to the FS5's REC.709 800% terminology here. What does it mean that makes it different from the usual REC.709? I'm planning on getting an FS5 myself. Thanks.
|
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
|
Re: FS5 - Macro blocking codec issue in 4k??
Wouldnt proving that the camera can record beautiful images on three gammas prove its not a hardware issue. Gammas are a software change, so it's clearly not the chip.
|
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
|
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
It does make you wonder though, if Sony can give you a clear image at rec709 800%, why cant they do that at standard Rec709 at ISO 100-3200? How is Sony's implementation of this possibly faulty noise reduction system different between these two modes? Calling all FS5 owners! More test samples please, please, please. ;-) |
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
Imagine this, you try to make a Bitcoin mining ASIC change into a general purpose CPU... You just can't. The function is VERY SPECIFIC and baked inside the chip, and to change instruction sets so that it turns into a general CPU is neigh impossible. (and if it is possible, incredibly inefficent, nullifying the point of changing the specific purpose of a ASIC after it's been made.) |
Re: FS5 - Macro blocking codec issue in 4k??
So, if you are right about these ASIC chips providing "broken" or "improper" noise reduction algorithms to the FS5's image processing, the only way for Sony to fix this is to dial back on its usage amount.
Dong so, might reduce the problem the NR algorithm is causing but will of course, allow more noise back into the image. I'll take it! Noise I can handle! I can always clean that in post if needed. What we cant do is repair the artifacts this is causing on the image today. Once resolution and detail is destroyed at the image processing level, it cant be recovered in post afterwards. Maybe this is Sony's only hope for a FS5 firmware fix? Question for Jack: Could Sony have baked in MULTIPLE noise reduction patterns/algorithms into this ASIC? (Designed for multiple Sony sensor types) Is it possible the the FS5's firmware is implementing or activating the wrong one? We know the FS5's S35 sensor is not a new one, it's used on the FS5, F5/55 and FS700 too. So we know that Sony has the right noise reduction algorithm for that sensor in it's technology somewhere. Could this noise reduction ASIC have those S35 sensor noise models baked in too and not being accessed properly? (The FS5 firmware is calling on the wrong NR model in that ASIC?) CT |
Re: FS5 - Macro blocking codec issue in 4k??
OK I can now reproduce the problem reliable, after extensive pixel peeping and I found the best way to spot the problem. I use my Odyssey O7Q+ in UHD and go pixel to pixel or even 2 to 1. This way I can see the effect w/o going back and forth downloading to my edit suite.
It took a long time for me to even spot this problem as I was working on developing PPs and test shooting outdoors and studio setups. I never saw it in any of my footage. I really had to work at it but now I can see it clearly and reproduce it. I will contact Sony and send them the video below that shows what is happening very clearly. So my conclusions are: It is a very special circumstance that causes the problem. A high contrast level edge slightly out of focus moving up and down slowly, fast is fine. In focus seems better but sometimes shows up. It is interesting that it is not every frame, just some frames, others are fine, and rarely are there 2 bad ones in a row. It happens UHD in all the CINE gammas 1-4 at 3200 iso and up. It can be seen but rarely at 1600 iso. All other Gammas are fine in my tests. It does not happen in HD. Noise Reduction settings make no difference at all, I tried all the variations. All my tests were in 29.97. So here is a short video it is ¼ of an UHD, so it is pixel to pixel viewed in HD. I can see this in reference monitors and on my Mac screens, so it is not the same noise you sometimes see in a computer screen when the GPU is overwhelmed. My bottom line is the 5 is a great camera, but it has a definite problem with CineGammas in UHD at iso 3200 and up, but this will only show up in fairly rare circumstances, at least the way I shoot. Hopefully Sony will look into this and correct it. It can be fixed in post if you get it in a shot and it needs to be used, just do a tracking blur over the affected area with soft edges. It is not stopping me from using Cinegammas at 3200, I will just be aware of what may happen in some rare circumstances. Anyway Happy New Year to everyone. These are interesting times... |
Re: FS5 - Macro blocking codec issue in 4k??
Just to say thank you Olof for your efforts in establishing these details. Happy New Year!
It will be interesting to see how Sony respond. |
Re: FS5 - Macro blocking codec issue in 4k??
I think that perspective has been lost here, and some of it starting to sound a lot like Sony bashing.
Sony has developed a very nice little HD camera in the fs5, which includes UHD capabilities. It is pleasing to the hand and to the eye and is offered it at an attractive price. It's a bargain...if it meets your requirements. If not move on. There have been many beautiful examples of the quality images that fs5 can produce posted by a number of professionals on this site and elsewhere. The 'macro blocking' in the dark could be resolved by throwing a bit of light on the scene and holding the camera steady. Any camera can be made to look bad if you try hard enough. |
Re: FS5 - Macro blocking codec issue in 4k??
I see no Sony bashing here. In fact, I see people trying to identify a problem so that Sony can fix it and sell more cameras.
Nobody wins if we all try to ignore this problem, pretend it's not there and try to sweep it under the carpet. This artifact happens in good light and bad light. It ruins edges in UHD and ultimately the hurts the overall resolution potential of the camera. No other Sony UHD camera has this problem that I know of and it's a shame that a $1300 RX10-II can out resolve a $5600 XDCAM FS5 because of this edging problem. Let's not "bash" Sony on this. Let's help Sony identify the issue so they can fix it and make the FS5 all that it can really be. We had a fit about the A7S-II over the "black hole sun" problem. We didn't just sit back and pretend it didn't exist. Sony took notice and fixed in in 3 weeks for their customers. I have owned 18 Sony cameras in 20 years. I'm certainly in the Sony "fanboy" catagory. I'm about to buy the FS5 in 3 weeks...so no, I'm not a Sony basher...I'm quite the opposite, for sure. |
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
I didn't know the A7s II had a black sun issue. That must meant they REALLY rushed the firmware and the camera out to market. Usually black sun issues only apply to industrial CMOS sensors or unprocessed raw sensor data. They must have rushed these cameras to market, like the PXW-X200 with it's infamous lens focus issue. |
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
Not sure how its "sucks" to have use ND in this camera and we will have to work at 3200 to use SLOG3 as well, it is not like the ND is causing any color shift or any IQ loss... I can't se any difference with or without ND engaged... sharpness and contrast all look the same to me, but I admit I didn't zoom to an absurd level just 100%-200% UHD on a 1080 time line and I have been watching some on a 60 inch UHD tv. I have been able to recreate the dancing line issue in CINE gamma at 3200/6400iso at 1 to 1 , hope it can be fixed, I wouldn't want to see busy scenes like tree branches in the background of an image go crazy with artifacts but as far as the original large blocking issue (the issue News Shooter re-posted) I have not been able to get anywhere near that... with a couple of exceptions grossly underexposing and bringing up in post and/or a combination of under exposure and digital zoom at high ISO values. |
Re: FS5 - Macro blocking codec issue in 4k??
When I sat it "sucks"....I simply mean that I have never...oh let's say: Crank up to 12db of gain only to throw on the ND3 filter on an EX1.
Gain and ND are counter intuitive when used like that. It's not absurd to want to shoot in a standard Rec.709 gamma and run at 200 ISO or low gain like that. You don't think it's odd that the FS5 can't do that without getting hit with edge blocks? I dunno....maybe I'm expecting way way to much from a $5500 camera? CT |
Re: FS5 - Macro blocking codec issue in 4k??
"When I sat it "sucks"....I simply mean that I have never...oh let's say: Crank up to 12db of gain only to throw on the ND3 filter on an EX1."
I never owned an EX1, but with the FS5 3200 in log or REC709 800% 3200 isn't 12db of gain its the native gain "Gain and ND are counter intuitive when used like that." Its not really gain for that gamma just like LOG the native is 3200 so your only options are close iris, add ND or speed up the shutter....in this case ND wont even cause color shifts or any loss of image quality so thats the way I would go "It's not absurd to want to shoot in a standard Rec.709 gamma and run at 200 ISO or low gain like that." Nope not at all, but this camera simply wont do it in 709 800% or SLOG (wont do 200 in any setting, 800 is the lowest in Cine1) "You don't think it's odd that the FS5 can't do that without getting hit with edge blocks?" Not sure what you mean by "that" I think the line/blinky/artifacts are really F'd up to be 100% honest.... luckily for me even as it sits the pros outweigh the cons.. I desperately needed a smaller camera, the vari ND is going to be amazing for what I shoot (big lenses that are very hard and expensive to filter) and the better HD/SLOG option will be absolutely wonderful. "I dunno....maybe I'm expecting way way to much from a $5500 camera?" I have no idea what you expect or how this applies to what I wrote. I personally expect it will get improved but do worry Sony is going to get blasted with strange requests and "issues" that might obscure the real ones. Seems like maybe I was unclear in my post but I just don't have much time to go on about it so I will just repeat the main point of my post. I am able to replicate the blinking line artifact issues in the CINE modes and at 3200 and up..... but after trying extensively I am unable to replicate the big blocked background look of the footage News Shooter reposted without using digital crop or underexposing I hope you don't feel I was being rude or anything, just posting what I found with my fs5 and if you disagree with it... or if yours is doing something different than mine so be it... post away I am out :) |
Re: FS5 - Macro blocking codec issue in 4k??
No, you are cool and I dig what you are saying. I don't own an FS5 so I can't say anything conclusive at all about it.
It's funny, on the A7s, the "native" ISO was 3200 with SLOG. On the A7S-II, with the same sensor, that magically changed to 1600 ISO. Is it correct to say the the FS5's native 3200 ISO is equal to 0db of gain? Is any ISO below that running negative gain? My brain operates better in "gain" than it does in "ISO"...ha! Can't wait to test my FS5 for myself soon anyway. CT |
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
|
Re: FS5 - Macro blocking codec issue in 4k??
Have been shooting with my FS5 for only a few days but it's clear the 4K image pipeline on this camera needs a firmware fix.
For now I recommend avoiding the ripped edges by shooting S-LOG 2 and no higher than ISO 6400. Also ITU 709 800% at the base ISO of that profile seems fine too. What I am most disappointed about is the 10bit 1080p performance. 50Mbit/s is way to low for the smooth gradation 10bit is capable of, it just gets compressed to hell! Macro blocking and banding all over the place and nothing like 10bit on a Blackmagic. |
Re: FS5 - Macro blocking codec issue in 4k??
@Olof: Thanks so much for narrowing down the issues. It's very helpful to know when these artifacts happen and how to avoid them. I did a shoot in Cine the other day and was wondering why the edges of interviewees seemed a bit weird, and this explains it. Cine gammas are my go-to settings at this point as they offer higher dynamic range but avoid the log workflow. But for now I may choose log or rec709 800. Hopefully Sony will address these issues soon, I was pleasantly surprised when they issued firmware updates so quickly for the A7sII and FS5, which means they either responded very quickly or they knew of the issues and had the fixes in the pipeline and were just QA'ing them further.
I'll be discussing this in an upcoming issue of my cinematography podcast, TechMove. -Keith Listen To TechMove Podcast |
Re: FS5 - Macro blocking codec issue in 4k??
I'd love for Sony to issue a statement that acknowledges the problem and states that they are working on a solution.
They did this recently for the A7s-II "black hole sun" problem and fix. At this point, we don't even know if Sony is even really aware of this today. However, If they do know about it, they might not want to say anything about because they are afraid it could hurt FS5 sales. Who knows? I certainly believe that being upfront with product problems improves your brand reputation and is a very noble way to handle these things. In the end, I think this strategy improves customer relations and increases consumer confidence too. How many people where impressed when Sony talked about that A&S-II firmware problem and fixed that thing in 3 weeks? I know I was very impressed. If this thread topic hasn't arrived on Sony firmware programmers desks yet, at least it's getting the warning flag up for the FS5 user community. There is nothing worse than shooting in a mode that you think is OK in the field only to get home and find out that you recorded a nasty problem with edges in your UHD Rec709 shots. CT |
Re: FS5 - Macro blocking codec issue in 4k??
More information is starting to come out:
Sony FS5 user reports artifact issues triggered by changing exposure, ND. Visible on HDMI output And more samples and here along with other issues discussed: Sony FS5 codec problems and 4K ripped edges bug - EOSHD I REALLY hope that Sony in Tokyo is aware of this and is working on it. CT |
Re: FS5 - Macro blocking codec issue in 4k??
Quote:
NewsShooter should be ashamed, they could easily get a camera and test for themselves but they just repost someones video and write an article... they will both get thousands of hits and I guess thats what counts but starting to look like the "sky is falling" pack has taken over and I can't see any reason for Sony to fix anything now... its over, the damage is done, even if they could fix all the issues why would they? The camera is dead, those posts will get thousands and thousands of hits... and keep getting hits even after an firmware fix came out. Bummed, I just wanted a better image in the LCD when I used focus mag and to be able assign AF on to the grip along with some other easy firmware tweaks to make the camera even more usable.. bet its not going to happen now |
Re: FS5 - Macro blocking codec issue in 4k??
"its over, the damage is done, even if they could fix all the issues why would they? The camera is dead,"
Not sure what you mean. The camera is not "dead", it's a brand new model and I'm guessing they CAN fix it in firmware. Sony plans these XDCAM models to have at least a 3 year shelf life. So, I'm sure they have allot planned for this in 2016. Let's hope they are aware of these problems in Tokyo |
All times are GMT -6. The time now is 06:27 AM. |
DV Info Net -- Real Names, Real People, Real Info!
1998-2025 The Digital Video Information Network