View Full Version : PDW700 workflow


Steve Phillipps
May 18th, 2008, 04:22 AM
Just thinking about the possibility that the new PDW700 might be able to record to SxS and disc simultaneously. I think this would give the ideal workflow in shoots in remote areas. Yes, discs could be seen as a permanent archive medium but alternatively if you just wanted data storage you could shoot to both simultaneously on location, then transfer the SxS to a single drive. Once back at base copy the material from the drive to one or more backup drives, verify that it's there and safe, then re-use both the SxS cards and the discs. If there was a problem and the data ws corrupted somehow then you'd have the optical discs to save your skin. I think a lot of people find it hard to trust solid state media and a setup like this would set people's minds at ease.

Dan Keaton
May 18th, 2008, 06:43 AM
Dear Steve,

You raise some interesting points.

Some feel that there is a confidence factor today, due to problems that some have experienced with solid-state media.

I fully believe the reported problems.


These problems break down, as I see it, into a few categories:

1. Problems with specific cameras or audio recording devices.

2. Problems with specific brands/types/vintages/quality levels of solid-state media.

3. Problems with counterfeit media.

4. Problems with quality media that has worn out or is longer reliable, but was once very reliable.



For Category 1, the devices that use solid-state media have to be properly designed.

This is not a trivial as it first appears. But once it is proven that a device works reliably with solid-state media, it should continue to do so.


For Category 2, the best parts from the top quality brands are far better than they were a few years ago.

In the early days of solid-state memory, there were problems with endurance, the wearing out of the memory cells, and the designs were not as robust as they are today.

All solid-state memory for professional uses should have "wear leveling" and should have error detection and correction circuitry built in.


For Category 3, regretfully a user of solid-state media must be very cautious to avoid counterfeit or low quality media.

Ebay has some interesting articles on how to spot counterfeit media.

Avoid purchasing memory products if the prices appear too good to be true. The counterfeiters generally attack the most widely known parts/brands.

Buying quality parts, at the going rate, from reputable vendors such as DVInfo.net's sponsors, is a good way to protect yourself.

The Flash XDR will have a built-in feature to test your Compact Flash memory to ensure that it is actually the correct memory size and performance. Some counterfeiters re-label low cost/low capacity/low performance parts as the premium high capacity media.


For Category 4, even today's best designed, highest quality media will wear out eventually.

The "wear leveling" feature of today's cards ensures that writes to "logical" memory addresses are written to different "physical" memory cells over time.

The FAT (File Allocation Table) on the media is usually written to far more often that other memory addresses. So, the actual writes are to different physical memory cells with the "wear leveling" feature. This avoids the problem of some memory cells wearing out while other cells in the memory are sitting idle.

Quality manufacturers specify the endurance of their parts.

We are lucky as recording video/audio is an ideal application for solid-state media. This is a far better application of solid-state memory than other applications that require a very high number of writes to the memory.

Today, for example, the endurance of quality media is well over 10,000 writes and an unlimited number of reads for each memory cell.

Recording 10,000 events/shoots/etc. is a lot of recording. Is there any videotape that can stand up to 10,000 recordings with an unlimited number of playbacks?

Summary:

In the design of the Flash XDR, we specifically wanted to overcome the perceived and actual reliability issues of solid-state media.

If one purchases quality media, especially if one purchases the recommended professional quality media, then one should have a reasonable level of confidence in their media.

For critical work, for safety, for backup, or for workflow reasons, one can create two “original masters” simultaneously using the Flash XDR.

Professional photographers have been using Compact Flash memory for years. Some can reliably state that they had a Compact Flash card that went bad over time, usually with some type of indication beforehand.

But, I feel confident to say that no one has had two professional level, quality Compact Flash cards fail simultaneously.

So, if one creates two “original masters” simultaneously using the Flash XDR, we feel that the risk of a failure or dropout is exceptionally low.

David Heath
May 18th, 2008, 07:42 AM
Just thinking about the possibility that the new PDW700 might be able to record to SxS and disc simultaneously. I think this would give the ideal workflow in shoots in remote areas.
Absolutely right, but is it not more than a possibility? I thought there was news at NAB that an SxS recorder designed to fit on the PDW700 in a simialr way to the CF recorder and the S270 was coming?

Dan - I don't want to put words into Steves mouth, but I suspect one of the things that may cause a lack of trust is more to do with solid state WORKFLOW than hardware or media. The possibility of finger trouble after a gruelling day of filming, especially if coupled with factors of being in a remote area.

In such a case, filming straight to (cheap) discs and worrying about the next stage back at base has a lot to be said for it, and your archive takes care of itself. In other cases, a cameraman may need to film a shoot, and simply hand the material to the producer at the end. What's easier than tape or disc then?

But in other cases, solid state has a lot to be said for it, especially in quick turn round situations, absolutely no question.

I don't see either solid-state OR disc as being inherently superior to the other - they each have their pros and cons dependent on situation. What I do see is the desirability of being able to call on either or both as required.

The XDR then becomes an obvious competitor to whatever Sony propose for the 700 with SxS, with the advantages of much cheaper media and the option of higher bitrate recording, but the disadvantages of higher cost, size and weight. But what about a cut down version of the XDR? Keep the CF recording ability, but lose the encoder, HD-SDI abilities etc - for many users the 50Mbs signal will be more than good enough. A small cheap device able to record the same signal as put to disc - but onto CF, not SxS - could be just what's needed.

Alister Chapman
May 18th, 2008, 02:01 PM
Well I have both a solid state camera (EX1) an Disc camera (F350). I have taken both of these to hell and back and they have both work 100% reliably from 24 degrees below freezing to searing desert heat, hurricanes, sand storms and 100% humidity. I have frozen both SxS cards and professional Discs into blocks of Ice and put the Disc through the dish washer. Even after that kind of abuse they still worked perfectly.

Now... I can see a situation where you might want to shoot to both SxS and Pro Discs to get the advantage of fast turn-around from the SxS cards plus an archival master from the Disc. But in terms of reliability it's probably overkill and the added complexity and extra things to worry about could end up negating the reliability benefits.

I used to use tape to shoot my weather extremes and every year I would get camera failures due to dust and humidity, tape shredding due to moisture and drop-outs caused by dust and dirt. Since switching to XDCAM over 2 years ago I have a 100% reliability record with over 1,000 hours shot.

Steve Phillipps
May 18th, 2008, 03:30 PM
I'm sure you're absolutely right Alister, I just know that producers in particular can be a little nervous when they've spent thousands of pounds on a shoot which cannot be repeated and trusting some invisible data on a drive somewhere! Good to know you tested the material to extremes though, gives us a lot of confidence.
Steve

David Heath
May 18th, 2008, 03:54 PM
Now... I can see a situation where you might want to shoot to both SxS and Pro Discs to get the advantage of fast turn-around from the SxS cards plus an archival master from the Disc.
Yes, but there are also situations where you may want to shoot to disc only, and other situations where solid state only makes more sense. In the past, XDCAM has suited the former, P2 the latter. Now, the PDW700 with the SxS recorder or an XDR allows you to have one camera and choose media as appropiate. And in some situations, yes, shooting to both simultaneously makes sense.

It's not the physical reliability of XDCAM disc, SxS, CF or P2 or whatever that's being questioned here, just a fear that after a long day, possibly in non-ideal conditions, finger trouble sets in - "Format?"...."Yes".......... "OH..*&$%!!?*.

Greg Boston
May 18th, 2008, 07:23 PM
One of the scenarios discussed at NAB was the ability to shoot simultaneously to both media, then pull the card and hand to producer while camera operator continued gathering more material.

This is good for news deadlines in the sense that someone can start working on the story even as additional material is still being acquired.

The question then becomes, "Why not just pop the disc and give to producer as you start on a new one". The answer being that an SxS card can be shoved directly into a newer vintage laptop while the disc would require a large, stand-alone deck or the U1 drive. Speed and portability is what I feel they were thinking about.

-gb-

Alister Chapman
May 19th, 2008, 09:02 AM
It's not the physical reliability of XDCAM disc, SxS, CF or P2 or whatever that's being questioned here, just a fear that after a long day, possibly in non-ideal conditions, finger trouble sets in - "Format?"...."Yes".......... "OH..*&$%!!?*.

But that's the beauty of the optical disc system, you never need to delete them or format them. Click the tab over as it comes out of the camera and it is write protected.

David Heath
May 19th, 2008, 11:56 AM
But that's the beauty of the optical disc system, you never need to delete them or format them. Click the tab over as it comes out of the camera and it is write protected.
Sorry Alister, I may not have been very clear. The first paragraph was replying to you, the second to Steves last post (#5) and to what Dan said in his original reply. That in less than ideal conditions it's the solid state workflow that may lose confidence - not the hardware.

But what you say above is exactly why I think record to disc is the most appropiate thing to do on some occasions - on others it may be solid state, or both together. That's why I like the choice.

Dan Keaton
May 19th, 2008, 12:15 PM
Dear David,

I believe that you were using the "Format...Yes" as only one example of what can go wrong.

While formatting a flash card is not desirable, if one uses one of the widely available "Unformat" utilities, the data can be recovered, if action is taken prior to writting more data to the flash card.


Other cases are more insidious, such as thinking that one transferred the data to your hard drive, but not actually doing so.

To be candid, solid-state media does require more diligence.

Losing the data on a Compact Flash card is similar to writing over a tape before the footage is captured.

I do believe that the advantages of solid-state media outnumber the disadvantages. I for one would love to eliminate dropouts.

I also believe that the use of solid-state media or not will be an individual (or company) decision. Some will adopt it, some will not.

David Heath
May 19th, 2008, 03:13 PM
I believe that you were using the "Format...Yes" as only one example of what can go wrong.
Most definately, the point is that what people are concerned about is workflow, not the hardware matters you accurately outlined. I doubt anybody has much worry about a P2 or SxS card failing physically - but human error in the heat of the moment, having to free up space to continue working, is a different matter.
I do believe that the advantages of solid-state media outnumber the disadvantages. I for one would love to eliminate dropouts.
If the discussion was tape v solid state, then yes. But as this thread is "PDW700 workflow" then the options become disc, SxS, and CF if the XDR is used. All of these get over any drop out issue.
I also believe that the use of solid-state media or not will be an individual (or company) decision. Some will adopt it, some will not.
Well, a year or two back, when the choice for tapeless working was XDCAM disc or P2, period, then yes, you (or your company) had to go for one or the other. (Or sit on the fence and keep using tape.)

We come round full circle to Steves first post and what this thread is about - the PDW700 and possible workflows. Now, with an SxS adaptor or an XDR, it's no longer one or the other - use whichever is most appropriate on a job by job basis.

Dan Keaton
May 19th, 2008, 03:41 PM
Dear David,

I agree with all of your points. Your points are well taken.



Using solid-state media it is best to not delete files and then record.

This will work if the unit is not near the limits of performance of the solid-state media. However, if it is, then deleting files (with the possible exception of the very last file), will cause a fragmented file structure, which will cause a reduction in write performance.

It is best to format the media, then record.


With the cost of Compact Flash at approximately $160 for 32 GB, it should become feasible to have enough memory on hand to avoid the situation of having to delete a file, on an emergency basis, to make room for more recording.

If I was faced with having to delete a file, then continue recording on an emergency basis, I would record at 50 Mb 4:2:2, which is not close to the limits of performance of the Transcend 32 GB Compact Flash cards. Alternatively, the Transcend 16 GB Compact Flash cards are significantly faster and sell for $240 a card.

Phil Bloom
May 19th, 2008, 04:04 PM
I've just been filming a review of the 700 after testing it for a few days. The release version is missing a number of things, like 25p, but that will added in June with a firmware update. Freaked me out filming HD interlace, don't think I have done that before apart from on a z1!!

Nice build quality. Sexy camera (Is that wrong to say that?!)

The review will be up by the end of the week

Alister Chapman
May 20th, 2008, 12:36 AM
I think sexy is a good word to describe the 700.

Greg Boston
May 20th, 2008, 09:28 PM
I think sexy is a good word to describe the 700.

Not that it adds much to the discussion (shame on me), but I feel the F350 is pretty sexy in its own right.

-gb-

Simon Wyndham
May 21st, 2008, 02:31 AM
My only issue with the 700 was that it was too good!

The camera I used (I assume it is the same one Phil also used) came with a Canon HJ17 lens, and the 700 showed up every single flaw with it!

I'm beginning to get pretty depressed with the lenses on offer these days. There was CA all over the place, and some very soft edges despite shooting at around f5.6.

Phil Bloom
May 21st, 2008, 02:39 AM
Hey Simon

It's a production model that I used, not the pre production that I had last months, so the 25p wasn't working (firmware in June) and yes CA all over the place. It was 4.5 wide angle, nice piece of glass, bit too wide for most stuff!

Steve Phillipps
May 21st, 2008, 03:12 AM
Most are mediocre at best, and they cost anywhere from hideously expensive to insanely expensive. One of the main reasons I put reservation on a RED was so I could you good old fashioned film lenses again. Having said that I still do use stills lenses like Canon 300, 150-600 and 800 on HDCam with what I think look pretty good results. Less CA for sure than most video lenses. Sharpness looks fine to me too, though I know others would debate that it should with that combo. I put the 150-600 side by side on a cam with an HJ something or other at a BBC HD training day though and they looked about the same to all who saw it - in fact some thought the 150-600 had the edge.

Steve

Alister Chapman
May 21st, 2008, 04:57 AM
Glad it's not just me that's disappointed by the quality of HD Zooms. I guess as the manufacturers have been busy competing to produce longer, wider, higher zoom ratio lenses they have ended up with just too much complex glass. Maybe it is time to go back to basics and prime lenses.

Simon Wyndham
May 21st, 2008, 05:51 AM
I agree Alister. Because a lot of the work that I get involved in could afford the time to change lenses given the opportunity, I was seriously considering the possibility of primes. I'd imagine that the 700 would look superb with such glass.

One thing that I get extremely frustrated at is manufacturer claims of extremely low 'breathing' during focussing. I nearly always have to use the macro cheat to do pull focussing because the breathing on show on most of these lenses is absolutely horrendous.

On the HJ17 it isn't so much slight breathing as a full fledged zoom movement!

Steve Phillipps
May 21st, 2008, 06:01 AM
The first lens I ever used on an HD camera was on an F900 not long after it had come out, and was one of the Canon cine style zooms, something like a 14x7, no extender, solidly made, great handling and optically superb. Smooth contrast, no CA AT ALL that I could see, and sharp as a pin. Whether they still are this good or whether they've made "advancements" and screwed them up I don't know.
Steve

Greg Boston
May 21st, 2008, 01:27 PM
One thing that I get extremely frustrated at is manufacturer claims of extremely low 'breathing' during focussing. I nearly always have to use the macro cheat to do pull focussing because the breathing on show on most of these lenses is absolutely horrendous.

On the HJ17 it isn't so much slight breathing as a full fledged zoom movement!

Amen to that Simon! The HSs18x5.5 has some serious breathing issues. Fujinon claims to have that problem solved on some of the higher end 2/3 lenses by coupling the focus and zoom servos together such that the breathing is compensated for. Don't know how well it works or doesn't work.

-gb-

Dennis Dillon
May 29th, 2008, 05:37 PM
Hello all,
Just got back from the Galapagos. We used a 700, an EX1 Letus Ultimate, and a second EX1 in a Gates Housing. What a great time. The perfect set up. When the need for a quick shot, I just reached into a 507 Kata, and removed the EX1 w Century WA, then swapped to the EX1 Letus for the CU's. 2 Cameras in one sack. When diving the Ex1 was terrific. The 700 is so sharp. The lens is critical. I agree the 4.5 is too much. I'll post more later. I have to transfer all the material to 3 (1 TB) drives for post.

Alister Chapman
May 30th, 2008, 01:19 AM
I tell you Denis thats the kind of kit thats getting me excited (sad I know). I think the 700 is going to be a killer camera with a good lens. Pair it with an EX for the run and gun stuff there can be no excuse for shoddy pictures.

Simon Wyndham
May 30th, 2008, 05:56 PM
There isn't really any excuse for shoddy pictures these days anyway....

Well, apart from stupid midday summer shooting conditions, being told to shoot an interview ad hoc inside with a big window in the background, and not having enough ND and needing to shoot with the lens almost closed up ;-)

I can't get excited by the Letus. Nigel showed it to me and I found that the ground glass was visible at all apertures. They need to make the GG rotate rather than vibrate. Plus it made the EX weigh as much as a 350, but without the ergonomics! I want to shoot with a camera, not a Mechano set.

Give me a 700 all the way, but with one of those Canon Cinematography zooms, or primes.

Dennis ,need anyone else to tag along for a Galapagos shoot? I'd be quite happy to look after the kit on the beach ;-)

Alister Chapman
May 31st, 2008, 02:11 AM
The letus is a weird beast. Produces pictures that at first glance look nice, but after a while the novelty wears off.

No, I was just thinking of a stock EX1 or EX3 as being good for the situations where a full size camera like the 700 is too bulky.

I'de love to get a 700 but my clients have got used to my F350 and trying to persuade them to pay that bit more for each shoot is going to be tough. Perhaps next year when all the options are out.

Phil Bloom
May 31st, 2008, 02:25 AM
I can't get excited by the Letus. Nigel showed it to me and I found that the ground glass was visible at all apertures.


Then it can't be working correctly Simon. As I have been using it for over 7 months the only time I see the ground glass is if I close beyond f5.6

Greg Boston
May 31st, 2008, 03:47 PM
Dennis ,need anyone else to tag along for a Galapagos shoot? I'd be quite happy to look after the kit on the beach ;-)

Ha.... get in line Simon! The line forms right behind me. (grin)

-gb-

Simon Wyndham
June 1st, 2008, 08:07 AM
Then it can't be working correctly Simon. -

Oh it was, I'm just very finnicky! What I found was that on clear skies and other light plain colours I could see it. When the GG vibration is turned off, the GG is clearly visible, obviously. Then when it is turned on, I can still see it subtly. It stands to reason really with static GG.

AFAIK it was set up correctly. I can't think of anything else that could be changed or adjusted to change the situation.

Phil Bloom
June 1st, 2008, 01:15 PM
Oh it was, I'm just very finnicky! What I found was that on clear skies and other light plain colours I could see it. When the GG vibration is turned off, the GG is clearly visible, obviously. Then when it is turned on, I can still see it subtly. It stands to reason really with static GG.

AFAIK it was set up correctly. I can't think of anything else that could be changed or adjusted to change the situation.

Very odd Simon, I don't know what is wrong but I love my skies and shoot them all the time with the Extreme and only ever get patterns when I stop down past f5.6 I use a 23" Apple Monitor for editing and never see patterns in these shots. If I did I would never use it. No point. I have had patterns before but only when I stop down or the batteries are low. They have to be changed every four hours. Did you try putting fresh ones in?

Anyway back the the PDW700!! My video review will be up this week