With the arrival of the Canon XL-H1 and other cameras with uncompressed SDI or component output, I am wondering if there is a portable capture device. Otherwise what is the point of this output, short of studio use?

My ideal device would be battery powered and consist of THREE 1.8 Inch Hard Drives (the same ones used in the iPod).

These three drives would be in RAID 5 configuration. So even if one hard drive failed, the footage would not be lost.

The current capacity of these hard drives is 60GB. So in RAID 5 you would get 120GB of capacity. However very soon 100GB 1.8 hard drives are coming, so then the capacity would be 200GB.

This device would have a circuit board that would take the SDI stream and in real time convert to a motion-jpeg based codec, like DVC-Pro or HDCAM, keeping the 4:2:2 color info. Something like 100-200 MBits/sec. The RAID 5 could handle this data rate easily.

So at 100 MBits/sec, 120GB would yield 163 mins and 200GB 271 mins.

The OEM cost of these three hard drives would be about $500. Add $200 for the circuitry and other material costs and add another $300 for profit.

So that is $1000 total.

Weight wise I estimate no more than 500 grams or 1 pound with the battery.

So is there (or will there be) such a device for $1000???

With the arrival of the Canon XL-H1 and other cameras with uncompressed SDI or component output, I am wondering if there is a portable capture device. Otherwise what is the point of this output, short of studio use?

My ideal device would be battery powered and consist of THREE 1.8 Inch Hard Drives (the same ones used in the iPod).

These three drives would be in RAID 5 configuration. So even if one hard drive failed, the footage would not be lost.

The current capacity of these hard drives is 60GB. So in RAID 5 you would get 120GB of capacity. However very soon 100GB 1.8 hard drives are coming, so then the capacity would be 200GB.

This device would have a circuit board that would take the SDI stream and in real time convert to a motion-jpeg based codec, like DVC-Pro or HDCAM, keeping the 4:2:2 color info. Something like 100-200 MBits/sec. The RAID 5 could handle this data rate easily.

So at 100 MBits/sec, 120GB would yield 163 mins and 200GB 271 mins.

The OEM cost of these three hard drives would be about $500. Add $200 for the circuitry and other material costs and add another $300 for profit.

So that is $1000 total.

Weight wise I estimate no more than 500 grams or 1 pound with the battery.

So is there (or will there be) such a device for $1000???

Why would you compress an uncompressed signal? Motion-jpeg based codec, like DVC-Pro or HDCAM are all compressed formats. Are you trying to get around the HDV compression? Why not just get an HVX?

Why would you compress an uncompressed signal? Motion-jpeg based codec, like DVC-Pro or HDCAM are all compressed formats. Are you trying to get around the HDV compression?

Because uncompressed data is HUGE and beyond protable means at present, and that high rate codecs are close to uncompressed anyway.

And HDV is poor for fast motion AND also 4:2:0.

So DVCPro or HDCAM are good compromises...

With no practical way to encode in an existing HD format, such as DVCPRO HD or HDCAM because those licenses are most likely unobtainable, you'd be looking at creating your own compression format, which would negate any hope of editing without creating a conversion application to go with it. So capturing uncompressed is probably the best way to go. But at nearly 1.5 gigabits per second uncompressed HD coming from the XL H1, even a 200GB RAID configuration would be extremely limited in usable recording time.

I can't do math on weekends... how much time would a 200GB disk array allow at 1.485Gbps?

how much time would a 200GB disk array allow at 1.485Gbps?

Firstly and sadly 200GB = 186.26GB - because greedy Hard Drive manufacurers use the definition of GB as a "billion bytes" and not 1024 to the power 3.

1.485 Gbits/sec = 0.185625 GB/sec (divide by 8 to get bytes from bits)

So now we divide the number of GBs 186.26GB by the rate of GB/sec to get the total number of seconds available:-

186.26 / 0.185625 = 1003.445 seconds or just 16 minutes and 43 seconds!

MOREOVER, I doubt a RAID 5 array of 1.8 inch drives can handle 1.485 Gbits/sec!

1.485 GBits/sec = 190MB/sec

Only a RAID-5 array of 10,000 rpm 3.5 inch drives could handle that - barely!

See this:-

http://sdd.toshiba.com/

The Toshiba 1.8 Inch Hard Drive 80GB, weighs only 62 grams and the power consumption is only 1.1 watts.

Sadly the Internal (i.e. REAL) data transfer rate is 164.3 - 341 Mbits/sec. This varies becuase the inner sectors transfer at less than half the speed of the outer sectors.

So assuming 164.3 MBits/sec = 20.5 MB/sec

Three drives in RAID 5 would get about double that. So we are looking at 40 MB/sec or 320Mbits/sec - fine for HDCAM, DVCPro, etc, but NO WAY for uncompressed!

I did some more math and came up with the uncompressed output as 711 Kbits/sec about half of the 1.485 Gbits/sec that Canon claims. So what am I doing wrong?

The resolution is 1440x1080. So each frame has 1,555,200 pixels or for fields it is 1440x540 and 777,600 pixels.

No multiply the number of pixels in a frame by 29.97 or the number of pixeld in a field by 59.94 and you get 46,609,344 pixels per second.

Now with the color space of 4:2:2 each pixel takes 16 bits of data. So multiply 46,609,344 by 16 and you get 745,749,504 bits of data per second or 711 Kilo Bits per second (divide by 1024).

More thoughts on uncompressed capture:-

If my math is correct then the data rate for uncompressed capture is about 700 Mbits/sec.

If one was to use a lossless codec (like huffy), that could come down to 300-400 Mbits/sec.

So then you could get an hour of video on 200GBs and it would be uncompressed. The data rate would still be out of reach for an 1.8 inch hard drive array. BUT it would be well in reach of a 7200rpm 3.5 inch hard drive array and also possibly an array of 2.5 inch hard drives as used by notebook computers...

Remember that HD-SDI data is full 1920x1080 resolution, so that's 2,073,600 pixels per frame x 29.97 fps = 62,145,792 pixels per second, times 24 bits/pixel = 1,491,499,008 bits per second or 186 MB/sec. The latest SATA II RAID controllers are delivering write speeds well in excess of that amount, for example as shown in these 3Ware benchmarks: http://www.3ware.com/products/benchmarks_sata2.asp.

On Pricewatch.com, good 400GB SATA hard drives are selling for $207 each, or $1656 for 3200GB of pre-formatted capacity. Round that down to maybe 3100GB after formatting and you've got ~3,100,000 MB of capacity, or enough to capture about 4.6 hours of full uncompressed 8-bit 4:2:2 video. Add the basic components for a computer plus a good RAID controller and an HD-SDI capture card, and you've got that much uncompressed capacity for under $5000 if you're frugal about it. Compare that to Cineform proposing to ask $15K for ~14 hours of ProspectHD recording in the form of the Wafien drive, and the cost of these two options is comparable per hour of recording time. Of course you could build your own ProspectHD capture setup for a lot less, and few people really need to work with uncompressed HD, but at least you've got some choices.

Now the question becomes, what's your definition of portable? If you could capture several hours of ProspectHD or uncompressed video in a computer costing a few thousand dollars and powered by a portable AC generator, would that work? If not, your best bet may be to consider the Panasonic HVX200 with the external Firestore hard drive due out next March.

single link hd-sdi like on the xl hd1 is actually 2 channels @ 1920*1080 at almost any frame rate (24p has 2750 samples per line, 1920 active, 25 has 2650 but still only 1920 active and 30p has 2200 but still only 1920 active). These channels are 10 bit each. So your datarate for 1080 @ 30p is 148 MB/s.

I'd be very surprised if the 1.8" toshibas can handle 160mbits because even the faster drives like hitachi 7k60 2.5" drives have the slowest speed being around 20Mbyte/s which is only 160mbit (see http://www.xbitlabs.com/articles/storage/display/hitachi-25-7200_10.html)

Likely that number that is listed on their website is the maximum theoretical performance that cannot be achieved in real world situations. So your looking at about 8 - 10 of these drives to do a hd-sdi capture at least (uncompressed). The only data rate that really matters is the slowest if you want to use the entire disk.

Likely that number that is listed on their website is the maximum theoretical performance that cannot be achieved in real world situations. So your looking at about 8 - 10 of these drives to do a hd-sdi capture at least (uncompressed).

My point was that you can build a computer with an HD-SDI capture card and a fast 8-drive RAID array holding several terabytes of data for a few thousand dollars, and that's something you could easily carry in a car (or even a golf cart) along with a portable power source. And even assuming the 3Ware benchmarks are generous, they've got overhead of almost 100% compared to uncompressed HD data rates in an 8-drive configuration. Plus data rate drop-off on modern hard drives is typically not very significant across at least 75-80% of the drive, so you wouldn't lose a huge amount of capacity to that consideration. And lastly, given the option of capturing instead to something like ProspectHD or Avid DNxHD, concerns about drive performance would be irrelevant for a full computer-based setup.

So the only practical problem here is having an HD recording solution which is truly portable, in the sense that you don't have to be plugged into an AC power source to use it. So far it looks like Panasonic has the lock on that for high-bandwidth recording, and it's a simple matter now to record HDV on the run to either tape or drive based options.

There has to be a line drawn here. That is, when you have so much gear along for the ride, that you might as well just rent a high rez HD camera with decent glass, and a small crew to wrangle the cart and cable along.

The H1 will provide a balance of 4:2:2 SDI in studio or location shoots, but for run and gun, you'll have to see how nicely the HDV material will cut in, (never mind the compressed audio, that is whole other issue).

Bottom line, we've now defined how consumerish these HDV camera's are.

Greetings all; just back from the my training session on the XL H1. I have read the post and reply, but a proper hard drive for the SDI or HDI output of the camera is going to need to be considerably more powerful if you want uncompressed video. Since the uncompressed signal on the H1 is 1.5 gigabit, a hard drive recorder will need to either compress the signal, or have enough data throughput to handle either SDI at 8 bit uncompressed, or 10 bit, or if possible, the 8 or 10 bit HDI signal. This is a complicated process to connect the drives, the controller, and the video input device. This will be a work in progress. There is a device coming soon that offers compression, and I have asked several companies that make similar products, and I await reply. I will be posting information as I have it.

thanks brian, http://www.zotzdigital.com

So how do the big boys do it? Scott Billups captures 4:4:4 progressive HD from a Viper right into his G5 with a Blackmagic DeckLink HD Pro card. Judging from the picture here (http://www.blackmagic-design.com/casestudies/historychannel/) it looks like he's got HUGE Systems' 4Gbit MediaVault 4105 (http://www.hugesystems.com/Products/) that can handle 300MB/sec dual, and it's only $3,600. His system looks pretty portable to me.
Granted, you're not going to run through the woods with it, but that's what Firestore's FS-4 HD is for.

Their already is some uncompressed hd-sdi solutions available. Some russian company says they have a flash based one at ctt.ru and their are definetly some other things in the works. When The XL HD1 gets out i suspect their will be products available shortly after that will do some amazing quality either uncompressed or lightly compressed and actually be portable.

sorry, didn't get an email that there were follow ups;
Everthing here is a matter of capture with, or without, compression. Uncompressed with Viper, but we are talking about a portable battery powered field unit for capturing these signals, which is where the compromise has to come in, at least for now. the Firestore and other devices for as much data as there is in and SDI or HDI type signal, and the various levels of HD, will require multiple DC powered drives to make this work,

a 4 gig fibre channel, dual 5 drive (4105) from Huge will be fine for capture of an HD signal even in 4:4:4, it is right up to the edge of what a 5 drive can do though and still leave you enough headroom to view other things in real time, without rendering. Overkill is not a fair description of what you get when you have more drive speed and space than required. That means ease of use, extreme speed. A Huge 4 gig fibre, 10 drive model, (4210) would likely do 12, maybe 14 real time streams of SDI video. Their 320R SCSI would do 6 or more (all on a Mac G5 mind you, 4-8 gigs RAM) But HD is demanding when you are talking about a 1.5 gigabit stream coming from the new XL H1. that is 187.50 megabytes per second sustained data requirement, in 4:2:2. If you want real 1080i, you have it. no questions, hands down, no compression, no BS. This is why 4 gigabit, raid 3 (at least) dual channel, and 10 drives at least, will make 500/600 megabytes/second sustained/burst data rates. This gives you a real time stream or two with your effects. You don't have to render everything, the effect won't hitch in preview, etc. but most important, it allows you to work with the best stream of video that most people can afford. 1080i uncompressed HD is pretty powerful. Check the Sony CineAlta and Panasonic Varicams and what you will spend on one of them. Check their output spec for video at 4:4:4 and 4:2:2. Figure 80K on up, no deck.
Headroom is not overkill, it is that extra speed to keep you running free of issues. it's nice not to have issues. This is why it is better to work with a G-Technology Graid, two drive raid, than a single external firewire drive on a laptop, same thing with SCSI, it is fast, but not as fast as the fibre, on up to the very fastest fibre systems. The more headroom, you get more speed and stability as you edit, more stability when you capture. Remember, if you are renting a deck at $2000 a day to capture to, and have a deadline, budget, etc... the last thing you need is a problem.

but back to DC powered drives;
I hope it soon, but it could a while before someone makes a DC powered hard drive set that can handle at least uncompressed SDI in the field. HD may take a while. Compression is everything. The pocket drives used for the firestore and laptops are perfect, they need a backplane like the Medea and Huge Systems have to give it this speed of data transfer
Since I last posted, I have also asked G-Technology, AJA, and Medea if they would consider this type of small drive array that will allow us to capture uncompressed for about 3 hours, at least and at minimum, downconvert HD to SDI for 10 bit capture (8 will be acceptable, but oh, when we can do real HD!) that would be like having DVCPRO50 in an XL H1, as the image capture quailty would be greater resolution at 1080i, but compared to a very good camera indeed that has larger chips and a very good Canon Broadcast lens, it's 40K price tag may not be worth the difference of a Canon XL H1 down res'd to it's capture level. A complete XL 1H kit is affordable, and really blurs the lines between the higher priced cameras for a lot of videographers. It is worth seeing. It is a considerable difference in cost, the difference in picture, is yet to be seen. Give it a couple weeks now.


the great part is, connect an AC cable to these daytime DC drives at the end of the day to your G5 (or even another type of computer) and start editing the way you can do with a firestore. It may become the field shooters only drive set required. Hope we see this option real soon. brian

Wafian just got some pics up on their website of the HR-1 cineform compressed HD-SDI recorder. Great as a field deck but seems more like a computer in a nice box with an lcd than anything.

However, it is closer to a price more people would be willing to explore (15k) but is definetly suited only for studio or a powered set location. Definetly cheaper than HD-CAM or HD-CAM SR, but not really as portable.

I have talked with Dave at Cineform. I am looking forward to seeing the product. Chris and I talked about the likely hood of being able to see everything by the NAB show, maybe even all in a row! That would great. HDV should be well rounded by then.
I hope you weren't really hit by a yukon? yikes. brian

In today reality is only one portable capture device with hd-sdi input at affordable price is Flash DVR:

# NTSC, PAL, HDTV 720p/60, HDTV 1080i/23.976, 1080p/23.976, 1080i/24, 1080p/24, 1080i/25, 1080p/25, 1080i/29.97, 1080p/29.97, 1080i/30, 1080p/30, 1080i/60;
# UP to160 GB
# 330MB/sec speed
# BNC HDSDI in SMPTE292M/SMPTE259M;
# BNC HDSDI out SMPTE292M/SMPTE259M;
# Multiple formats in same time
# embeded audio support
# RS-232 Remote Control ( Sony 9-pin Protocol);
# size 170х270х50 mm
# power 12 V, 0,3 А.
# 8" TFT LCD option
# LVDS or SCSI option
# FC option
# 4:4:4 option
# OEM
# Pocket PC control option

info from theme "HD-SDI Recorder: http://www.dvinfo.net/conf/showthread.php?t=52964
base model have 20GB on board, 3min in HD or 6min with LS codec.
also 40GB, 80, or 160GB models possible too.HDSDI IN/OUT, 8" TFT LCD option. price from $4800 USD

Flash DVR with Aja component-to-hdsdi convertor for JVC HD100 much better
and portable solution than Wafian recorder, imo.

Well, something needs to give... I tried the HVX route, and gave up on swapping cards (it's not a realtime 1:1 copy either). I wound up dragging my dual xeon workstation, LCD monitor and keyboard out and used Edius 4.0. Even my internal scsi raid 0 gave fits on a few captures, requiring restarts. I had to endure a long post converting the files over to cineform and using two raids. One to hold the raws and the other to save the conformed. What a mess, (see attached image).

I just like something better than HDV, 10bit and clean enough to pull a key without picking up the garbage matte tool and dragging points.

I may just build a shoebox PC with small raid, Xena PCIe card/cineform solution and drag that around.

Only option currently, the Grass Valley Turbo DDR's. Faster, but pretty expensive.
I have quite a few clients doing HD/SDI out from the Canon XL H1 to MacPro's and G5's with the AJA and Blackmagic cards, fibre channel raids to handle the input of data at that rate. They report great results, but they are hardly portable, and require AC. This seems to be the only interim solution that allows uncompressed capture other than a deck. But that still allows you studio work with a complete camera and editing system for less than the cost of a tape deck that would handle that signal.

when I know more, I sure will post it.

Maybe this is a silly idea, but what if Apple got together with an HD capture card maker and Cineform to build a laptop with HD-SDI ingest capability? I'd bet that's technically feasible today with a little creative engineering...

I agree. That's a great idea.

I'm trying to put something together for laptop capture of HD-SDI, using a PCI adapter card and some Caldigit drives. Then I've got to figure out how to get Prospect HD ingest to work with this setup. It sure would be easier if someone would just create one. The demand would be there. When all is said and done, this solution may not work due to limitations of the laptop when connected to the Xena LH card...

tooooooo big.

trying to find something portable, and preferably that will mount on the rear bracket. Also, DC powered.

At least with a shoeboxed side recorder, it can be one piece and mounted to a cross-bar on a tripod directly beneath. Then only one power cable to wrangle. Not ideal if your following a shot, but manageable for short runs or fixed. A shoebox sized PC will allow a full size capture card and two or three disk array. Essentially it's full powered workstation and can be used for field editing, and with a dual processor mobo, a better option vs a laptop.

Look at this companies recorders...
Probably expensive....

http://www.keisoku.co.jp/en/product/vw/recorder/udr5e/index.html

These are worth a look, bare bones shuttles:

http://sys.us.shuttle.com/Scgsupport/NewProducts.htm

Run about $500. Spend another $2k in graphics, capture card and hard drives. Much cheaper, and more than just capture solution as it's a portable edit station. Hmmmm.

Think I'll try this out, it's worth a shot.

Hi Peter,

These mini-PCs look very promising for a reasonably portable solution. What type of solution are you looking at for the actual capture of the HD-SDI signal? In other words, are you looking at Prospect HD ingest, or just straight, uncompressed HD? I'm trying to figure out a way to convert the HD-SDI stream to smaller file sizes without HDV compression. Prospect HD ingest is $3000! Not what I'd call a reasonavble priced solution.

Also, have a look at Caldigit's new drives. I spoke to them about this type of solution. They were apparently behind the design of G-RAID's drives.

Stuart

Actually, I'm solving two solutions. I'm thinking about a cineform-prospect intermediate solution with a xena card. Since I already edit with PPro, this will fit in with my existing workflow. Having a full raster 10bit avi, but at cineforms compression will allow me to use a small array (I think), and is a better compromised over raw uncompressed.

The other point is having a small, portable workstation on hand. So, back at the hotel or for extended stays, I can setup shop and edit away. No sense in wasting real-estate. I can find room in one of the pelicans for LCD and keyboard.

Sure, I could get a $5K box that just records, then I'd have hook it up a laptop for editing, and a decent one that will do the job is around $3500.

Maybe it's more like $3500 all said an done. But cheaper and more useful still.

Maybe someone from Cineform would like to chime in.

I'm in the same boat as you. It would be great to have the little box for grabbing the HD-SDI output AND being able to do some editing in the evening. I'll need to take a closer look at Cineform's software. I'm using PPro 2 as well, along with the rest of the suite. I'd love to avoid the $3000 for Prospect HD ingest and just convert to Cineform avi files after capturing the uncompressed footage (with their less expensive software). I don't know enough about their software to know if the cheaper versions will convert uncompressed HD. With a 1.5TB Caldigit SATA RAID, I'll have the room to capture and convert.

By the way, what camera are you using? Since I'm still waiting for the contract on the HD production, I have not bought yet. I'm leaning heavily towards the XL H1 and/or the G1. The HD-SDI capture might be the finalizing factor. This will be corporate work, so 60i should be fine.

I'm getting a G1 for the HDSDI (for those jobs that need). But I won't be capturing via SDI for every job -overkill. So firewire and cineform would do.

As a side note, I watched a demo of the Newtek Tricaster. They also use a shoebox/shuttle PC and house a full sized VideoToaster card in it, and use a limited version of their software to capture SD material. The benefit was a larger housing for the full sized card, better heat sinks and fans, and a mobo that can accept a more robust processor. I think you can dual processor boards now -which rules out laptops.

I have a long weekend and a lot of turkey sandwitches to pour over the details. I might be able to build one from tiger direct, or modify a base unit to suit.

Don't eat too much turkey... that trytophan will get you! LOL! My biggest problem is which part of the leftovers to eat first - turkey or stuffing?

Sounds like you'll have fun putting this together. I'll take a look at Tiger Direct as well. By the way, I spoke to someone at Caldigit who said he'd work with me on "special pricing" if I want to buy their drives. The SATA 3gb/s solution they're offering won't be available until later in December (the one with up to 1.5TB capacity). If you're interested, let me know. I'll see if he'll do the same for you. I think they're trying to build their name in the video editing world.