View Full Version : New camera project! Need help with a few things...


Jose A. Garcia
December 6th, 2008, 12:21 PM
Hi all,

I'm glad to say I'm back with a brand new camera project! No industrial cameras, no demo boards, no minipcs. Just a 1920x1080 CCD sensor and FPGAs recording DNG sequences to a compact flash card. I can say little more about it because there's little more to say. Do I have the resources to do it? Yes, but I need your help to start it. Don't worry. I won't ask for money...

First of all I just need to know what would be the standard complete diagram with all hardware needed to go from the sensor to the flash card (including LCD output). Here's what I need:

- A/D conversion from the sensor.
- Basic sensor control. Shutter, fps, ISO, frame height/width... For now I don't need to know HOW to do it. Just the hardware I'd need to do it.
- DNG sequence conversion from the digital stream.
- Standard LCD out.
- Probably DVI out for monitoring.
- Of course, compact flash out.

Extra questions:

- Can everything I need be implemented into ONE FPGA?
- What other features would you add (appart from audio recording) to a basic digital cinema camera?
- Would it be possible to add pro quality audio recording?

I'm accepting all kind of suggestions on hardware, advices to design a speed/energy efficient system...

Thanks a lot in advance. It's good to be back!!

Jose A. Garcia
December 6th, 2008, 12:27 PM
I've got another question for people interested in sensors. I've got a few initial choices for fullHD or 2K CCDs (I want global shutter) but they're mostly 2/3" sized. Not bad. Many digital cinema cameras have them, but I'd like something a bit larger. What are my options for a good quality fullHD/2K 1", APS-C or full frame sensor? I know there won't be many of those out there but, I'd like to know if I've got other possibilities. Even if they're CMOS.

Thanks again.

Jose A. Garcia
December 6th, 2008, 06:01 PM
More questions. The camera will store the frames in DNG format and it's suposed to deliver up to 60fps FullHD. Will a fast compact flash card be fast enough to do it? Do you think an internal HDD is a better option?

Thanks.

Ali Husain
December 6th, 2008, 10:57 PM
Hi all,

I'm glad to say I'm back with a brand new camera project! No industrial cameras, no demo boards, no minipcs. Just a 1920x1080 CCD sensor and FPGAs recording DNG sequences to a compact flash card. I can say little more about it because there's little more to say. Do I have the resources to do it? Yes, but I need your help to start it. Don't worry. I won't ask for money...

First of all I just need to know what would be the standard complete diagram with all hardware needed to go from the sensor to the flash card (including LCD output). Here's what I need:

- A/D conversion from the sensor.

the a/d is always included on the sensor.


- Basic sensor control. Shutter, fps, ISO, frame height/width... For now I don't need to know HOW to do it. Just the hardware I'd need to do it.
- DNG sequence conversion from the digital stream.


DNG is basically TIFF with some special tags, which would be a pain to write in hardware. if you really want a ginormous sequence of DNG's out of your camera (remember DNG's are for still images not video), it's far easier for your camera hardware to write raw bayer data to flash, then wrap and convert those frames to DNG, or whatever format, upon flash ingestion with software running on your workstation.


- Standard LCD out.
- Probably DVI out for monitoring.
- Of course, compact flash out.

Extra questions:

- Can everything I need be implemented into ONE FPGA?
- What other features would you add (appart from audio recording) to a basic digital cinema camera?
- Would it be possible to add pro quality audio recording?

I'm accepting all kind of suggestions on hardware, advices to design a speed/energy efficient system...

Thanks a lot in advance. It's good to be back!!

Jose A. Garcia
December 7th, 2008, 06:40 AM
the a/d is always included on the sensor.

Even in CCDs?

John Wyatt
December 7th, 2008, 07:42 AM
I've been following the video DSLR subject lately, but always interested in these DIY experiments. Best of luck with your project Jose.

Juan M. M. Fiebelkorn
December 7th, 2008, 12:50 PM
Go for the Sony 24 Mpixel full 35mm CMOS.
It is fast, it's full size, and because you won't be using the full resolution it should give you the required framerate.

Sony Global - Press Release - Sony Develops 35mm full size CMOS Image Sensor with 24.81 Effective Megapixel resol (http://www.sony.net/SonyInfo/News/Press/200801/08-010E/index.html)

I don't remember it's number code, but I remember that is was around $400 dollars each if you are buying just one.

Good Luck

Paul Curtis
December 8th, 2008, 11:53 AM
Don't get me wrong but i have to ask 'why?' (and i love these threads too). I've personally dabbled with machine vision heads and piecemeal collections of bits and pieces and i've learnt lots about what goes into these things. So beyond the education aspect (which is reason enough to do it) are you looking to do this commercially? If so, isn't this exactly what ikonoskop have done?

I believe they are using one of the new kodak quad tap CCDs which should be available around now. I've used the previous generation (the KAI 2093) which was good but suffered vertical blooming too much for my tastes.

I don't think that sony 35mm would do (plus sony of all people aren't about to release a sensor that would cripple their video camera sales - the industrial vision sony CCDs, which are great quality, are all sub 1080 resolution)

And DNG is a valid way of storing the files, the white papers for cinema DNG are on the adobe site somewhere and feature meta data for black balancing, bad pixel mapping and other variables useful for moving image sequences.

cheers
paul

Samuel Hinterlang
December 8th, 2008, 05:29 PM
Paul,

Not trying to say your points are invalid, since they are very understandable. But it would be nice to see a camera that is open source/ publicly developed right here. I think it's healthy to get these kind of thoughts out in the open for discussion.

I think in the true spirit of creating something it's best to stay away from the "why" question and just enjoy the discussion, if for nothing else "the education aspect [is reason enough.]"

Sony does have their occasional schizophrenic moments. They sell software that can rip cd's but then they were trying to push DRM and the like. You never know.

The real sad part about sensors in general though, seems to be that manufacturers are always trying to push pixel count and the sensors are only a larger format to add to the count. The ideal sensor would have larger, more sensitive pixels, like a 2MP 1" sensor.

Jose A. Garcia
December 8th, 2008, 06:36 PM
Why? Why not?

I mean, you can choose from a huge number of different options if you want to buy a simple camcorder, a photo camera, a computer, a dvd player... If you want to buy an affordable digital cinema camera you've got what? 3 options? 5 by this time next year? The more options you have, the more possibilities you have to find exactly what you want.

So...

- The camera will have either a 1,2" 2048x2048 CCD or a 2/3" 1920x1080 CCD both by Kodak. Of course if it's the first one, this camera will have an interesting point against other 2/3" cameras.

- I need someone who can confirm that DNG is a good format for the image sequence and if a fast compact flash card will be able to store that sequence at 60fps. If not, at least at 25fps. What would be the frame size in FullHD?

- Do new CCDs have a built in A/D converter?

I'll try to post a basic diagram tomorrow, so I can tell you exactly what I want and you can say what's missing, what's wrong and what can be improved. It'd be great if someone could answer my questions...

Jose A. Garcia
December 8th, 2008, 07:37 PM
Ok, I couldn't wait. Here it is...

What's missing? What can be improved? What's wrong?

And...

- Which FPGA to use?
- Flash cards or internal HDD?

Thanks a lot.

Steven Mingam
December 8th, 2008, 07:59 PM
- I need someone who can confirm that DNG is a good format for the image sequence and if a fast compact flash card will be able to store that sequence at 60fps. If not, at least at 25fps. What would be the frame size in FullHD?

Well, you're probably big enough to do the math by yourself since we're talking about raw data here (and it's been repeated countless times in every single camera thread in this forum).
Here, just for you : 1920x1080x10x24 = 60MB/s
Fastest CF card is around 40/45MB/s, and that's if you can access it in UDMA mode... Not to mention that writing a lot of small files instead of one big reduce the performance _a lot_ on flash drives.
Had a look at the latest SSD drives ? Some are around 80/90MB/s (or more ?) in writing speed...

- Do new CCDs have a built in A/D converter?
Read the specs, luke. (AFAIR, the KAI-2093, yes)


Basically you want an elphel camera with a CCD sensor.... save you the hardship to redevelop the whole thing.

Jose A. Garcia
December 8th, 2008, 08:42 PM
Hi steven,

Thanks for the maths and the answer for the A/D converter. Those numbers are for raw data but is it the same for DNG files?

I've already considered SSD disks. It's probably the best option.

No, I don't want an Elphel. I want to build a pc-less camera with its own lcd and controls.

Paul Curtis
December 9th, 2008, 04:27 AM
Jose,

Once i posted my comment i was a bit concerned about being overly negative, my aim was perhaps to avoid a lot of expense for you in re-inventing the wheel.

Your aim is pretty much identical to ikonoskop and their camera ships soon and doesn't seem that expensive, although they have had to make their own solid state storage to handle the demands of 60fps RAW DNG files.

Your biggest problem with a sensor over 1" will be lenses. There are very few good lenses with that coverage. There are some fujinons with an image circle that size but you'll miss out on all 16mm and S16 lenses out there. You can convert APS-C style lenses but you'll miss out on fast and wide choices. If you want to make a camera that can actually be used for shooting you need to be able to focus on the run, the lens is key to this. Machine vision lenses are *not* ideal for this (this from experience). I would stick to 2/3rds sensor size if i were you.

Also performance wise one of the biggest differences between available CCD sensors and those sensors in high end cameras is vertical blooming. The Kodaks are okay but not good enough (imho) for practical use outside out and about. I cannot comment about the new generation though and they may be good enough now (the quad tap ones). Sony have some fantastic sensors with FIT but are not available (they're the ones used in their cameras). The only good sony ones available to buy are lower resolution and 4:3

If i were you the first thing to check would be the availabily of lenses that would work for you and also the performance of the new kodaks with regards to vertical blooming.

I think your only practical CCD choice is that new 1080p Kodak quad tap sensor...

cheers
paul

Jose A. Garcia
December 9th, 2008, 06:39 AM
Hi Paul,

Thanks for your answer.

I know this project looks pretty close to what an Ikonoskop camera will offer soon, but as I said, appart from the educational value, i can't see the problem in having many options to choose from. In fact, there're SSD disks out there with 90Mb/s sustained writting speed for about $400. Without the need to develop a new storage card, this camera will probably end up being cheaper.

About the lenses questions, I know there're many good quality and cheap machine vision (fujinon, computar...) and s16mm old lenses out there for a 2/3" sensor. I started gathering info about the 1,2" CCD because I saw what the NoX camera from GS Vitec can do appart from the shallower DOF. You're also forgetting the new Micro 4/3 format. Those lenses cover about a 18x18mm area, that's only 3mm more than the 1,2" sensor and they're photo lenses. In terms of focus, it's like working with a 35mm adaptor.

What do you think?

Steven Mingam
December 10th, 2008, 04:28 AM
Well I was talking about the Elphel because with little work (way less than re-designing an entire camera) you could have it PC-less. It already record directly to disk, so with some empty pins on the extension boards, or a hacked usb-keyboard, you could easily control it without the ethernet hassle. Just a bit of software programming... which is less time consuming. If I had some money I would buy an elphel and start hacking it but I'm dead broke :P
At least it already deliver pictures as it is.

Sebastian Pichelhofer
December 10th, 2008, 05:30 AM
Hi steven,

Thanks for the maths and the answer for the A/D converter. Those numbers are for raw data but is it the same for DNG files?

I've already considered SSD disks. It's probably the best option.

No, I don't want an Elphel. I want to build a pc-less camera with its own lcd and controls.

You might not want the Elphel camera of the past, but you will want the future Elphel Vision camera that is currently being developed:

http://www.dvinfo.net/conf/975061-post1000.html

open source of course!

Jose A. Garcia
December 10th, 2008, 08:52 AM
Looks good, but it still has a 1/3" sensor and compressed RGB out. The Elphel is a great camera. It's like the only camera project here that's still alive and getting better every year. It gives a great image, full control over the sensor and it's quite close to become an independent camera, but still lacks a few features needed for cinema work.

By the way, it's now confirmed that the first version of the camera will have a Kodak 2/3" CCD with anti-blooming, low smear and 60fps.

Now we have to focus on the diagram I posted. Is that everything the camera needs? What's missing? What's wrong? What would be the perfect FPGA to use?

Sebastian Pichelhofer
December 11th, 2008, 04:06 AM
Looks good, but it still has a 1/3" sensor and compressed RGB out. The Elphel is a great camera. It's like the only camera project here that's still alive and getting better every year. It gives a great image, full control over the sensor and it's quite close to become an independent camera, but still lacks a few features needed for cinema work.

By the way, it's now confirmed that the first version of the camera will have a Kodak 2/3" CCD with anti-blooming, low smear and 60fps.

Now we have to focus on the diagram I posted. Is that everything the camera needs? What's missing? What's wrong? What would be the perfect FPGA to use?

If everything goes well the next Elphel camera will be the first video camera with an APS-C sized sensor.

I already demonstrated an "almost" uncompressed RAW video workflow here: http://www.dvinfo.net/conf/947828-post970.html
Not very production friendly but as a proof-of-concept it worked quite well.

But you are right, there are still many things to do. But we won't give up ;)

Jose A. Garcia
December 11th, 2008, 06:51 AM
If everything goes well the next Elphel camera will be the first video camera with an APS-C sized sensor.

Mmm... That sounds really good.

Jose A. Garcia
December 17th, 2008, 06:02 PM
Still working on the camera! Does anyone know of options to include high quality audio recording?

John Wyatt
December 18th, 2008, 05:33 AM
I got a reasonable price digital sound recorder earlier this year called the Zoom H2 which which can do 48 kHz at 16 or 24-bit (or even at 96 kHz if you need that). Records to SD or SDHC memory cards and just needs 2x AA batteries (alkaline or re-chargeables), or can take power from the mains. Has a USB connection for dumping files or connecting to a computer as an external mic (I haven't gone into that functionality). Has a standard tripod thread on the bottom so you can fix it to a camera tripod or mic stand. Very light unit, onboard mic is quite good but you could plug in another. Would need to adopt syncing method (like traditional clapperboard) if the unit is not locked in some way to the camera.

Samuel Hinterlang
December 19th, 2008, 10:46 PM
I'd agree with the basic theme John has. Just find a way to record the audio in a standard way and sync in post. I've had enough times I was doing that for mic'ing several people or got a mix from and audio engineer and never had an issue getting the audio to just plop down. If there is a time difference, it'll only go out of sync over really long runs.

John Wyatt
January 23rd, 2009, 03:21 PM
Jose -- anything new with the camera project?

Jose A. Garcia
January 23rd, 2009, 07:19 PM
Still working on it. These things take their time. I'll post news as soon as I can.

John Wyatt
January 24th, 2009, 07:24 AM
Thanks, look forward to hearing your progress.
John.

Jose A. Garcia
February 28th, 2009, 10:23 AM
Hi all,

I'm very proud to present the very first official images shot with our camera! Of course this is all work in progress and we don't even have white balance included yet, but it's a huge step for us since these images have been captured using our own hardware and software, so we're getting closer each day.

http://www.cus-cus.net/cameratests/screencap01.jpg
http://www.cus-cus.net/cameratests/screencap02.jpg

These images are directly from the sensor. No alteration has been done besides converting them to JPG. They were taken with my Computar 12-75mm megapixel zoom.

For now I can say we're very happy with the initial tests. The noise levels from the Kodak sensor are amazingly low even in very low light situations and we're getting new and better results everyday.

I'll post low light, DOF and detail tests as soon as I can.

John Wyatt
March 1st, 2009, 05:28 AM
Thanks for posting those frame grabs!

Are you shooting a DNG sequence as originally planned?

Jose A. Garcia
March 1st, 2009, 09:26 AM
As I said, these images were just extracted from the sensor using one of the first versions of the software and converted to JPG.

I can't answer to more questions for now because I'm only part of the project as a consultant, but I'll keep you updated on a regular basis.

Jose A. Garcia
April 17th, 2009, 04:49 AM
Hi all,

I'm sorry I didn't pay attention to this thread lately. We've been going through a lot of stuff.

The camera we were developing now has a name and it's becoming something big. We already have a couple more threads started in other forums with good results.

Now let me introduce to you THE SPARTA (Cineraw - Sparta (http://www.cineraw.es))

The Sparta is (as you may know from previous posts) a new cinema camera with a single 2/3" CCD giving beautiful DSLR like images at up to 60fps and recording them to selectable raw DNG 12bit or PNG 8bit format using solid state disks.

If you take a look at the page, you'll find all info available to the public in a PDF document. For anything else, just post here or mail me.

Thanks.

Jose A. Garcia
April 17th, 2009, 04:56 AM
Today is a very important day for everyone involved in the Sparta development.

It's my pleasure to announce that this september Cineraw will be in Los Angeles, CA presenting working units of the Sparta and talking about its features and, most important, its workflow.

We'll be giving more info as the day gets closer. More info in our website very soon.

You're all invited to come and join us in the Sparta Week!

Chris Hurd
April 17th, 2009, 07:24 AM
I'm sorry I didn't pay attention to this thread lately.

We already have a couple more threads started in other forums with good results.Interested folks should direct replies to:

New cinema camera coming very soon: SPARTA - DVXuser.com -- The online community for filmmaking (http://www.dvxuser.com/V6/showthread.php?t=167373)

That's where all the action is for this particular topic. Thanks in advance,