|
|||||||||
|
Thread Tools | Search this Thread |
August 19th, 2005, 11:31 PM | #16 | |
CTO, CineForm Inc.
Join Date: Jul 2003
Location: Cardiff-by-the-Sea, California
Posts: 8,095
|
Quote:
__________________
David Newman -- web: www.gopro.com blog: cineform.blogspot.com -- twitter: twitter.com/David_Newman |
|
August 20th, 2005, 12:18 AM | #17 | |
Major Player
Join Date: Jan 2004
Location: Katoomba NSW Australia
Posts: 635
|
Quote:
It seems still, that the fact that HDV was concocted as a video camcorder format for those wishing to complement their HDTV purchase is lost on those who dream of having a low cost camera that will replace film based cameras. The further fact that MPEG2 is the broadcast format for HD signals is also somewhat of a comprehension sticking point for many. While some companies will 'massage' the paranoia of those who don't fully understand what the HDV format is all about by releasing HDV camcorders with 'user requested features'; the fact remains that HDV was never intended as a film replacement format. Even those who fanfare H.264 and MPEG4 as MPEG2 replacements are whistling up the drainpipe. They may be better in some peoples minds, but as HD is currently being broadcast using MPEG2, the cost to broadcasters and consumers alike in purchasing hardware that is able to encode/decode an as yet unsupported broadcast format would prohibit an easy transition. One day in the future, there'll be affordable to the Joe Bloggs of the World digital camcorders with image quality to match 35mm film... with true 24p etc, etc. It just won't be today. |
|
August 20th, 2005, 12:25 AM | #18 | |
HDV Cinema
Join Date: Feb 2003
Location: Las Vegas
Posts: 4,007
|
Quote:
Actually, 24fps IS an ATSC standard (Table 3) and folks continue to claim it is used for movies. I think it NOT used, but every HDTV is supposed to decode it. The problem is, that to be useful, all HDTVs would have to support 72Hz refresh, which they don't. --------------------- "24p is put into 60p just like 24 is put on a 60i DVD, only 24 frames are encoded, but 60Hz presentation is predetermined with repeat flags (i.e. there is no native 24p DVD." So it does NOT work like the DVX100 where 24p uses 2:3 pulldown to get 60i. Right? Nor does it work like film where only 24fps are recorded -- which would lengthen record time. (Panasonic claims they will truly record only 24fps to SD cards!) ------------------------- Anyway, I'm still confused. Only 30 -- not 60 frames -- are RECORDED to tape otherwise the tape duration would be cut in half. So the 24 frames have to get placed within 30, not 60 frames. That requires 6 REPEAT frames per second. WHICH of each 24 frames is repeated and flagged? -------------------------- And, what gets sent down the i.LINK cable? 30 frames/second with 6 flagged frames or 60 frames/second with 12 flagged frames? This question relates to the 30fps mode. In the HD1/HD10 only 30 frames/second were sent via i.LINK. Does the HD100 send 60 frames/second? If so, then it feeds 720p60 into your NLE. (Of course, each frame has been doubled.) --------------------- Whether 30 frames with 6 flagged or 60 frames with 12 flagged frames come via the i.LINK -- which, if any, NLEs understand "Flagged Repeat frames?" They are used to working with 24fps with 2:3 pull-down because that's how film comes in. Which leads to THE critical question. Will the repeat frames be dropped during capture so that 24fps video is stored to a file. Or, will 720p60 be stored to a file and when the video used -- the flagged frames will simply be ignored. Clearly the former is better as it saves storage space and reduces disk bandwidth. Which will ConnectHD and AspectHD do?
__________________
Switcher's Quick Guide to the Avid Media Composer >>> http://home.mindspring.com/~d-v-c |
|
August 20th, 2005, 01:05 AM | #19 | |||||||
Wrangler
Join Date: Oct 2002
Location: Los Angeles, CA
Posts: 2,100
|
Quote:
Quote:
Quote:
Quote:
Quote:
Quote:
Quote:
Apple deals with the whole HDV mess by using a HDV component for Quicktime...so all of a sudden pretty much ANY program that works with video on the Mac can now read/write HDV. It's very slick. |
|||||||
August 20th, 2005, 01:19 AM | #20 | |||||||||
Barry Wan Kenobi
Join Date: Jul 2003
Location: North Carolina
Posts: 3,863
|
Quote:
Quote:
Quote:
JVC didn't go that route -- they chose a fixed bitrate per second. Which is actually good for their 24P implementation, as it means that it's the least-compressed form of HDV available. By using the repeat-frame flags, they get 25% more compression bandwidth applied to each compressed frame. Quote:
And as Nate and Lumiere and Cineform have all confirmed, the 24P data is encoded/carried within a 60p MPEG-2 file. Tim Tokita, general manager of product engineering for JVC, confirmed this for me as well. It's a 60P data stream. However, out of those 60 frames, only 24 are unique. 36 are handled, apparently, by a simple flag that just says "repeat the last frame" -- which takes up practically none of the available bandwidth! Quote:
Quote:
Quote:
Quote:
Also, the HD1 and HD10 can transport those files via firewire. They can't play/decode the data, but you can capture 24p files from an HD1, and you can write them back out to an HD1. It knows how to process the data stream, but it doesn't know how to decode/display it. Quote:
With DVCPRO-HD the # of frames per second does affect the storage space, because each frame is encoded discretely at a fixed/constant bitrate. With HDV MPEG-2, the only thing that's absolute is the data rate. The presence or absence of frames will change how many bits get allocated to encode each frame, but even if it were capable of encoding 60 separate frames (which the current hardware can't, but HDV specs do allow for), the final product will *still* be 19mbps. Just more heavily compressed. |
|||||||||
August 20th, 2005, 01:20 AM | #21 | |||
Wrangler
Join Date: Oct 2002
Location: Los Angeles, CA
Posts: 2,100
|
Quote:
Quote:
Quote:
I'll agree..I wish HDV was a little better. But I don't bemoan it. I look forward to the production value it will add to my lower-budget work. "It is what it is". I'll deal. |
|||
August 20th, 2005, 02:43 AM | #22 | |
HDV Cinema
Join Date: Feb 2003
Location: Las Vegas
Posts: 4,007
|
Quote:
But here's where I get lost. We know the HD100 records 5 6-frame GOPs per second -- 720p30. When we only have 24 rather than 30 frames within those 5 6-frame GOPS -- I just don't see WHERE the 24 frames "go" because 24 can't be divided into 5 GOPS. Obviously, there could be 4 6-frame data GOPs followed by 1 "null" GOP of 6-frames, but I think that would leave gaps in the data flow. So I feel the 24 frames must be distrbuted uniformly amoung 30 frames. Each new 24fps frame must generate an I frame followed by 5 B/P frames yielding 1 GOP. This means every second there would only be 4 GOPs not 5 GOPs. This makes me think, as you suggest, that something like a 2:3 pulldown pattern must be used. But at 4:30AM -- I can't think how it would work. Can you, or David, explain the cadence that gets the 24 into 30. Lastly, although everyone talks about 720p60 -- the recording system remains 720p30. I don't see where p60 comes into play until each frame (for 30p) is doubled in the NLE and assigned an appropriate timebase. Thus not only do we have understand HOW 24 gets into 30 -- we have to understand in the NLE how we get back our 24 frames out of the 24.
__________________
Switcher's Quick Guide to the Avid Media Composer >>> http://home.mindspring.com/~d-v-c |
|
August 20th, 2005, 03:36 AM | #23 | |
Barry Wan Kenobi
Join Date: Jul 2003
Location: North Carolina
Posts: 3,863
|
Quote:
But since the generation of a 24p file means creating a 60p file (while only having to deal with the throughput of 24 frames) the hardware can handle that. So the file that gets written to tape is a 60p file, containing 24 frames worth of data, and 36 "duplicate frame" flags. It's actually encoded as a 60p file, but more than half of those frames just basically point to a prior frame and say "what he said." At least, that's what I gathered from JVC, and it matches with what Graeme said that Lumiere told him, and Graeme has been working with JVC 24P footage for a while. It also matches with what David and Nate are saying, so I'm pretty sure it's accurate. David would likely be the one who knows best. The .m2t's in the article on HDVInfo.net are direct 24p captures from tape, as processed by HDV Rack and by Pixela HD Capture, so if you want to examine a 24p HDV file, there are some available for download. |
|
August 20th, 2005, 10:33 AM | #24 |
CTO, CineForm Inc.
Join Date: Jul 2003
Location: Cardiff-by-the-Sea, California
Posts: 8,095
|
Yes I should have said 720p24 is not used as a broadcast standard, 720p60 is the common format. I don't spend my day looking at ATSC specs, yet I have (well much more my co-workers) spent a lot of time looking at many different transport streams. We have been doing this for a long time now.
The confusion seem to be with the 6 GOP structure and how that applied with repeat flags. The repeat flags do not use any of the 6 frames in the GOP. Here is how a GOP looks in the transport stream. In 30p the camera uses a 30 frame transport so the IBBPBB applies to each of the frames. In 24p in a 60p transport the repeat flags ('R' -- note: all of the is way over simplied -- for my understanding too) would look something like : I R B RR B R P RR B R B RR R vs RR apples the 3-2 pulldown. The 6 frame GOP covers 15 frames in transport stream "time." There are 4 GOPs for the 24 frames which adds to 60 display frames per second.
__________________
David Newman -- web: www.gopro.com blog: cineform.blogspot.com -- twitter: twitter.com/David_Newman |
August 20th, 2005, 02:34 PM | #25 | |
HDV Cinema
Join Date: Feb 2003
Location: Las Vegas
Posts: 4,007
|
Quote:
So there is no change to recording system in the HD100?!? I agree that the encoder was/is limited, but I never had any idea the recording system was ready for 720p. Mind blowing. 1) This means by the next NAB we could see a enhanced HD100 that is true 720p60. Only a new encoder chip needs to be dropped in! 2) That's when we'll get the PCM audio tracks. 3) This raises a lots of questions: A) When the HD1/HD10 recorded 30p I thought it only wrote five 6-frame GOPs to tape. But, if the tape had space for ten 6-frame GOPs, that means skipping every other GOP space on the tape. Analog output was frame doubled. And the 720p30 (every other GOP) was sent down i.LINK. Correct? B) Does the HD100 also only write 30p to tape -- skipping every other GOP space on the tape? And, send 720p30 down i.LINK? I assume it does. C) I've got to understand what David has posted, but I don't yet. D) Here's where I'm stuck. If I were JVC and I could record 720p60 to tape -- I would use 2:3 pulldown because the whole NLE industry works with this cadence: AABBBCCDDD so 24 frames nicely turns into 60 frames. E) But I get the feeling this NOT what JVC is doing. Perhaps because 2:3 pulldown doesn't work for inter-frame compression.Therefore, some other scheme is used. F) But, what comes down i.LINK? Some bizarre pattern of IBP frames or clean 720p24? If the former, is that what the NLEs will record to a disk file -- leaving the NLE MPEG-2 decoder to obtain only the 24p in realtime -- or will the software driver obtain the 24p and write it to a disk file as 24fp?
__________________
Switcher's Quick Guide to the Avid Media Composer >>> http://home.mindspring.com/~d-v-c |
|
August 20th, 2005, 04:34 PM | #26 | ||||||
CTO, CineForm Inc.
Join Date: Jul 2003
Location: Cardiff-by-the-Sea, California
Posts: 8,095
|
Quote:
Quote:
Quote:
Quote:
Quote:
Quote:
__________________
David Newman -- web: www.gopro.com blog: cineform.blogspot.com -- twitter: twitter.com/David_Newman |
||||||
August 20th, 2005, 06:08 PM | #27 | |
Barry Wan Kenobi
Join Date: Jul 2003
Location: North Carolina
Posts: 3,863
|
Quote:
It is, indeed, a 60p stream. But 36 of those 60 frames have no data assigned to them -- because they're exact duplicate frames, in the data stream they're just pointers back to prior frames. So there are 24 frames that have actual compression encoded on them, and then there are 36 "duplicate frames" there -- and because of MPEG efficiency, those duplicate frames take up practically no space. So, the data stream looks something like what David said earlier: Frame 1 = fully-compressed I-frame Frame 2= pointer back to Frame 1, taking up no space at all Frame 3 = compressed Bi-directional frame Frame 4 = pointer back to Frame 3, taking up no space at all Frame 5 = pointer back to Frame 3, taking up no space at all Frame 6 = compressed Bi-directional frame Frame 7 = pointer back to frame 6 Frame 8 = compressed Predicted frame Frame 9 = pointer back to frame 8 Frame 10 = pointer back to frame 8 etc. etc. You can see how if that stream was uncompressed and played back at 60p frame rate, it would have a similar frame cadence as 24p recorded on a 60p Varicam tape: you'd see 24 distinct frames displayed per second, but there would actually be 60 frames updated and displayed on the television. And the pointer frames take up practically no space and no bandwidth, so there's really no loss in doing it this way. Had they made an actual 24p data stream they could not have made it HDV compatible. HDV has no provision for 24p in the spec -- it's 25p, 30p, 50p and 60p only. So they implemented 24p within a 60p data stream, to keep it HDV-compatible. |
|
August 21st, 2005, 12:32 AM | #28 | |
HDV Cinema
Join Date: Feb 2003
Location: Las Vegas
Posts: 4,007
|
Quote:
I think this is the first time inter-frame compression (TS) has incorporated intra-frame compression technology. To really understand I've got to draw it. Thank you guys for the help!
__________________
Switcher's Quick Guide to the Avid Media Composer >>> http://home.mindspring.com/~d-v-c |
|
August 21st, 2005, 06:04 AM | #29 | |
HDV Cinema
Join Date: Feb 2003
Location: Las Vegas
Posts: 4,007
|
Quote:
JVC writes the TS bit-stream into the DV segment of the tape -- leaving the PCM segment untouched -- for now. They write Sub-code into it's area. However, they also claim that WITHIN these 60 tracks, the TS macro-blocks are written in a scrambled way so a small DO can only wipe out a few macro blocks. They claim the loss of an I frame is almost impossible because the DO would need hit -- over the 60 tracks -- all the macroblocks making-up the I-frame. So you are correct that within the 60 tracks, the CBR bit-stream is written without regard for "tracks." It is a pure data stream. Nevertheless, the 5 GOPs -- written into 60 DV tracks -- making up 30 frames DOES occupy an exact amount of space on the tape. Thus 30fps recording use a fixed space on the tape for every second of video. What we don't know is if JVC designed the system so the 60 tracks can hold the data-stream for 30 frames or 60 frames. If only 30 frames, then JVC has to make a change to support 720p60 -- run the tape twice as fast and write 120 frames for each second, thereby cutting recording in half OR increase the the recording density by 2X. But, if the 60 tracks will hold the data for 720p60 -- JVC is all ready for 720p60 simply by swapping in a new encoder. I tend to think the 60 tracks can accept 720p60, but is now being used at "half capacity" however that might be be done.
__________________
Switcher's Quick Guide to the Avid Media Composer >>> http://home.mindspring.com/~d-v-c Last edited by Steve Mullen; August 21st, 2005 at 03:12 PM. |
|
August 21st, 2005, 10:43 AM | #30 |
CTO, CineForm Inc.
Join Date: Jul 2003
Location: Cardiff-by-the-Sea, California
Posts: 8,095
|
Wow! It seems that your ideas can't be budged. Sorry, your conclusions are counter to our real world experience of analyzing the transport stream data.
__________________
David Newman -- web: www.gopro.com blog: cineform.blogspot.com -- twitter: twitter.com/David_Newman |
| ||||||
|
|