View Full Version : Transcoding AVCHD Takes Forever


Tim Lawrence
June 5th, 2010, 01:42 AM
Ok, So I have a new MBP (i7 8RAM) and I also have Neoscene as well as FCP7.

With everything I've read I was assuming AVCHD would transcode i a reasonable amount of time, however my current estimate is it takes 2 to 3 times longer than real time (30 minutes + to do a 10 minute clip. Am I missing a trick somewhere here???

Ron Evans
June 5th, 2010, 07:27 AM
Not sure what your doing but on my PC, a Q9450, so not as fast as the i7, it takes just less than half realtime to convert using either Neoscene or to Canopus HQ fine. Most of the time for single track, I edit native files in Edius Pro 5.5 or Vegas Pro 9 only convert for multicam with multiple tracks as it makes it easier on the PC though most with i7's report multiple tracks native is OK.

Ron Evans

Tim Lawrence
June 5th, 2010, 09:29 AM
Update:

Using FCP7 Log and Transfer takes less than real time.

Neoscene actually took close to 5 times real time (I'm talking 50 minutes for a 10 minute clip here).

I have an email in to Neoscene.

Robert Turchick
June 5th, 2010, 11:19 AM
I tried neoscene too and was not happy with the time it took. Also, I didn't see a difference in quality. My 8-core Mac Pro does log & transfer at 1/3 real time. Too spoiled to change!

Robert Young
June 5th, 2010, 12:42 PM
Transcoding from AVCHD to Cineform on my i7 system is very fast- probably 1/3 RT or less.
If the conversion is not pushing all 8 cores into the 90% range, then something fixable is slowing the process down.
One common bottleneck is the hard drive configuration:
1) In my case the AVCHD files are on a SATA drive and the converted Cineform files are written to a seperate RAID 0 drive.
2) If you tried to write the Cineform files back to the same SATA drive that the AVCHD is being read from, the entire conversion could be slowed down substantially. Even more so if you were reading and writing to a single USB external drive.
The worst ever was the time I was reading the AVCHD from the camera SD card and inadvertently writing the Cineform .avi back to the card instead of the RAID. That was maybe 10x RT, and the cores were at 30%.

Robert Turchick
June 5th, 2010, 10:45 PM
interesting! I'll have to give that a second look then. I have the HD config you describe but typically transcode back to the same drive the AVCHD files are on. Once again though, never bogs in L&T doing this.

Robert Young
June 5th, 2010, 11:00 PM
interesting! I'll have to give that a second look then. I have the HD config you describe but typically transcode back to the same drive the AVCHD files are on. Once again though, never bogs in L&T doing this.
It may not be the HD config in your case, but definitely with an 8 core CPU & plenty of RAM, the performance of CF software conversion of AVCHD is expected to be on par with FCP & other pro level programs. If you are not getting that speed, there has to be a bottleneck somewhere in the system.
As mentioned earlier, a good clue is the level of CPU usage- if it's not running all cores pretty much flat out, there is most likely a dam somewhere downstream.

Randy Painter
June 6th, 2010, 07:50 AM
If your not using a scratch disk, then that's your bottleneck. Reading and writing to the same disk will make it crawl. If you haven't purchased one yet, if you can afford it, get a SSD external drive. Or at least get a 7200 rpm hard disk for your external. Pretty sure your internal drive is 5400 rpm's unless you have a SSD drive.

Tim Lawrence
June 6th, 2010, 04:39 PM
Indeed FCP has a scratch disk. All of my drives (internal and external) are 7200 RPM.

I do not see a scratch disk for Neoscene. How do I set it up? Or can I use the same one?

Also, does Neoscene only change CF files to 4:2:2 or does it also change the prores files it creates to 4:2:2?

Thanks,

TL

Amos Kim
June 6th, 2010, 06:14 PM
Would the quality of media reader affect transcode time?

Robert Young
June 6th, 2010, 09:44 PM
Indeed FCP has a scratch disk. All of my drives (internal and external) are 7200 RPM.

I do not see a scratch disk for Neoscene. How do I set it up? Or can I use the same one?

Also, does Neoscene only change CF files to 4:2:2 or does it also change the prores files it creates to 4:2:2?

Thanks,

TL
You don't need to set up a "scratch disk" per se. You just need to be reading from, and writing to different drives.
The Cineform files have the highest data rate by far- so you want to write them to your fastest drive. In your case maybe you could try putting your AVCHD files on the external drive, and writing the CF files to your internal SATA drive.
CF conversion produces a 4:2:2 Cineform .avi or .mov file.

Another issue: Someone mentioned that they did a CF conversion and the image quality "didn't look that much better"
The newly created CF clip is not going to look any different than the original clip.
The two principle benefits from working with CF are:
1) CFHD.avi (mov) is easier for your computer to work with for editing than AVCHD, etc.
2) After applying graphics, filters, color correction, effects, and then beating up on the codec even more by transcoding to DVD, Flash, Blu Ray, & etc., Cineform will give you the best final image quality because, unlike AVCHD, it is "lossless" throughout the editing process. That's where you will see the difference in image quality- on the final delivery product.
So, the ultimate purpose of CF is the preservation of the original image quality throughout the editing and final output process.

Robert Young
June 6th, 2010, 09:46 PM
Would the quality of media reader affect transcode time?

IMO, not likely.
AVCHD files are small/low data rate (16-24 mbs), so the card reader is usually not an issue.
If you have any doubts about it, transfer the clips from the card to one of your HD & see if the conversion is any faster from there.

Denny Lajeunesse
June 8th, 2010, 04:22 AM
Is indexing turned OFF? If it is on it will seriously hamper your HD and slow transcoding to a crawl.

Tim Lawrence
June 9th, 2010, 06:49 AM
Hi Denny,

How can one tell if indexing is on?

Thanks,

TL

Stu Holmes
June 9th, 2010, 01:20 PM
If your not using a scratch disk, then that's your bottleneck. Reading and writing to the same disk will make it crawl. If you haven't purchased one yet, if you can afford it, get a SSD external drive. Or at least get a 7200 rpm hard disk for your external. Pretty sure your internal drive is 5400 rpm's unless you have a SSD drive.Interestng. OK here's a question : i've got a 5400rpm 500Gb internal drive on my laptop, and a 7200rpm 2Gb externakl drive. Up til now, i've had all editing projects 100% on the external 7200rpm drive. Media files, .veg file, renders too.

What does anyone think would be a more optimum setup? Have all files on the 7200rpm drive but render to the internal 5400rpm drive? I note the "reading and writing to the same drive will slow it to a crawl".

appreciate any comments on this stuff.

cheers

Denny Lajeunesse
June 9th, 2010, 01:40 PM
Hi Denny,

How can one tell if indexing is on?

Thanks,

TL


Right clck on your drives - properties - uncheck indexing. Apply to al folders and subfolders.

Then. Go to services and disable the indexing service. (services.msc or find it under administrative tools)

Denny Lajeunesse
June 9th, 2010, 01:46 PM
Interestng. OK here's a question : i've got a 5400rpm 500Gb internal drive on my laptop, and a 7200rpm 2Gb externakl drive. Up til now, i've had all editing projects 100% on the external 7200rpm drive. Media files, .veg file, renders too.

What does anyone think would be a more optimum setup? Have all files on the 7200rpm drive but render to the internal 5400rpm drive? I note the "reading and writing to the same drive will slow it to a crawl".

appreciate any comments on this stuff.

cheers


While that would seem to make sense, keep in mind that windows is on that 5400 drive and does a lot of memory caching to the same drive.

So.. I would still render onto he drive with the media. Stay away from the windows drive.

If you had two non system drives, then you could put the rendering on one and media on the other.

Robert Young
June 9th, 2010, 06:22 PM
If you had two non system drives, then you could put the rendering on one and media on the other.

Denny is absolutely right- the proper setup for HD editing:
1) a System Drive (SATA 7200 rpm)
2) a "media" drive (usually RAID 0) and
3) an "export" and project drive (SATA 7200 rpm)

Tim Lawrence
June 27th, 2010, 09:42 AM
The exact response from Cineform regarding this issue:

"we're aware of this issue. it is currently being worked on as a high priority fix. we were waiting for apple to release the api for the h.264 acceleration".

Interesting that they would sell their product without divulging this information on the website. They said that they do not give refunds. However, my opinion is that this is terrible customer service as they are basically selling something that they know has a "high priority" problem without telling you. Until they fix this "high priority" problem they should either stop selling the product or give refunds. Beware!

I hope you read this Cineform!!

Robert Young
June 27th, 2010, 04:17 PM
I certainly appreciate your frustration. We have all shared it at one time or another.
But, current HD editing (AVCHD, for example) is still pretty cutting edge, and it's a fact that all of the major players- Adobe, Apple, Sony, as well as third party guys like CF, all are selling their latest software while simultaneoulsy working on many "high priority" issues in the background.
In some ways, it's been all beta, all the time for quite a while now. I know from reading these posts that FCP has several significant issues with AVCHD that are unresolved.
For my purposes, the closest I am seeing to a really finished product at present is Premiere Pro CS5 combined with high powered hardware, and it's taken Adobe a long time to get there.
The v.5 CF products do seem to be working very well with CS5.

Ron Evans
June 27th, 2010, 05:41 PM
Edius Neo or Edius Pro 5.5 will edit native AVCHD just fine especially on an i720 machine. No special hardware. My Q9450 Quad core will edit a single track with no problem using Edius or Vegas Pro9. For multicam /multitrack editing I convert to Canopus HQ as this is easier on my PC but others with an i720 say several tracks native are no problem.

Ron Evans

Robert Young
June 27th, 2010, 10:44 PM
Yeah... it's definitely happening.
With Premiere CS5 my Intel i7 + nVidea CUDA GPU can do multilayer native AVCHD with real time previewing.
My main point in the prior post was just that lots of folks are still having a variety of bumps in the road trying to do what they have in mind.
The real situation on the ground is often more complicated than the marketing/advertising materials indicate. I'm usually surprised when these things actually do work as advertised ;-)

Robert Lane
July 3rd, 2010, 07:15 PM
Another option I didn't see mentioned is ClipWrap; rather than transcoding it simply "re-wraps" the clip into a QT container that FCP - or other apps - can use. It can either just re-wrap into AVCHD, or transcode into DVCPRO-HD or Avid DNxHD. It's a powerful little helper and while not freeware is much faster than Log & Transfer on FCP.

Alberto Blades
July 9th, 2010, 02:47 PM
has anyone tried a soft called hd stream tools? just downloaded it and seems quick transcoding, lets see