Atom Feed
RSS Feed
Buy Mike Recommended
edit systems & gear
from Silverado Systems
Buy Books, Software, & More
at HD for Indies Amazon Store
Buy New Movies from
HD for Indies Amazon Store
Or, you can also support
HD4NDs by contributing
to the tip jar...
Help Support HD for Indies
RSS Feed
Buy Mike Recommended
edit systems & gear
from Silverado Systems
Buy Books, Software, & More
at HD for Indies Amazon Store
Buy New Movies from
HD for Indies Amazon Store
Or, you can also support
HD4NDs by contributing
to the tip jar...
Help Support HD for Indies
Advertisements
Great HD Links
- HD For Indies Home Page
- HD For Indies FAQ
- HD 24
- Cinematography
- Bare Feats
- 24p Entertainment
- Light Illusion (was Digital Praxis)
- OneRiver Codec Resource
- CamcorderInfo.com
- LumiereHD
- HighDef.org Info
- Understanding RAID
- Video Systems (Reviews)
- DV Film (DV=>Film)
- SonyHDVInfo.com
- Plus 8 Digital (vendor)
- Digital Cinema Society
- Texas High Def (local F900 guy)
- Creative Cow (news & forums)
- Philadelphia FCP User Group
- Los Angeles FCP User Group
- Cinema Tech
- FresHDV
- DV Info's forums
- HVX User
- Pro App Tips
- Bluesky Media - Instruction
- RedUser.net
- fxguide
- little frog in high def
- VideoMaker Learning Section
- Stu Maschwitz's ProLost
Archives
- March 2004
- April 2004
- May 2004
- June 2004
- July 2004
- August 2004
- September 2004
- October 2004
- November 2004
- December 2004
- January 2005
- February 2005
- March 2005
- April 2005
- May 2005
- June 2005
- July 2005
- August 2005
- September 2005
- October 2005
- November 2005
- December 2005
- January 2006
- February 2006
- March 2006
- April 2006
- May 2006
- June 2006
- July 2006
- August 2006
- September 2006
- October 2006
- November 2006
- December 2006
- January 2007
- February 2007
- March 2007
- April 2007
- May 2007
- June 2007
- July 2007
- August 2007
- September 2007
- October 2007
- November 2007
- December 2007
- January 2008
- February 2008
- March 2008
- April 2008
- May 2008
- June 2008
- July 2008
- August 2008
- September 2008
- November 2008
- December 2008
- January 2009
- March 2009
- April 2009
- May 2009
- June 2009
- July 2009
- August 2009
- September 2009
- October 2009
- November 2009
- December 2009
- January 2010
- February 2010
- March 2010
- April 2010
High Definition Video for Independent Filmmakers
A How To Guide for Digital Filmmakers
Welcome all! This is my blog to share my latest research,
thoughts, etc. on utilizing HD for independent filmmaking.
YES, I am available for consulting
Contact me at mike@hdforindies.com
All content copyright 2004-2007 Mike Curtis.
Friday, July 06, 2007
Working with 24P from Canon HV20
UPDATED with Windows product info, see bottom
Similar to Geoff Frost's post on HVX200 production tips, my other intern, Andy Nelson, has been doodling around with a Canon HV20, and I asked him to post his notes on his experiences with the HV20. Below is his article on dealing with 24p. BTW - if looking to figure out how to get optimal results out of the HV20, FreshDV's interview with Bruce Allen (he of recent Cinegear report) has some EXCELLENT specific details on hands on usage and testing on how to get the most out of the HV20.
This is thematically similar to Steve Mullen's recent piece on dealing with the V1's 24p in Final Cut Pro
More coverage to follow on that, but here's Andy's report on the HV20 and 24p, my comments in italics:
==============
For a thousand bucks the Canon HV20 isn’t a bad little camera, especially after putting some work into getting 24P from it. The HV20 uses HDV, so it only records 60i to tape and adds 3:2 pulldown for its 24fps mode. You can, however, acheive some pretty good results with a reverse telecine to remove the pulldown for full-on progressive beauty. To do this I began by capturing with the Apple Intermediate Codec, as to bypass the temporal compression of MPEG2 that comes with native HDV, and then went two routes for the reverse telecine…(Mike comment - the MPEG-2 compression is from the source HDV, by transcoding to AIC, FCP can process that footage faster, and your recompression/generational losses will be less. This was with FCP 6 not 5.x, BTW)
The Hard Way:
The first way I did this was using Cinema Tools (After Effects or something like JES Deinterlacer will also work ...but using After Effects, with its RGB processing, can clip superwhite and sub-black values - mike). After opening my clip in Cinema Tools, I used the Reverse Telecine button at the bottom of the window. Cinema Tools does not do a “smart” reverse telecine, you have to tell it where to start and what to do. 3:2 pulldown puts the 24P footage down as 60i on tape in a pppii cadence, p for progressive frames and i for interlaced (three progressive and two interlaced, hence 3:2). Essentially, you must tell Cinema Tools what frame of this cadence you are starting with. The button brings up a window with options for Capture Mode, Fields, File, and Frames. It is quite a process to determine the Capture Mode and Fields options, while File and Frames are rather straightforward. This diagram from the Cinema Tools manual was helpful...

Capture Mode has to do with the repeating frame sequence of the clip. I used “Field 1 – Field 2,” which means that my footage contains both fields with Field 1 Dominance, as opposed to the other options: Field 2 Dominance, Field 1 Only, or Field 2 Only.
So if you've been using the HV20 below its full potential--or thinking about how this little camera stacks up, Compressor 3 can give you nice 24P very easily.
Also, if you want to go the extra step and add some shallow depth of field, check out the lens adapter rigs below....
PROLOST - Redrock Gets It
PROLOST - Gold Rims On the Hoopty
PROLOST - TurboHoopty2000
-andy
============
Mike's follow up questions - I'd want to do further testing to absolutely verify that Compressor is figuring out cadence changes within a single captured clip (which could include lots of starts and stops, and stops could be almost anywhere in the cadence process). I'd like to verify whether >100 IRE values do or don't get clipped in this process, and if they do, what steps can be taken to preserve them.
============
Andy's follow up answers - This article on 24P HDV and ProRes from Tim Wilson at Creative Cow has some more info on Compressor's "smart" reverse telecine. He's done at least 20 tests the same way with successful results. I did run another test using footage with very bright whites and as far as IRE values greater than 100 go, they DO get clipped in this process. The workaround, as described in Stu Maschwitz's DV Rebel's Guide, is fairly simple; lower the opacity of the clip to around 90% (or check the scopes until you're under 100) and make sure to go into FCP's clip settings and under "Video Processing" select "Render all YUV material in high-precision YUV" as to not lose image quality while darkening your video.
Mike's continuation of that - ...and then export that in some high quality codec, preferably 10 bit, such as Apple Uncompressed 10 bit 4:2:2 or ProResHQ - THEN process via Compressor, THEN bring the levels back in FCP when you color correct (or maybe in Color - I need to check that round trip workflow to see if superwhites and sub-blacks are maintained).
-andy & mike
SATURDAY UPDATE - a commenter mentioned the 3:2 pulldown removal capabilities of Cineform, and I recalled they could do it and do it well, so I emailed David Newman:
Hey David!
This blog post was mostly letting my intern explore and commenting on it a bit more - do you have a specific page that outlines the 24p extraction goodness? And for working with HDMI and HD-SDI sources as well for "live" capturing and how it does that?
He responded:
Hi Mike,
We do have a technote on the subject : http://www.cineform.com/products/TechNotes/InverseTelecine.htm
All our PC products now support live capture and pulldown removal from Intensity, Decklink or AJA Xena in real-time.
The pulldown extraction is not dependent on repeat flags, as it is an image analysis technique that works on all telecined sources, however they are encoded. We originally developed this for the HDSDI output from the Canon XL-H1, since then Wafian uses it, Mircosoft uses it for ingest all the HD materials of Xbox Live, and now it works very well for HDMI sources.
Real-time removal of telecine is helpful is several ways. It can save a compression generation, while not a big issue for CineForm, capturing to 60i then converting to 24p, is a lot of encoding and decoding before the edit. Also with live pull-down removal, compression is easier, takes less CPU and produces significantly small files at higher quality.
David Newman
CTO, CineForm
Thanks David!
-mike
Similar to Geoff Frost's post on HVX200 production tips, my other intern, Andy Nelson, has been doodling around with a Canon HV20, and I asked him to post his notes on his experiences with the HV20. Below is his article on dealing with 24p. BTW - if looking to figure out how to get optimal results out of the HV20, FreshDV's interview with Bruce Allen (he of recent Cinegear report) has some EXCELLENT specific details on hands on usage and testing on how to get the most out of the HV20.
This is thematically similar to Steve Mullen's recent piece on dealing with the V1's 24p in Final Cut Pro
More coverage to follow on that, but here's Andy's report on the HV20 and 24p, my comments in italics:
==============
For a thousand bucks the Canon HV20 isn’t a bad little camera, especially after putting some work into getting 24P from it. The HV20 uses HDV, so it only records 60i to tape and adds 3:2 pulldown for its 24fps mode. You can, however, acheive some pretty good results with a reverse telecine to remove the pulldown for full-on progressive beauty. To do this I began by capturing with the Apple Intermediate Codec, as to bypass the temporal compression of MPEG2 that comes with native HDV, and then went two routes for the reverse telecine…(Mike comment - the MPEG-2 compression is from the source HDV, by transcoding to AIC, FCP can process that footage faster, and your recompression/generational losses will be less. This was with FCP 6 not 5.x, BTW)
The Hard Way:
The first way I did this was using Cinema Tools (After Effects or something like JES Deinterlacer will also work ...but using After Effects, with its RGB processing, can clip superwhite and sub-black values - mike). After opening my clip in Cinema Tools, I used the Reverse Telecine button at the bottom of the window. Cinema Tools does not do a “smart” reverse telecine, you have to tell it where to start and what to do. 3:2 pulldown puts the 24P footage down as 60i on tape in a pppii cadence, p for progressive frames and i for interlaced (three progressive and two interlaced, hence 3:2). Essentially, you must tell Cinema Tools what frame of this cadence you are starting with. The button brings up a window with options for Capture Mode, Fields, File, and Frames. It is quite a process to determine the Capture Mode and Fields options, while File and Frames are rather straightforward. This diagram from the Cinema Tools manual was helpful...

Capture Mode has to do with the repeating frame sequence of the clip. I used “Field 1 – Field 2,” which means that my footage contains both fields with Field 1 Dominance, as opposed to the other options: Field 2 Dominance, Field 1 Only, or Field 2 Only.
The next setting, Fields, is the frame type of the current frame open in the Cinema Tools, either AA, BB, CC, or DD. For this I used “DD,” because that is where my current frame lie.
File is to either keep the same file or make a new one, I chose "New."
Finally, Frame is either 24 or 23.98, I went with “23.98.”
Confused yet? To further disorient, this process only works for a single clip--if you captured all in one clip (as I did with the Apple Intermediate Codec) you must split them up into separate clips for every camera start/stop. This is because every camera start/stop breaks the pppii cadence and starts it anew. Cinema Tools does have a Batch Reverse Telecine option for this, but all clips must have their in-point set to the same Field (as selected in the Field option) in order to begin the cadence at the same frame.
After a short wait, I imported my clips back into Final Cut Pro and could find no interlacing. Success!
The Easy Way:
Compressor, on the other hand, does have the ability to do a “smart” reverse telecine. Smart because it recognizes the cadence and the current frame, but also because it recognizes cadence breaks for clips captured or edited together. I simply loaded up the “Apple ProRes 422 for Progressive material” preset and changed a few things.
First off was the frame rate: under the Encoder Tab, I clicked the Settings button and changed Frame Rate from “Current” to “Custom” and used 23.976.
Then I went to the Frame Controls Tab and turned Frame Controls “On.” A few options down under Deinterlace is the “Reverse Telecine” option.
That’s it. I waited about 15 minutes for a 6 minute clip on a Dual 2.0 G5 and ended up with something identical what Cinema Tools spit out. Not only do I have true 24P, but now my footage is in the friendly ProRess 422 codec as well. Double success!
So if you've been using the HV20 below its full potential--or thinking about how this little camera stacks up, Compressor 3 can give you nice 24P very easily.
Also, if you want to go the extra step and add some shallow depth of field, check out the lens adapter rigs below....
PROLOST - Redrock Gets It
PROLOST - Gold Rims On the Hoopty
PROLOST - TurboHoopty2000
-andy
============
Mike's follow up questions - I'd want to do further testing to absolutely verify that Compressor is figuring out cadence changes within a single captured clip (which could include lots of starts and stops, and stops could be almost anywhere in the cadence process). I'd like to verify whether >100 IRE values do or don't get clipped in this process, and if they do, what steps can be taken to preserve them.
============
Andy's follow up answers - This article on 24P HDV and ProRes from Tim Wilson at Creative Cow has some more info on Compressor's "smart" reverse telecine. He's done at least 20 tests the same way with successful results. I did run another test using footage with very bright whites and as far as IRE values greater than 100 go, they DO get clipped in this process. The workaround, as described in Stu Maschwitz's DV Rebel's Guide, is fairly simple; lower the opacity of the clip to around 90% (or check the scopes until you're under 100) and make sure to go into FCP's clip settings and under "Video Processing" select "Render all YUV material in high-precision YUV" as to not lose image quality while darkening your video.
TUESDAY UPDATE - While recording I found that the super-whites on the HV20 go to 109 IRE, so you should only have to bring the opacity down slightly--I was fine at 92%. On the other end, while recording straight darkness I got 4 IRE, which is just under black if you go with 7.5 IRE as black.
MONDAY UPDATE - FCP's Batch Export does not clip--Compressor seems to be responsible for that. So if you have multiple clips/tapes with IRE levels to preserve, Batch Export can be used before Compressor as described below...
Mike's continuation of that - ...and then export that in some high quality codec, preferably 10 bit, such as Apple Uncompressed 10 bit 4:2:2 or ProResHQ - THEN process via Compressor, THEN bring the levels back in FCP when you color correct (or maybe in Color - I need to check that round trip workflow to see if superwhites and sub-blacks are maintained).
-andy & mike
SATURDAY UPDATE - a commenter mentioned the 3:2 pulldown removal capabilities of Cineform, and I recalled they could do it and do it well, so I emailed David Newman:
Hey David!
This blog post was mostly letting my intern explore and commenting on it a bit more - do you have a specific page that outlines the 24p extraction goodness? And for working with HDMI and HD-SDI sources as well for "live" capturing and how it does that?
He responded:
Hi Mike,
We do have a technote on the subject : http://www.cineform.com/products/TechNotes/InverseTelecine.htm
All our PC products now support live capture and pulldown removal from Intensity, Decklink or AJA Xena in real-time.
The pulldown extraction is not dependent on repeat flags, as it is an image analysis technique that works on all telecined sources, however they are encoded. We originally developed this for the HDSDI output from the Canon XL-H1, since then Wafian uses it, Mircosoft uses it for ingest all the HD materials of Xbox Live, and now it works very well for HDMI sources.
Real-time removal of telecine is helpful is several ways. It can save a compression generation, while not a big issue for CineForm, capturing to 60i then converting to 24p, is a lot of encoding and decoding before the edit. Also with live pull-down removal, compression is easier, takes less CPU and produces significantly small files at higher quality.
David Newman
CTO, CineForm
Thanks David!
-mike