Editing

Editing Flip camera footage in Final Cut Pro

I love my Flip camera – it’s portable, instant-on nature makes it ideal for throwing into my pocket whenever I might have something to film in a hurry.

Because it records in an MPEG 4 format though, it doesn’t provide the easiest files for editing. The software provided with the camera is OK for most things (and it’s great to be able to upload directly to YouTube et al), but when it comes to editing which involves anything more complex than just stringing a bunch of clips together, I need to fall back on something more powerful.

Final Cut Pro is my primary weapon of choice when it comes to video, but it doesn’t natively handle MPEG 4 files very well – and nor should it: MPEG 4 is a hefty codec intended for distribution.

So I’ve had to come up with a little workflow to convert that lovely Flip footage into something which will play nicely with Final Cut Pro. MPEG Streamclip to the rescue!

I love MPEG Streamclip – it’s my swiss army knife for doing any kind of video file wrangling. It’ll handle pretty much any file conversion job you can throw at it, and always comes to the rescue when I need to format A isn’t playing nicely with format B.

So, to get that Flip footage working with FCP, it’s just a case of firing up MPEG Streamclip and opening the a source Flip file (once you’be got them saved to a folder on your hard drive). Then just follow these simple steps:

  1. Go to the “File” menu and choose “Export to Quicktime…”
  2. In the “Compression” drop-down choose “Apple DVCPRO HD 720p60″
  3. Select “Make Movie”, choose a location for your output file, and that’s it.

It couldn’t be simpler!

Why the DVCPRO HD 720p60 codec? Well, the native Flip video format is 720p HD, with a frame rate of 30fps – this is the best fit for conversion. DVCPRO will give you excellent quality video without losing too much in the conversion.

Now, to edit this footage in Final Cut, all you need to do is create a sequence using the “DVCPRO HD 720p30 preset, and you’re away.

SmoothCam

I’ve had the chance to play with a new filter in FCP called SmoothCam. It’s great, and creates delicious results.

It’s basically a camera stabilisation filter which has been ported from Shake. It processes your footage to create a vector map of all of the objects and movements, then using that data to manipulate the original footage to create smooth camera motion.

The processing of your footage can take some time, but it’s a one-off task, and once it’s done, you can make changes to the filter settings without the need to re-process. You can make adjustments to the amount of each transformation the filter applies. One of the other things it does is to automatically zoom the image to mask any black areas which appear, due to the compensation of the transformations – and you can also set the level at which this is applied.

I’ve been working with some footage which was shot in a hurry, with a Z7 mounted on a tripod strapped around my neck and braced with both arms. A lot of it was fast-paced and there were a few bumps, which is why I wanted to run SmoothCam through its paces, to see whether I could get an authentic syeadycam look with my shoddy, rushed footage. I shot in HDV, but the end result is going onto a SD DVD, so I had plenty of flexibility in how much I could zoom the image, which in turn, allowed me to ratchet up the SmoothCam settings quite high.

And it looks fantastic! It’s not perfect, but it goes a long way to tidying up the material. And with filmic grading, and 1.35 letterboxing, it looks quite authentic.

It’s certainly not a cure-all, and is best suited to tracking shots, or slow pans. It can have trouble with irregular movement, or fast pans, at which point you have to chop your footage and carefully splice filtered and unfiltered clips together – it can be time-consuming, but then you can’t have everything for free.

I just wish I could show off the final footage, but sadly it’s a private commission which can’t be broadcast publicly.

Stick “SmoothCam” into Google though, and you’ll get a heap of articles on the subject – some with examples of test footage.

Compressor Droplets for Vimeo

Update 2: Hooray! Thanks to a very thoughtful and generous commenter (much appreciated Shahin), the Droplets are back. The download links below are working again.

Update: Looks like I’ve clumsily lost these when updating the site to a new server – oops! The links will no longer work. Here’s a useful link to a really useful video explaining how to create custom settings and droplets though.

Since I recently posted on a great method for encoding for Vimeo using Compressor resets, I’m currently adopting that workflow for all of the work I’ve been doing this past month or so. It may well be that I’m losing a certain amount of quality by using this technique, but I’m happy that it’s good enough for online distribution.

What I’ve done, is created a set of Compressor Droplets, which live on my desktop and allow me to just drag-and-drop files for encoding. The one-click dialog box which appears feels a lot cleaner and more efficient than having to launch compressor and fiddle with settings and sources etc.

I’m providing the droplet files I’ve created here for download. They’re provided as-is, and with absolutely no warranty – they work for me, and they should work for you. There are three droplets: standard definition, anamorphic standard definition and high definition.

Vimeo SD Droplet

Vimeo SD – Anamorphic Droplet

Vimeo HD Droplet

All you need to do to use them, is drag-and-drop the file you want to encode onto a droplet, and a simple dialog will appear asking for confirmation. Hit “Submit”, and Batch Monitor will launch and process the job. The output files are set to be created in the same directory as your source file.

Encoding HD video for Vimeo using Compressor

I stumbled across this great video tutorial which explains how to easily set up a preset for compressing HD video for Vimeo. It’s clear, concise, and straight to the point.

Until now, I’ve been using VisualHub presets to encode video for online distribution, but this looks like it could be an alternative solution (particularly since the developer of VisualHub has pulled the plug on the software).

De-interlacing for fun and profit (or: how to create a film-look with video)

Oops.

After I finished writing my last post on interlacing, I realised that I missed out one important aspect of the whole de-interlacing discussion, and more specifically, another very good reason why you would want to use de-interlacing: creating a film-look for your video.

When you watch most soap opera or current affairs programmes on TV, you’ll notice that they have a much sharper and crisper look than the picture of a drama or film you watch on the same TV. It has a distinctly “video” look to it, which creates a very immediate and “real” image.

Part of that is down to the way images are captured on most video cameras, and the way in which the signal is processed. There are video formats which create a softer, richer image, such as digi-beta. But for those of us who work with cheaper, less-cumbersome formats (such as DV, HDV, XDCAM etc) there remains the issue of how to change that “video” look to one which looks more like film.

Well, there are three basic things I do which create that magical film-look.

The first is to desaturate the image a little – using a more less vivid colour palette instantly gives your image more subtlety. The hyper-reality of video is dampened.

The second thing to do, is to recoup some of the richness you lost when desaturating, but increasing the contrast of the image. This will tend to “bleach” the image, and you’ll lose some detail, but the detail which remains will be sharper and add more depth.

And then the third, and final thing: de-interlacing. There’s a very good reason for this, and even if you don’t want to apply desaturation and increased contrast, if you don’t apply a de-interlace, you just aren’t going to get anywhere near a film-look. Here’s the reason why:

Film consists of 24 unique frames per second. Even if those frames are being displayed several times in a row (for instance, due to a faster shutter speed when projecting at say 50fps) the fact remains that there are only ever 24 unique images being shown every second.

TV has a similar “shutter speed”, showing 50 frames per second. But those frames are split into two sets of fields (see my previous post for a fuller explanation of this), and a video signal records one field every 1/50th of a second. So, rather than there being 25 full frames being displayed every 1/25th of a second, there are 50 half-resolution frames being displayed every 1/50th of a second. When your eye sees this and feed the signal to your brain, everything gets merged to fill in the gaps between the missing fields, and that’s what creates that super-crisp, video look.

So to get rid of that video look, and to simulate more closely the mechanism of film, you de-interlace the video image, combining each set of fields, which creates 25 full frames, instead of the 50 “half” frames. Even if the video ends up being interlaced again (for DVD for example), then it will still retain the filmic look, because the interlacing will still only be showing one full frame every 1/25th of a second.

Interlacing

Having done a fair amount of video editing which involves working with, or converting to different resolutions, I’ve stumbled across a lot of problems in the past which are caused by interlacing.

In a recent post, I wrote about my workflow for down-converting from HDV to SD, which included a step for de-interlacing footage to avoid artefacts appearing when publishing to DVD. Although that post explained the “whats” to get around problems, it didn’t really go into the “whys”. And since interlacing seems to be an area which causes a lot of people to stumble when it comes to editing and rendering video (particularly in this world of multi-formats) I thought it worthwhile to look at the subject in a little more detail.

People tend to sit either side of the fence when it comes to their views on interlacing: some view it as a bucket of putrid evil which should be banished into the bowels of purgatory; others view it as a clever tool which is misunderstood. My view? I consider it an outdated idea, which we’re sadly stuck with for the time-being, and life is a lot easier if you learn to live with it, rather than fight against it.

So what is interlacing? And why does it exist? Let me try to explain in simple terms.

(Please note: the numbers I’m using here are probably not accurate, and are muddled by the fact that PAL and NTSC frame rates vary. I’m using PAL as my benchmark, and if I had more time to research I’d hunt out more accurate numbers.)

Moving pictures are made up of a series of static pictures, displayed in quick succession, creating the illusion of a moving image. People generally cite 24 frames per second as the “magic” number, at which our eyes and our brains are tricked into believing that what we see on the screen is “real” – i.e. the point at which we no longer think “this is a series of pictures”. Traditional film runs at this magical rate of 24 frames, and that number (or thereabouts) has remained as a benchmark ever since.

But there’s a problem with viewing film at 24 frames per second (fps): you get a noticeable flicker between each frame. So, to mask that, cinemas run film with a faster shutter speed, creating the illusion of about 50 frames per second – because the shutter effectively creates a faster flicker which makes it less noticeable. But now it’s starting to get confusing, so I won’t go into that too much – all you need to know is that moving images work best at 24fps, but to avoid any kind of flickering, you ideally need to be viewing at around 50fps.

Then, along came television. The boffins who were behind the technology noted that TV pictures would suffer from the same flicker as film, so they needed to crank up their technology to run at 50fps. But there was a problem: there wasn’t enough bandwidth to send 50 frames of pictures every second – 25 was about all they could squeeze into the analogue signal.

So here was the problem: there needed to be 25 frames of images displayed every second, but to avoid flicker, those 25 images somehow needed to be sent down the signal 50 times a second, but using half the bandwidth. And that’s where the idea of interlacing came from.

Video images are split into individual lines – around 576 lines for standard PAL video. You need to see all 576 of those lines every 1/25th of a second for the moving image to display correctly. It doesn’t particularly matter when those lines reach your eye within that 1/25th of a second – your brain won’t work that fast – as long as they are not all arriving at once.

So interlacing is essentially this: send half the lines during one 1/50th of a second, and the remaining liens during the next 1/50th of a second. Result: the picture is being viewed as 25fps (the optimal viewing rate), being sent through a signal at 50fps (eliminating flicker), using half the bandwidth.

These “sets” of lines are commonly referred to as “fields”, and you’ll find them called “Upper/Lower” fields or “Odd/Even” fields.

So what implications does this have on our modern-day digital world of HD and internet video? Well, we still use PAL and NTSC video standards, and they are standards which use interlacing. Modern HD video even uses it to get around the same initial problem as those early TV pioneers: to squeeze more data into a smaller bandwidth. So, for the foreseeable future at least, we’re kind of stuck with it. Which is why I advocate learning to live with it, to save a world of pain for yourself.

And where does that pain come from? Why is interlacing such a swine to handle when it comes to editing? The most common problem people experience are interlace artefacts – you’ll edit some beautiful footage, which seems fine when you edit, and when you view it on a TV, the picture will strobe and display all sorts of weird lines. That kind of thing can really cause serious headaches and frustration beyond the limits of humankind – I’ve learned the hard way, through trial and error, with late nights trying to prepare masters, sat in front of a rendering process praying to whatever silicone god might be listening.

Most problems though, are down to one very simple thing: field order. Remember those fields: odd/even, upper/lower? Well, get those mixed up at any stage, and that’s when artefacts appear. Field order dictates which field is displayed first: line 1 or line 2 (odd or even) If you’ve edited video which has it’s field order set to “odd”, and then you render out to a video file which has it’s field order set to “even”, that’s when everything goes wrong.

If there was one simple bit of advice I’d give to people to deal with interlacing problems it’s this: Keep track of field order. Simple as that. Here are things to watch out for:

* Make sure you’re editing timeline has the same field order as the footage your editing.
* Make sure you’re final rendered file uses the same field order as your editing timeline.
* If you’re converting files for building a DVD, be especially careful that your field order is the same (DVD Studio Pro is a flagrant culprit when it comes to setting default field order differently to the rest of Final Cut Studio)
* If you’ve got mixed formats in your editing timeline, be really, really careful to make sure that field orders are consistent, and where appropriate de-interlacing is applied, and applied correctly (that’s a whole other topic though).

Another area where field order is important is when you’re converting from one resolution to another. I edit, as standard, using HDV footage, but regularly have to down-convert to standard defintion (PAL) for DVD authoring. Interlaced HDV and DV footage – although they use exactly the same interlacing technique – have a different number of lines, and generally tend to have different field orders. To make life easier, it is always safest to make sure your HD resolution footage gets de-interlaced before it’s converted.

I’ve mentioned de-inerlacing a few times, but what does de-interlacing actually do, and when should you use it?

De-interlacing is very simply taking the two fields of lines (two separate frames) and combining them into one single frame. There are different techniques and algorithms which can be used for achieving that, and the best is generally interpolation, where an average of the two fields is calculated to give you the best estimate of how the single frame should look. If you’re down-converting to a lower resolution though, you can usually get away with just using field duplication – this technique just trashes one of the sets of fields, and doubles up the other, which you don’t notice once you’ve scaled down. Interpolation is best for retaining detail, duplication is quicker.

It’s also worth noting that if you’re producing video for distribution on the internet, it’s a good idea to de-interlace. Computer video (and most modern LCD and Plasma screens) display a “progressive” image. Whereas traditional television display a picture by “scanning” each set of lines every 1/25th of a second, a progressive display only changes those parts of the image which need to change. Because of this progression, there are absolutely no benefits to interlacing.

I hope that demystifies some of the black magic of interlacing, and helps to soften the pain should you run into problems with it. I welcome any other tips or advice which I might have missed.

Nattress Film Effects using HDV

I love Nattress Film Effects. I bought this set of Final Cut plugins last year for use on a kookie little DV film project, and they created a really great film look for footage which as shot on a rally cheap Canon camera.

What’s so super-duper about them? Well, there are ways to create a filmic look using some simple de-interlacing and messing around with saturation and contrast filters, but it can be difficult getting the right look. I’m also not convinced that Final Cut does a very good job of de-interlacing. There are some kludges you can use to split the field order of interlaced footage, adding a bit of blur for good measure, but it’s a black art and mileage may vary depending on how keen your eye is, and the type of footage you’re working with.

Film Effects just takes the pain out of it and gives you a wide range of presets which you can tweak to your hearts content. Admittedly, there is a $100 price tag (around £50 in real money), so I guess you need to weigh up whether you’re willing to pay up for it.

Now, the basic effects were designed for DV footage, primarily to give DV the look of 24p, along with some bleaching and contrast adjustments (there are a whole host of settings and parameters you can tweak, but essentially that’s the main focus of what they do). So I’ve never really considered their use for HDV footage. Until now that is.

I’m putting the finishing touches to a documentary right now which will really benefit from a filmic look. Ordinarily, I’d just put the master footage through a de-interlace filter when downconverting for DVD in Compressor – since the footage is being scaled down, the effect of the de-interlace (the removal of one set of the fields) isn’t really noticeable, so it’s a quick fix. But it’s a bit of a cheat, and I’m not sure it’s creating the best results.

Turns out the Nattress filters will work just as well for HDV as they will for DV. The only consideration is that you have to keep an eye on the field order (HDV uses the upper field first, whereas DV uses the lower field first), but essentially it’s just doing the same thing: resampling two fields into one, albeit on a larger scale.

Rendering takes a little longer than usual, but the resulting footage is looking very lush.

Working with Qmaster

I’ve never used Qmaster before. I’d never gotten around to poking around to see how it worked, and what benefits it might bring. And after the last installation I had on a G5 refused to function under Leopard, I just left well alone.

Qmaster is, quite simply, a way to create a cluster for video rendering. Rendering is just a whole load of number crunching; it’s processor intensive – just squillions of calculations going on to process and render frames of a moving image. If you’ve got multiple processors in your machine, they get used, but on the basis of whenever they’re needed By allocating a cluster, Compressor can allocate these calculations more efficiently, treating each processor as a separate entity.

I like to think of it a bit like counting votes in an election. If you were to put all of the ballot papers in one big pile, and allow the counters to grab whatever they wanted, then go off an count, it wouldn’t be a very efficient use of resources – time would be wasted to-ing and fro-ing, some people might be counting more ballots than others, and there’d probably just be pandemonium and confusion. By allocating everyone ballots to count, and topping them up when they’re done, you save a lot of time and resources are allocated efficiently.

You can also make clusters available to other machines, so that you can allocate rendering tasks across a network, spreading the load and using processors on other machines which might just be sitting idle (I’ve yet to investigate whether you can include multiple machines in a cluster – haven’t delved that far yet).

Creating a cluster turns out to be relatively simple, and is done through System Preferences. Here’s a step-by-step example on how to set your machine up with a cluster for your own use (note I’m using OS X Leopard with Final Cut Studio 2 installed):

1. Open System Preferences.

2. Under “Other”, click on “Apple Qmaster”.

3. The first thing you’ll see is a series of options for “Share this computer as…”. You want to make sure you select “QuickCluster with services”.

4. Next, you’ll see a list of “Services”. Make sure that “Compressor” is checked, and highlighted.

5. Below the list of Services, hit the button labelled “Options for selected service…”. A little sheet will pop out at the top of the window with an option to select “Number of instances”. This is the number of processors you want to assign to the cluster (the language Apple use here isn’t very clear). Ideally, you want to select as many as you can – I have two processors in my machine, so I select “2″. The more processors you make available, the more efficient your cluster will be.

6. Click “OK”.

7. Under “Quickcluster”, you can assign it a name, so that you can easily identify the cluster when it comes to the point of using it.

8. That’s pretty much it. If you click on “Start Sharing” your cluster will spring into life! (sounds more dramatic than it is – it won’t “spring” at all, it’ll just meander in the background, out of sight).

So, now that you have a cluster set up, how do you go about using it? Really simple – assuming you’re familiar with Compressor 3, you just need to do the following:

When you come to submit a job to the queue, by clicking “Submit…”, you get presented with a popup, containing three options: “Name”, “Cluster” and “Priority”. Just select the cluster you’ve just set up and hit “Submit”.

A few things to note:

Using a cluster works best when you have render which will benefit from multi-processing – by that I mean jobs which it will be possible to split to assign to each process of the cluster. For example, rendering a multi-pass DVD file will split the job into several parts and then merge again at the end. Quicktime movies which are reference movies also work well, as there are lots of referenced files which can be assigned to different processes. If all that sounds a little confusing, it’s probably worth doing a little research and reading up on what happens behind the scenes when you render video files.

Also, I’ve yet to toy around with the “unmanaged services on other computers” options – so that might have to be the subject of a future post.

New system; new workflow

Things got so busy recently that it became time to expand the number of workstations in the office. The G5 Mac I’ve been running for the past few years has been chugging along reliably, but it was causing a bottleneck in our workflow as the only machine which could handle any serious rendering jobs. Plus, since we’ve moved to a HDV workflow, things were really starting to feel the strain.

So, it was time to say goodbye to the G5 (it’s now relocated to the other side of the office and has had a fresh reinstall ready to jump into action as a second editing workstation), and hello to a shiny new MacBook Pro. We decided to plump for a refurbished notebook, which saves a little money (every little helps). This is the second time I’ve splashed out on a refurbished machine and it’s something I’d recommend to anyone looking to purchase a new Mac. Apple’s refurbished products are usually either returns (people get them, open the box, decide they don’t want/need them) or dead-on-arrival (something was broken coming out of the factory. Might sound scary buying something which might have once been broken, but they get a full refurb, are thoroughly tested, and you get a full warranty, just like if you were buying a freshly-boxed machine.

With a 1TB firewire drive hooked up, this new Intel machine rips along at an impressive speed. And since we’ve been angling towards recording to Compact Flash cards, it was also time to upgrade to Final Cut Pro 6, so that we can benefit from importing clips using a card reader, rather than capturing from tape. The benefits of this are going to be brilliant – transferring files from the card reader will take about a quarter of the time it takes to capture in real-time from tape, making for a much more pleasant editing life.

I’ve yet to use this workflow to any great extent (other than a few tests), but now that it’s tried-and-tested, we’re going to start using this approach as standard – just as soon as I source the cheapest and most reliable Compact Flash cards.

With the upgrade to Final Cut Studio 2, I’ve also had a chance to play around a little with Motion 3, which has some great whizz-bang 3D tools built into it. I’m really impressed with what I’ve managed to get from it so far, and can see some great possibilities for creative work further down the line – especially compositing stuff in 3D space.

A while back I wrote about the woes of trying to downconvert HDV footage to standard definition for use in DVD Studio – it was one hell of a hack, and felt really clunky. When you consider how far NLE software has come in recent years, it seems odd that it becomes a really painful process when you want to publish your work to various formats. Also, I’d completely abandoned trying to use Compressor, since it didn’t seem to be compatible with PowerPC chipsets on OS X Leopard anymore (that was a painful lesson to learn after upgrading to version 10.5 of the OS). Instead, I’d resorted to using VisualHub – it has a really impressive feature-set, runs fast, but is not a very pretty application. That just added to the feeling of a clunky workflow, and made the whole process of rendering anything feel like a chore, rather than just a simple task.

It would appear that with the latest release of FCP and Compressor 3, all of this kludging is no longer necessary. Hooray! Creating M2V files for import into DVD Studio is now a very simple process – no need for converting to an intermediate codec and clicking on mystical settings in the depths of Final Cut’s option panes. It’s still not the fastest of processes, even with QMaster running, but at least I know I can choose the options, hit Submit and know that the file I’m after will pop out the other end when it’s done; no more worrying about whether I’ve forgotten to check a certain checkbox, or change a certain setting; no more sitting at 2am, waiting for a freshly rendered DVD, which is the product of a 4 hour rendering process, hoping to any god that might be listening that it is interlaced properly so that I don’t have to start the whole process again.

There’s a lot to be said for having a reliable, easy-to-use workflow. Not only does it help to prevent things from going wrong, it allows me to apply more effort and brainpower to the creative task at hand. A good creative tool should help you to achieve a creative vision in the most unobtrusive way possible, so that it is almost synergistic with your thoughts and ideas. It shouldn’t be a hindrance, nor should it be an overriding influence. Final Cut Studio 2 is getting there – especially the way you interact with Motion – and the improvements in rendering workflows are making me very happy (well, as happy as one can be about rendering workflows).

It’s a rap-tor

I’ve just finished putting the finishing touches to 8 minutes and 43 seconds of documentary goodness, which has the working (and possibly final) title of “Raptors”.

It was shot at the start of the Summer, and was intended as an entry to a Channel 4 “3 Minute Wonder” competition. Plans for that were slightly scuppered though, due to the cheeky monkeys bringing the deadline forward at the last minute.

It’s worked out for the best though, as the finished film probably wouldn’t have had the charm it has if it had been jammed into a 3 minute slot. As it is, we?ve been able to allow it to breathe a little – so much of the footage looks gorgeous, and so it’s nice to allow the story to ebb along without worrying about ending up with too much on the cutting room floor (so to speak – cutting room floors don’t really house off-cuts in this digital age).

Colour correction has been a bit of a challenge, due to a slight problem with the camera during the shoot (a little too much exposure in places), but I’m grateful for having plenty of experience of doing battle with colour in Final Cut, which makes this kind of job a challenge, rather than a horrendous nightmare. Also had a few problems with it being a windy day, and some resultant rumbling on the soundtrack – but most of that has been remedied with some careful audio filtering.

The finished product will go online soon. We wanted to let the contributors have first dibs on viewing the footage before unleashing it on the world, since they’ve been so accommodating and willing to open themselves up in front of the camera.

This has been a refreshing change after the mountain of corporate work I’ve been working with lately. Although corporate edits pay the bills, they certainly lack al ittle something when it comes to satisfying my creative thirst.