There are many different ways for consumers to experience your content today - so many that it’s often difficult to predict exactly where and how it’ll be seen. Is it going to a theater? Will it be watched on a television? Which of the many handheld devices or personal computers will an end consumer use to view and listen to your work? And how is that device or environment going to be rendering the colors?
Color management is an important consideration for every modern digital content production company to keep in the forefront of their minds. In larger post production environments, there will often be a dedicated team that manages the preservation of color accuracy across the many screens and displays found throughout the facility. But for small companies and independent producers, the burden of color management often falls on an individual with multiple roles, and is easier to ignore and to hope for the best than to spend the time and money to make sure it’s done right.
Before going any further, it’s important to define what we’re talking about when we say ‘color management.’ Color management is different than color correction or color grading, which is the process of normalizing colors and contrasts, maintaining color consistency across edits, and applying creative looks to your footage. Instead, color management is about making sure the colors you see on your screens match as closely to the what the digital values stored in your video files are actually describing, within the color space you’re using.
In practice this means making sure that your displays, televisions, projectors, or other screens, as well as your lighting environment, are all calibrated so that their RGB balance, brightness, and contrast all match as close to the target standard as you can get them. This makes sure that you don’t accidentally add corrections to your digital data when you’re trying to ‘fix’ what you see on your displays that’s only there because of your displays or environment. “Burning in” these kinds of shifts adversely affects the quality of your content by creating perceptual color shifts for your clients and consumers.
While calibration is essential, color management also involves ensuring the preservation of color from camera to end user display, keeping the color consistent between programs and ensuring your final deliverables contain the appropriate metadata. Both parts to color management are essential, so we’re going to talk about both. We’ll focus more on the calibration aspect of color management since that’s essential to get right, before briefly addressing color management in applications without getting mired too deep in advanced technical talk.
The problem
How do I know that my red is the same as your red?
This is one of the fundamental philosophical questions of color perception. How do I know know that the way that I perceive red is the same as the way that you perceive red, and not how you perceive blue or green? There’s actually no way to measure or determine for certain that the perceived shades are identical in the minds of any two individuals, since color perception happens as the brain interprets the stimulus it receives from the eyes.
While being a fun (or maddening) thought provoking question, color sameness is actually a really important baseline to establish in science and imaging. In this case we’re not asking about the perception of color, but whether the actual shade of color produced or recorded by two devices is the same. Today we’re only going to focus on colors being produced, and not recorded - we’ll cover capturing colors accurately in our next post.
There are a LOT of different kinds of displays in the world - from the ones we find on our mobile devices, to computer displays, televisions, and consumer or professional projectors. The core technologies used to create or display images, such as plasma, LCD, OLEDs, etc., all render shades of color in slightly different ways, leading to differences in how colors within images look between displays.
But it’s not just the core technology used that affects the color rendition. Other factors like the age of the display, the specific implementation of the core technology (like edge-lit or backlit LCDs), the manufacturing tolerances for the specific class of display, the viewing angle, and the ambient environment all affect the colors produced or the colors perceived. Which makes it almost impossible to predict the accuracy of color perception and rendering for one viewer, let alone the thousands or millions who are going to see your work.
But rather than throw up your hands in despair at the impossibility of the task, shift your focus to what you, as the content creator, can do: if you can be reasonably sure that what you see in your facility is as close to what’s actually being encoded as possible, you can be confident that your end viewers will not be seeing something horrifying. While every end viewer’s experience will be different, at very least your content will be consistent for them - it will shift in exactly the same way as everyone else’s content, a shift they’re already used to and don’t even know it.
For that reason it’s important that when you master your work you’re viewing it in an environment and with a display that’s as close to perfectly accurate as possible. But unfortunately, color calibration isn’t something you can simply ‘set and forget’: it needs to be done on a recurring schedule, especially with inexpensive displays.
What is Color Calibration?
How do we make sure color looks or is measured the same everywhere?
This question was first ‘answered’ in 1931 with the creation of the CIE XYZ color space. Based the results of a series of tests that measured the sensitivity of the human vision to various colors, the CIE created a reference chart that mapped how the brain perceived the combination of visible wavelengths as colors into a Cartesian plane (X-Y graph). This is called the CIE 1931 Chromaticity Diagram.
This chart allows color scientists to assign a number value to all perceivable colors, both those that exist as a pure wavelength of light, and those that exist as a combination of wavelengths. Every color you can see has a set of CIE 1931 coordinates to define its chromaticity (combined hue & saturation, ignoring brightness), which means that while we may not have an answer to a philosophical question of individual color experience, we do have a way of scientifically determining that my red is the same as your red.
This standard reference for colors is a powerful tool, and we can use it to define color spaces. A color space is the formal name for all of the colors a device can capture or produce using a limited set of primary colors. Map the primary colors onto the chromaticity diagram, join them as geometric shape, and your device you can create or capture any color within the enclosed shape. With an accompanying white point, you have the fundamentals ingredients for a defined color space, like Rec. 709, sRGB, AdobeRGB, etc.
Defining and adhering to color spaces is actually quite important to managing and matching end to end color. Digital RGB values have no meaning without knowing which of the many possible shades of red, green, or blue color primaries are actually being used. Interpreting digital data using different RGB primaries than the original creator used almost always results in nonlinear hue shifts throughout the image.
This is where color calibration comes in. Color calibration is the process whereby a technician reads the actual color values produced by a display, and either adjusts the display’s settings to conform more closely to the target color space, and / or adjusts the signal coming to the display to better match the targeted output values.
To do this, you need access to four things:
A signal generator to send the display specific digital values
A colorimeter to measure the actual colors produced
Control of the display’s input signal or color balance settings to adjust the output
Software to manage the whole process and correlate the signal to measurement
If you want to make sure you’re doing it right, though, an in-depth understanding of how color and every image generation technology works helps a lot too.
Some consumer, most prosumer, and almost all professional displays leave the factory calibrated, though consumer and commercial televisions and almost all projectors must be calibrated after installation, for reasons we’ll talk about later. Unfortunately, displays lose their calibration with time, and each kind and quality of display will start showing more or less variance as they age. Which means that in circumstances where calibration is important, such as in professional video applications, displays require regular recalibration.
For desktop displays, this usually involves creating or update the ICC color profile, while for reference displays this typically involves adjusting the color balance controls so that the display itself better matches the target color space.
The differences in calibration technique comes from the workflow paradigm. For desktop displays it’s assumed that the host computer will be directly attached to any number of different kinds of displays, each with their own color characteristics, at any given time - but always directly attached. So, to simplify the end user experience, the operating system handles color management of attached displays through ICC profiles.
ICC profiles are data files that define how a display produces colors. It records the CIE XYZ values of its RGB color primaries, white point, and black point, and its RGB tone curves, among some other metadata.
Using this information, the operating system “shapes” the digital signal sent to the display, converting on the fly the RGB values from the color space embedded in an image or video file into the display’s RGB space. It does this for all applications, and essentially under all circumstances. Some professional programs do bypass the internal color management, sort of, by assigning all images they decode or create to use the generic RGB profile (i.e. an undefined RGB color space). But it’s usually best to assume that for all displays directly attached to the computer, the operating system is applying some form of color management to what you’re seeing (1.)
Calibrating direct attached displays is relatively quick and easy. The signal generator bypasses the operating system’s internal color management and produces a sequence of colored patches, which the colorimeter reads to map the display’s color output. The software then generates an ICC color profile for that specific display, which compensates for color shifting from wear and tear, or the individual factory variances the display has.
Once calibrated, you can be reasonably confident that when viewing content, you’ll be seeing the content as close to intended as that particular display allows.
Reference displays, projectors, and televisions have a slightly different paradigm for calibration. For calibrating computer displays, you can shape the signal to match the display characteristics. But because of the assumption that a single video signal will (or at very least can) go to multiple displays or signal analysis hardware at the same time, and the signal generator is likely to have no information about the attached devices, it’s simply not practical to adjust the output signal. Rather, professional output hardware always transmit their signals as pure RGB or YCbCr values, without worrying about the details of color space or managing color at all.
So instead of calibrating the signal, calibration of reference displays, projectors, or any kind of television usually requires adjusting the device itself (2.)
Once again, a signal generator creates specific color patches the colorimeter reads to see exactly what values the display creates. Software then calculates the color’s offset as a Delta E value (how far away is the color produced from where it’s supposed to be according to the selected standard) and reports to the operator how far away from calibration it is.
The operator then goes through a set of trial and error adjustments to the image to lower the Delta E values of all the colors to get the best image possible. Tweak the ‘red’ gain and see how that affects the colors produced. Touch the contrast and see its effect on the overall image gamma - and on all the other colors. Measure, tweak, measure, tweak, measure, tweak… and repeat, until the hardware is as close to the target color space as possible.
Generally, Delta E values less than 5 are good, less than 3 are almost imperceptible, and under 2 is considered accurate. Once the calibration is complete, you can be reasonably sure that what you’re seeing on a reference display, projector, or television is as close to the target color space as possible. But does that even matter?
Regular Calibration
Medium priced computer displays and professional reference displays usually leave the factory with a default calibration that puts them as close to standard reference as the technology allows. The same is not true of most televisions and projectors - they leave the factory uncalibrated, or are in an uncalibrated mode by default for a couple of reasons which we’re not going to get into.
But even with this initial factory calibration for the displays that have it, the longer a display’s been used the more likely it will be experience color shifts. How quickly it loses calibration depends on the technology in use: some technologies can lose their calibration in as short as a month with daily use.
The reasons behind this shift over time can be lumped together as “wear and tear”. The exact reasons for each different display technology losing its calibration are a little off topic, so I’m going to spare you the gory details of the exact mechanisms that cause the degradations. However, the important things to know are:
The backlight of LCDs and the main bulb in digital projectors change colors over time. This is a major problem with the xenon arc lamps found in projectors, and is a bigger problem for CCFL LCDs than for LED lit (white or RGB) LCDs, but even the LED spectrums shift with use.
The phosphors inside of CRTs and plasma displays degrade with time and their colors change, as do the primary color filters on LCD displays though at a slower pace.
Anything using liquid crystals (LCD displays and LC or LCoS projectors) can suffer from degradation of the liquid crystal, which affects color and brightness contrasts.
The spectrum of light emitted by plasma cells change with age, so they don’t stay balanced for the same output levels.
Or in other words, all displays change colors over time. Setting up a regular calibration schedule for every display that you look at your content on is an important part of color management. You don’t want to move a project from your reference display to your desktop to find that suddenly the entire video appears to be pulling magenta, or invite a client to review your work in your conference room to find the picture washed out or color shifted.
Environment and Color Management
Up until now we’ve been talking about the color characteristics of your displays and projectors. But just as important as your display calibration is the characteristics of your environment in general. The brightness level and color of lights in the room affect perceptions of contrast and the colors within the image.
This is really easy to get wrong. Because not only does the display need to be calibrated for the target color space, it should be calibrated within the target environment. The technician handling the calibration will usually make a judgement call for changing display values like display brightness, gamma curve, or white point based on these environmental choices. But they may also make other recommendations about the environment to improve the perception of color on the screen - what to do to other displays, lighting, windows etc., so that your perception of color will better match industry standards.
Generally speaking, reference environments should be kept dim (not pitch black), using tungsten balanced lighting that’s as close to full spectrum as possible. Avoid daylight balanced bulbs, and install blackout curtains on any windows. Where possible, keep lighting above and pointed away from the workstation screens - reflected light is better than direct lighting, since it reduces glare and is better for color perception.
The easiest way get proper lighting is to set up track lighting with dimmable bulbs (LED or tungsten based, colored between 2800K & 3200K), and point the pots slightly away from the workstation. The dimmer ensures that you can bring the environment into specification for grading, but can then bring the lighting back up to normal ambient conditions for general work or for installing hardware etc. If changing the overhead lighting isn’t an option, good alternatives are stick lights on the opposite side of the room, positioned at standing height.
Keep your reference display or projector as the brightest screen in the environment. If you don’t, your brights will look washed out and gray since they’re dimmer than other light sources. It will also affect your overall perception of contrast: you’ll perceive the image as darker and having more contrast than expected, and are therefore more likely to push up the mids and dark and wash out the image as a whole. Dimming the brightness of interface displays, scopes, phones or tablets, and any other screen within the room will make sure that you’re perceiving the image on your reference hardware as accurately as possible.
Depending on the number of interface displays and other other light sources in the room, you may need to further lower ambient lighting to keep contrast perception as accurate as possible. In rare cases, such as in small rooms, this may include turning the lights off completely since the interface displays provide sufficient ambient lighting for the environment.
Calibrating your displays is essential, calibrating the environment is important. Usually it’s pretty easy to tweak environmental calibration for better color perception, so long as you’re starting from a dark or otherwise light controlled environment. And unlike display calibration it’s something you can do once and not need to tweak for years.
Application Color Management
Once you’ve calibrated all of your hardware and your environment, it’s easy to assume that your job is done, and you don’t have to worry about color management until the next time you book a calibration session. Oh, how I wish that were the case.
Different applications manage color in different ways, which means you may still see differences between applications with the same footage. Sometimes applications get in fights with the operating system over who’s managing color and both end up applying transformations you’re not aware of.
Which means it’s important to understand exactly how each application touches color. To do that, let’s briefly look at how four common applications manage color: Adobe Premiere, Final Cut Pro X, Adobe After Effects, and DaVinci Resolve.
Both Adobe Premiere and Final Cut Pro X actively manage the colors within the project. Adobe Premiere gives you exactly no ways of changing the color interpretation of the input files, beyond the embedded metadata in HEVC and a few other formats (NOT Apple ProRes). It conforms everything to Rec. 709 in your viewers and signal outputs, and there’s no way to override this. The operating system then uses the display’s ICC profile to conform the output so that you can see it as close to Rec. 709 as possible. Which is good, because it means that when you output the video file, what you see is what you get.
Adobe Premiere’s color engine processes colors in 8 bit. You can turn 16 bit color processing in the output or in the sequence settings by flagging on “Maximum Bit Depth” and “Maximum Render Quality.” This is really important for using high bit depth formats like Apple ProRes, which stores 10 or 12 bit image data, assuming you want to maintain high color fidelity with your output files. If you’re outputting to 8 bit formats for delivery you may still benefit from keeping these flags on, however, depending on how in depth your color corrections and gradients are.
Basically, Adobe Premiere assumes you know nothing about color management, and that it should handle everything for you. Not a terrible assumption, just something to be aware of when you start thinking about managing color yourself.
Like Adobe Premiere, Final Cut Pro X also handles all of the color management, but offers at least a small amount of control over input and output settings. By default, it processes colors at a higher internal bit depth than Premiere, and in linear color which offers smoother gradients and generally gives better results. You also get to assign a working color space to your library and your project (sequence), though your only options are Rec. 709 and Wide Color Gamut (Rec. 2020).
Each clip by default is interpreted as belonging to the color space identified in its metadata, and conformed to the output color space selected by the project (sequence). If necessary, you can override the color space interpretation of each video clip by assigning it to either Rec. 601 (NTSC or PAL), Rec. 709, or Rec. 2020 (notably missing is DCI-P3 and HDR curves). When using professional video outs, the signal’s data levels of the is managed by the selection of Rec. 709 or Rec. 2020, and FCP-X handles everything else. Like Adobe Premiere, it works with the operating system to conform the video displayed in the interface to the attached monitor’s ICC profile.
Both Adobe Premiere and FCP-X work on a “what you see is what you get” philosophy. If your interface display is calibrated and using the proper ICC profile, you shouldn’t have to touch anything, ever. It just works. But gods Adobe and Apple forbid you try to make it do something else.
On the other hand, Adobe After Effects and DaVinci Resolve have highly flexible, colorspace agnostic color engines that allow you to nearly completely ignore all color management. They’re quite content to simply apply the transformations you’ve requested to the digital data read in, and to not care about what color space or contrast curve the digital data is in. And when you output, it simply writes the RGB data back to a file and you’re good to go.
Of course, that’s the theory. After Effects makes a few color assumptions under the hood about intent, including ignoring the display ICC profile on output, since it has no idea what color space you’re working in anyway. That sounds innocuous, but it’s a problem if you’re using a display with properties that are mismatched to the color profile of the footage you’re using (3.) Suddenly your output, with an embedded color profile and playing back in a color managed application, may look significantly different than it did in After Effects.
Turning on After Effect’s color management by assigning a project working space allows for a more accurate viewing of the final output. You can then flag on the view option to “Use Display Color Management” (on by default), and adjust the input space of any RGB footage. But you can still get into trouble: any chroma subsampled footage, like ProRes 422 or H.264, is only permitted to use the embedded color profile. Also Adobe ignores ProRes metadata for Rec. 2020 and HDR, which will negatively affect the output when using color management. It also exhibits strange behavior when using HDR gamma curves and in some other working spaces.
DaVinci Resolve has some of the best functionality for color management. It’s agnostic color engine renders color transformations in 32 bit float precision, and outputs raw RGB data to your video out. It assumes you know what color space you’re using, so it’s happy to ignore everything else. By default, on a Mac it applies the monitor ICC profile to the interface viewers, with the assumption that your input footage is Rec. 7094.
Fortunately, changing the working space is incredibly easy, even without color management turned on - simply set it the color primaries and EOTF in the Color Management tab of the project settings. With color management off, this will only affect the interface display viewers, and then only if the flag “Use Mac Display Color Profile for Viewers” is set (on by default, MacOS only). Unfortunately it does not as of yet apply ICC profiles to the viewers under Windows (see footnote 4).
When you turn DaVinci Resolve’s color management on, you have extremely fine grained control over color space - being able to set the input, working, and output color spaces and gammas separately (with Resolve managing the transformations on the fly), and then being able to bypass or override the input color space and gamma on a clip by clip basis in the color correction workspace. And because of their 32 bit floating point internals, their conversions work really well, preserving “out of range” data between nodes and between steps in the color management process, allowing the operator to reign it in and make adjustments to the image at later steps - an advantage of active color management over LUTs in a few cases.
Item | Input | Processing | Output | Display |
Adobe Premiere | Assumes embedded or Rec. 709, cannot be changed | 8 bit Rec. 709 with Gamma 2.4 assumed, 16 bit and linear color processing possible | Rec. 709 on all outputs | Output conformed to display using ICC profile |
Final Cut Pro X | Assumes embedded or Rec. 709, overridable to Rec. 2020 | 10-12 bit Rec 709 or Rec 2020 (configured by library) with gamma 2.4. | Rec. 709 or Rec. 2020 on all outputs (configured by project) | Output conformed to display using ICC profile |
Adobe After Effects | Assumes embedded or Rec. 709, ignored by default, reassignable for RGB formats but fixed interpretation of YCbCr | 8 or 16 bit integer or 32 bit float agnostic color engine. Working space assignable on project basis, many fixed working spaces available | RGB output in working space or generic RGB | Color space and calibration defined by display (Pro out), output conformed to display using ICC profile for direct attached interfaces when working space assigned. |
DaVinci Resolve Studio | Ignored by default, global assignable with per-clip overrides to nearly any color space | 32 bit floating point agnostic color engine. Working space assignable on a project basis, many combinations of working spaces with independently assignable color primaries and EOTFs | RGB output in working space or assignable output space, or generic RGB | Color space and calibration defined by display (pro out), output conformed to display using ICC profile for direct attached interfaces when working space assigned, LUTs available for pro output calibration. |
These four programs kind of form a good scale for understanding application color management. Generally speaking, the easier an application is to set up and use, the more hands-off management it’s likely to do, and give you anywhere from no, to very limited control over color management. More advanced programs usually offer more in depth color management features, or the ability to bypass color management completely so that you’re able to have the finesse you need. They also tend to preserve RGB data internally (and output that RGB data through professional video output cards), but require more of a knowledge of color spaces and the use of calibrated devices.
Calibrating your displays is a significant portion of the color management battle, though it’s also necessary to understand exactly what the applications are doing to the color if you want to be able to trust that what you’re seeing on the screen is reasonably close to what will be delivered to a client or to the end user.
What A Fine Mess We’re In
Keeping displays and projectors calibrated and trusting their accuracy has always been a concern, but it’s really become a major issue as the lower cost of video technologies has made the equipment more accessible, and since both the video and film production industries have shifted into modern digital productions.
“Back in the day”, analog video displays relied on color emissive phosphors for their primary colors. The ‘color primaries’ of NTSC and PAL (and SECAM) weren’t based on the X-Y coordinates on the CIE XYZ 1931 diagram, but on the specific phosphors used in the CRT displays that emitted red, green, and blue light. They weren’t officially defined with respect to the CIE 1931 standards until Recommendation BT.709 for High Definition Television Systems (Rec. 709) in 1990.
Around that time, with the introduction of liquid crystal displays computer displays also had to start defining colors more accurately. They adopted the sRGB color space in mid to late nineties, using the same primaries as Rec. 709 but with a different data range and more flexible gamma control. Naturally, both of these standards based their color primaries on… the CRT phosphors used in NTSC and PAL televisions systems. And while the phosphors degrade and shift over time, they don’t shift anywhere near as much as the backlights of an LCD. Meaning that prior to the early 2000s, when LCDs really took off, calibration was far less of an issue.
Now we have to worry not only about the condition of the display and its shifting calibration, but which of the multiple color spaces and new EOTFs (gamma curves) the display or application works with, what client deliverables need to be, and which parts of the process may or may not be fully color managed with our target spaces supported.
And then we have film. Right up until the advent of end to end digital production, film had the massive benefit of “what you see is what you get”—your color space was the color space of the film stock you were using for your source, intermediates, and masters. Now with the DCI standard of using gamma corrected CIE X’Y’Z’ values in digital cinema masters, you have to be far more cautious of projector calibration: it’s not possible to convert from CIE X’Y’Z’ into proper color output without regularly measuring the projector’s actual output values. And we’re not going to talk about the nightmare of DCI white points and desktop displays that use the DCI-P3 color space.
Oh, and by the way, every camera sees the colors differently than the actual color spaces you’re trying to shoot in, and may or may not be conforming the camera color primaries to Rec 709, DCI-P3, or something else. Because this needed to be more complicated.
Fortunately, with a basic understanding of color management and color calibration navigating the modern color problems is actually much more manageable than it all appears on face value. In our next post we’re going to be discussing RED Digital Cinema’s Image Processing Pipeline 2 (IPP2), and why it’s the perfect paradigm for solving the modern color management problem.
But in the meantime, if you’re working in the Utah area and want to figure out the best way of calibrating your workspace or home office, give us a call. We’ve got the right equipment and know how to make sure that when you look at your display or projector, you’re seeing as close to the standards as possible.
Color and deliver with confidence: make sure it’s calibrated.
Written by Samuel Bilodeau, Head of Technology and Post Production
ADDENDUM: Color management and calibration are trickier than I’ve made it sound. I’ve simplified a few things and tried to be as clear as possible, but there are many, many gotcha’s in the process of preserving color that can make it maddening. And this is one area where a small amount of knowledge and trying to do things yourself can get you into huge amounts of trouble really quickly.
Trial and error is important to learning, and often it’s still the only way to feel out exactly what an application is doing to your files. But be smart: calibrate your displays and let the programs manage things for you, unless you’re intending on experimenting and know the risks associated with it. Footnotes:
1 Note, this is not a bad thing. In most cases it’s a good thing. It’s just something to be aware of and to understand how it works.
2 It’s also possible to use lookup tables to shape the signal for viewing on a reference display. Here, the software will measure the actual values produced by the display, and calculate the offsets as values to put in a 3D LUT. When attached to multiple displays using the same professional signals, LUTs should be applied using external hardware, when attached to one display only it’s acceptable to apply the LUT in the software application generating the output signal or in a hardware converter. Ensure that the LUT is not applied to any place on the signal upstream of the final output recording.
3 This is a big problem with the iMac, or any other Wide Gamut / DCI-P3 display. Colors will look different than expected without enabling color management within After Effects.
4 At least it did, until DaVinci Resolve Beta 14b8, 14b9, and 14.0 release - the option to flag on and off color management for the display disappeared with this update and I haven’t had time to test whether it’s on by default, works under Windows, or whether they’ve gone a different way with their color management.