Understanding Your Histogram Part Three

Understanding Your Histogram : Part 3 – General Rules

If you’ve read Part 1 and Part 2 of this series, you should have a firm understanding of what a histogram is and at least a basic understanding of how to read it. However, you still might be at a bit of a loss as to how you can use that information to improve your photography. In this article, I’ll discuss three of the most important adjustments that you should make based on your histogram.

The Perfect Histogram

Many photographers want to know what the perfect histogram should look like, and the answer provided by most authors on the subject is usually this: There’s No Such Thing.

While this is technically true, it’s also somewhat misleading to the beginner. To be more helpful, we need to pair our first inquiry with another question, and first ask “What does the perfect photograph look like?” If you answer, “It should have as much highlight detail as possible while retaining as much shadow detail as possible”, then there are definite implications for your histogram. If your answer is “It should be pure white with no detail except in the subject”, then there are different implications. This second answer, incidentally, is very typical for product shots and portraits taken against a white backdrop. In most circumstances for the amateur, though, and in virtually all landscape photography, the goal is to maintain as much detail as possible, so I’ll proceed with that consideration in mind.

[During post processing, as a general rule, I like to have at least a little pure white in my image and a little pure black, so I adjust the curves or levels accordingly.]

Potential Problem 1: Clipped Highlights

Example of histogram without clipped highlights
Click to enlarge. This histogram shows an image with relatively safe highlights, and you can see detail in most of the feathers. The slight clipping in the red and green channels (shows as yellow) was actually caused by output sharpening for the web.

As we all know, the detail in digital  photographs is formed by pixels of varying brightness and color. A group of pixels that all have the same RGB value would simply be a solid color or shade of grey, there would be no detail present within it. Detail can be created by varying the over-all brightness of  adjacent pixels or varying brightness between color channels.  Keep in mind that anytime the RGB values are equal to each other, the result is a shade of grey, and variation in any one channel from that creates a color cast. We also know that each channel has a range of values from 0-255 in an 8-bit scale.

Suppose that we’re taking a black and white photo of 3 adjacent blocks of grey, and with a correct exposure, Block 1’s value is 200, Block 2 is 220, and Block 3 is 250. What happens if we over expose the photo a little, and each value is raised by 5? Nothing very important. The whole scene is a little brighter than it should be, but it can easily be adjusted back down to the correct values in post processing with no loss of information (see the first two lines of the figure below).

Effects of Over Exposure on Histogram
(Click to Enlarge) Three exposures of 3 blocks of grey. The first line is the correct exposure, the second line is correctable, but the third line loses contrast in the highlights.

Suppose that we over expose a bit more, though, and the values are all raised by 20 instead. Again, all of the values are brighter: 200 becomes 220, 220 becomes 240, but 250 becomes 255 because that’s the top of the scale;  instead of going up to 270, this tone has now been clipped! How does this effect our image? Notice that in absolute terms, there is no loss of detail; there’s still a difference between the Block 2 and Block 3, but the relationship between the two has changed. When we shift the exposure down in post processing, and the values lose 20 levels each, there are only 15 levels separating the two blocks instead of 30; the contrast between the two has been lost.

The progression here is probably obvious at this point. Suppose that we over-expose more than that, and each value is raised by 35 tones. It should be obvious that Block 2 and Block 3 are now both going to be 255, while Block 1 is still not clipped, at 235. No matter how much adjusting is done after the fact, it will be impossible to recover the tonal difference (and thus, detail) between Blocks 2 and 3; the relationship has been completely lost, and needless to say, further overexposure would also obliterate the relationship separating Blocks 1 and 2.

Example of histogram with clipped highlights
Here, I’ve simulated what the image would look like with clipped highlights, with a matching histogram. Incidentally, if you can’t see the differences between the tones in thse examples, you should consider getting an IPS monitor, or calibrating your current monitor.

In our example with grey tones, we were looking at three very distinct shades of grey (two of which were pretty dark) and it took quite a bit of over-exposure to lose detail. In the real world, though, the highlights of a photo can be rich with subtle textures and tonal grades. The differences between the real-world Block2 and Block3 are likely to be only one or two levels. Consequently,  any instance in which you have data actually pushed up against the 255 mark of your histogram is likely to represent some loss in detail that is impossible to recover. If you’re shooting in color (and we all should be, shooting RAW) then it’s also important to recognize that when all three channels clip (255,255,255 RGB), the color is also lost… if all of the channel numbers are equal, the tone is neutral… so no matter how much you lower the exposure later, you’ll still just get grey. Similarly, if only one or two of the RGB channels is clipped, the relationship between them is effected, causing a color shift.

General Rule #1 : Keep the brightest tones in your image below the white point (255) on your histogram if you don’t want to lose detail.

Tea With Over-Exposed BackgroundIn some cases, it is expected and acceptable to have some clipping: if the sun is in your photo, or light bulbs, or shiny highlights in chrome, for example. Capturing detail in these areas would mean gross under exposure of the rest of the photo. These are also things that we perceive without detail in our daily lives, so it can actually be disconcerting if they have too much detail in a photo.

As mentioned previously, there are also specific circumstances in which you’ll prefer to lose highlight detail. About a year ago, for example, I shot the catalog photos for a tea shop in Snohomish, WA. The teas were to be photographed on pure white, to blend in with the pure white of the website background. Because of production time constraints, several hundred loose teas were set out for me on sheets of white paper. While photographing them, I over-exposed so that any textural detail in the paper would be lost, and in post processing, I corrected the exposure for the teas (a simple, batch command, since they were all equally over-exposed). On the other hand, if you’re shooting a bridal portrait, it is not acceptable to blow out the highlight detail in the gown for which the bride just payed thousands of dollars.

Histogram in Adobe Camera RAW Showing Overexposure
Notice that the exposure for this RAW file has not been adjusted; the histogram shows some clipped highlights. I’ve raised the blacks substantially to compensate for the over-exposure; otherwise the photo would look very washed-out.

When You’re Shooting: Most digital cameras these days can be set so that they display the histogram after the shot, which is very helpful. You can quickly check the histogram and make sure that there’s a little space between your data and the right side of your histogram, and keep shooting. Another option is to have the camera display areas where highlights are clipped on the photo – they usually blink – which also gives you an indication of where the problem is. If there’s too much blinking, adjust your exposure compensation down 1/2 stop (or adjust your exposure any other way you choose) and re-shoot.

Keep in mind that sometimes only one of the RGB channels will clip, but the area will still blink. If this is the case, you might still have some highlight detail in the non-clipped channels, so the exposure might actually be acceptable. The same is true if your display shows a combined histogram instead of separate color channels, so if you want the most information to base your exposure on, set your camera to display histogram info for all three colors.

Potential Problem 2: Under-Exposure

An analogous problem exists at the left side of the histogram, and it’s complicated by additional factors that will be discussed below. Shadow detail tends to fall off a little more gently than highlights clip, but getting good shadow detail can still be a very difficult task in digital photography.

When You’re Shooting: If you glance at your histogram and notice that a lot of pixels are piled up at 0, you should consider sliding your exposure compensation to the positive side. Depending on your photographic goals, it may even be worth blowing out highlights… especially if your subject is in the shadows.

Potential Problem 3: Expose To The Right

“Expose to the right” has become something of a mantra for many landscape photographers after the publication of the the article on the subject by Michael Reichman around 2003. As with anything on the internet, there is some debate regarding this technique, and I recommend using it in moderation rather than as an absolute rule.

This principle is based on the fact that (1) our camera sensors capture data in a (roughly) linear fashion and (2) our sensors always create a certain amount of extra, random data (ie, digital noise).

Most DLSR sensors capture 14-bit images (16,384 levels)  these days, and have a dynamic range of about 10 f-stops. If the capture of these tonal levels were evenly distributed across all ten f-stops, then we’d see that each stop would be recording about 1638 levels, and although exposing to the right would still be important (not getting any tones in the brightest stop on the histogram would mean a loss of 10% of your available levels), it would be a negligible difference in most cases.

But that’s now how our sensors work. Instead, the first f-stop contains a full HALF of the available levels (8192), the next stop contains half of that (4096), the next stop half again (2048), etc.  This means that the brightest 3 stops of your exposure contains about 88% of all of the possible levels of tonal distinction. The darkest 3 stops combined, on the other hand, contain only 128 levels ( 0.7%).

Expose to the Right Diagram
If you’re not in danger of clipping highlights, increase your exposure to move the data in your histogram to the right.

These numbers are approximate, of course: not all sensors are the same- some are not exactly linear in their capture, and some have more dynamic range than others- but the general idea is valid: your camera is capable of capturing more information in the brighter portions of an image than the dark. Furthermore, if the sensor is generating 10 levels worth of noise, that noise is a significant portion of the image forming data in the lower three stops, but it’s negligible in the upper three. Put another way, the signal to noise ratio in the dark tones is quite bad (128:10), but quite good in the bright tones (14226:10). This is why digital noise is always most problematic in shadows, of course.

When You’re Shooting: To get the best signal to noise ratio and make use of the most tonal levels, you should over-expose your image until your highlights are as far right as possible on the histogram without clipping any channel. Your photo will not look good coming out of the camera, but when the exposure is corrected in post processing, you’ll have less noise and more detail to work with. I don’t recommend this for jpg shooters (but I also don’t recommend shooting jpg).

Expose to the Right Examples
These are screen captures from Camera Raw, since the images from the back of my camera were not available. Notice that in the top image (which probably looks more accurate for the scene) there’s plenty of room on the right of the histogram. The lower image was with an extra stop of exposure. It doesn’t look as good coming out of the camera, but it should produce a better image when processing is complete.

If you’re still getting comfortable with exposure compensation and would like like a fail-safe, or if you’d like to have more options, auto-exposure bracketing can also be used to provide one or more additional exposures with more (or less) exposure. Consult your manual.

Histograms display an incredible amount of information, so the more that you get familiar with them and how they should look to match what you’re trying to capture, the better your images will be. One of the advantages of using your histogram in the field is that you can get an accurate representation of your exposure even if it’s too bright for your LCD to be worth looking at otherwise. The same idea holds true to some degree for post processing as well; even if you’re using a monitor that is too bright, you can tell whether your image really has blown highlights by checking out the histogram.

Since Part Three has run a bit longer than I’d anticipated, I’m going to pick up this thread for a few final examples in : PART FOUR, Situational Specifics

Editor-in-Chief
  1. I just skimmed the first 2 and read this one. Very helpful. I’ll need to come back and reread after processing a little bit. I had a basic knowledge of histograms, but this definitely helped boost the know how. Thanks, Matt!

  2. I just read through this after re-skimming the first two articles which I’d read more in-depth previously.

    The general gist of what I get (as someone totally new to both SLR photography & histograms) is that I need to somehow move the histogram as far to the right as I can, without introducing clipping.

    I understand at least one reason why this is recommended; which is, due to the math, I get a lower SNR on the right (brighter) side of the histogram.

    I guess my (dumb) question is, how do I move the histogram to the right? Do I do that by recomposing the shot, adjusting lighting, or using in-camera adjustments via ISO, shutter speed, exposure compensation, etc.?

    Thanks for yet another good article.

    Bill

    1. That’s right; there’s more information in the right side of the histogram, and there’s better signal to noise ratio… basically, the more photons that you’re capturing, the better the information that you’re getting.

      Moving the histogram to the right can be accomplished in different ways, but in general terms it is done by increasing the sensor’s exposure to light. If you were shooting in full manual mode, you could either open up the aperture, or lengthen the duration of the shutter speed, or both (increasing the ISO is not generally very helpful, since it is actually increasing the noise. Increasing the lighting doesn’t help, at least by itself, because your camera will correct for the brighter light to get the same exposure/histogram as before).

      If you are shooting in an automatic metering mode, though, as most of us do, then you’ll need to use exposure compensation instead, since the camera will offset any adjustments that you make otherwise (ie, if you’re in aperture priority mode and increase the size of the aperture, the camera will adjust to what it thinks is the correct exposure… not the over-exposure that you’re going for).

      Since you’re shooting with a 60D, exposure compensation is easily controlled with your thumb on the big flat dial on the back of your camera to the right of the LCD. That’s been a feature of the EOS line almost from the beginning, and it’s one of the reasons that Canon’s are so comfortable for me to shoot :) You’ll see the exposure compensation meter moving in the viewfinder as you turn that dial. It’s important to remember to return it to zero after you’re finished with that particular shooting situation.

      Keep in mind, though, that ETTR is actually not necessary most of the time. Most photos have a dynamic range that is greater than we can capture, so the more important thing is to not clip the highlights.

  3. Thanks Matt, very informative post!

    One thing I’m curious about is the “debate” you mentioned regarding Expose to the Right. Your explanation made technique pretty much seem like an unambiguously good thing. So my question is: What’s the downside to exposing to the right?

    I can only come up with 3 possibilities, and none of them seems very persuasive (certainly not enough to create a “debate” given the advantages that the technique apparently offers).

    (1) The Expose to the Right method says to move the data to the right to the extent you can *without blowing out highlights that you want to keep*. But if people are sloppy or not paying attention they might forget the second part, and end up blowing out highlights more often than if they didn’t use the technique.

    (2) “It’s cheating.” This might be the objection from those who disdain post processing and like to delude themselves that what “comes out of the camera” is somehow pure and pristine, where as post-processed images are false and constructed — as if the camera hasn’t already processed the image in dozens of ways using the software in the camera.

    (3) “I don’t have all day.” Correcting the exposure in post takes time (although not much, especially since most software gives lets you batch process in one way or another), and some people will find that a bigger downside than others.

    Of those, (3) makes the most sense to me — I could see it if you are really in a rush or just loath working at a computer for even a few minutes. (1) I find less persuasive, but I can see a bit as well, maybe. (2) I think is just stupid.

    So are any of these arguments part of the non-Reichman side of the “debate”? Does the other side have anything else to say for itself?

    1. Hi Mike,

      First of all, let me say that the debate is pretty one-sided. For the most part, detractors of “Expose to the Right” (ETTR) actually only take issue with the strictness of its application, and these are objections based on pretty technical little issues. These people still say that ETTR is a good idea, just not to rely on it as gospel… and in this regard, I’m sympathetic.

      On the other hand, I’ve seen a few articles that make bolder claims. One of the most prominent is called “Why ‘Expose to the Right’ is Just Plain Wrong” from the CHROMASOFT website.

      Despite the title, the main thrust of the author’s argument is this: If you expose to the right one extra stop, the image quality is better, but not any better than lowering your ISO one stop and exposing normally. The article contains several photographic examples that are very helpful, though they only address signal-to-noise and not highlight/shadow detail. He concludes that the only time that ETTR is a good idea is in those ‘limited circumstances’ in which the photographer is already shooting at their lowest ISO.

      A secondary argument is that RAW processing engines apply a specific color curve based on the brightness of tones, so ETTR can cause color shifts and make more work for you in post processing… which is in line with your 3rd possibility.

      I’m honestly not sure why the author thinks that his primary point is an argument against ETTR: A) The fact that there are other ways to improve image quality does not diminish the fact that ETTR is effective and B) ETTR works when ISO adjustment will not, and C) ETTR can improve shadow detail (ignored by the author). Anyway, there are plenty of people who have spent much more time than I’m willing to on responding to guys like this… you might find some interesting comments following his post, or if you do a Google search :)

      Another interesting discussion on the topic, if you really want to go crazy on it, is called “Debunking ETTR“, and it has something like 31 pages of comments. :)

      – Matt

    2. Incidentally, you’ve touched on a couple of the most common objections to ETTR; it does increase the risk of clipped highlights, and it can make post processing tricky.

      When black and white film was all the rage, the technique was actually very similar; I have always assumed that ETTR was devised with black and white film in mind. Back then, it was “Expose for the shadows, develop for the highlights.” Since the shadows were the thinnest (ie, most transparent) part of the negative, you’d increase the exposure to bring in detail into the film, and then while developing the film (if you were using sheet film you could tailor developing to each particular image), there were a variety of methods to get the shadows to develop faster than the highlights… you could use very weak developer and not agitate, for example… so the developer working on the highlights would deplete (because it had a greater reaction there) but the developer in contact with the shadows would continue working because it hadn’t reacted very much yet.

      Anyway, that’s all just to say that although there are lots of “purists” out there who make the kinds of objections that you mention in (2), you’re right about the “stupid” part.

      I actually think that the issue of clipped highlights isn’t that big a deal when it comes to ETTR. It’s really only used in situations in which you have time to make an exposure, determine that there’s room to overexpose, and shoot another shot. So, you’ll probably have a non-blown exposure anyway… and if you do clip, it’s obvious by looking at the histogram that another adjustment needs to be made.

      The issue of post processing being time consuming is probably the biggest real concern. Unfortunately, batch processing isn’t usually an option because when you’re in the field, you have to adjust your camera’s exposure based on the scene and lighting… so sometimes you’ll be overexposing by a stop, sometimes two stops, sometimes 1/2 or 2/3rds of a stop, etc.

      Of course, if speed is an issue, you’ll generally have the original, non-ETTR photo also, unless you’re a pro with exposure and use compensation on the fly. In any case, I think that if you’re doing photography at the level that you care about exposing to the right, you’ll probably be willing to spend a little time in post; it’s a lot less time than developing a sheet of film :)

      – Matt

Your email address will not be published. Required fields are marked *