Tag Archives: ice and snow

Rivers of Ice

Oh, Yakutsk! It has been a long time – 2012, to be exact – since we last spoke about you (on our sister blog). It was a different time back then, with me still referring to the EUMETSAT Natural Color RGB as “pseudo-true color”. (Now, most National Weather Service forecasters know it as the “Day Land Cloud RGB”). VIIRS was a only a baby with less than one year on the job. Back then, the area surrounding the “Coldest City on Earth” was on fire. This time, we return to talk about ice.

You see, rivers near the Coldest City on Earth freeze during the winter, as do most rivers at high latitudes. Places like the Northwest Territories, the Yukon, Alaska and Siberia use this to their advantage. Rivers that are frozen solid can make good roads, a fact that has often been overly dramatized for TV. Transporting heavy equipment may be better done on solid ice in the winter than on squishy, swampy tundra in the summer. But, that comes with a cost: ice roads only work during the winter.

In remote places like these, with few roads, rivers are the lifeblood of transportation – acting as roads during the winter and waterways for boats during the summer. But, what about the transition period that happens each spring and fall? Every year there is a period of time where it is too icy for boats and not icy enough for trucks. Monitoring for the autumn ice-up is an important task. And, perhaps it is more important to monitor for the spring break-up of the ice, since the break up period is often associated with ice jams and flooding.

We’ve covered the autumn ice up before on this blog, but VIIRS recently captured a great view of the spring break up near Yakutsk, that will be our focus today.

We will start with the astonishing video captured by VIIRS’ geostationary cousin, the Advanced Himawari Imager (AHI) on Himawari-8 from 18 May 2018:

The big river flowing south to north in the center of the frame is the Lena River. (Yakutsk is on that river just south of the easternmost bend.) The second big river along the right side of the frame is the Aldan River, which turns to the west and flows into the Lena in the center of the frame.

Now that you are oriented, take a look at that video again in full screen mode. If you look closely, you will see a snake-like section of ice flowing from the Aldan into the Lena. This is exactly the kind of thing river forecasters are supposed to be watching for during the spring!

Of course, this is a geostationary satellite, which provides good temporal resolution, but not as good spatial resolution. The video is made from 1-km resolution imagery, but we are looking at high latitudes on an oblique angle, so the resolution is more like 3-4 km here. (Note: the scene in the video above is approximately the same latitude as the Yukon River delta, so this acts as a good preview of what GOES-17 and its Advanced Baseline Imager [ABI] will offer.) So, how does this look from the vantage point of VIIRS, which provides similar imagery, but at 375 m resolution? See for yourself:

(You will have to click on the image to get the animation to play.)

Animation of VIIRS Natural Color RGB composite of channels I-1, I-2 and I-3 (18 May 2018)
Animation of VIIRS Natural Color RGB composite of channels I-1, I-2 and I-3 (18 May 2018)

This animation includes both Suomi NPP and NOAA-20 VIIRS. That gives us ~50 min. temporal resolution to go with the sub-kilometer spatial resolution. Eagle-eyed viewers can see how the resolution changes over the course of the animation, as the rivers start out near the left edge of the VIIRS swath (~750 m resolution), then on subsequent orbits, the rivers are near nadir (~375 m resolution) and then on the right edge of the swath (~750 m resolution again). In any case, this is better spatial resolution than AHI can provide (or ABI will provide) at this latitude.

One thing you can do with this animation is calculate how fast the ice was moving. I estimated the leading edge of the big “ice snake” moved about 59 pixels (22.3 km at 375 m resolution) during the 3 hour, 21 minute duration of the animation. That works out to an average speed of 6.7 km/hr (3.6 knots), which doesn’t seem unreasonable. Counting up pixels also indicates our big “ice snake” is at least 65 km long, and the Aldan River is nearly 3 km wide in its lower reaches when it meets the Lena River. That is in the neighborhood of 200 km2 of ice!

That much ice moving at over 3 knots can do a lot of damage. Just look at what the ice on this much smaller river did to this bridge:

(Make sure you watch it all the way to the end!)

A Graduate Level Course on DNB and NCC

Is there any post on this blog that doesn’t have to do with scaling the DNB or NCC?

I was going to title this post “Revisiting ‘Revisiting “Revisiting Scaling on the Solstice”‘”, but that would just be ridiculous. Besides the fact that we just passed an equinox (and are months away from a solstice), this post is more of a follow-up to our very first post.

If that was an introduction, this is a graduate level course. Well, maybe not. It won’t take a whole semester to read through this, unless you are a really slow reader. But, since Near Constant Contrast (NCC) imagery is coming to AWIPS in the very near future, now is a good time to prepare for what’s coming.

We start off with some good news: NCC imagery is coming to AWIPS! NCC imagery provides an alternative to ERF-Dynamic Scaling, CSPP Adaptive Scaling and whatever this is:

Example VIIRS DNB image displayed in AWIPS using the Histogram Equalization method
Example VIIRS DNB image displayed in AWIPS using the Histogram Equalization method. Courtesy Eric Stevens (UAF/GINA).

(I know that the above image uses the “Histogram Equalization” algorithm that was developed for CSPP originally. I was just being dramatic.) NCC imagery is an operational product, not some fly-by-night operation from CIRA or CIMSS (who both do great work, by the way).

Now the bad news: NCC imagery as viewed in AWIPS might not be the best thing since sliced bread. It may not solve all of our problems. To understand why, you have to know the inner workings of AWIPS (which I don’t) and the inner workings of the NCC EDR product (which I do).

Here’s a first look at the NCC product as displayed in AWIPS:

Example NCC image (12:39 UTC 19 August 2015) displayed in AWIPS II
Example NCC image (12:39 UTC 19 August 2015) displayed in AWIPS II. Image courtesy John Paquette (NOAA).

Notice the bright area of clouds northwest of Alaska that suddenly become black. Also notice the background surface just looks black, except for the Greenland Ice Sheet. These are examples of two different (but related) issues: the first being that AWIPS is blacking out areas where the image is saturated (the maximum value on the scaling bounds is too low), the second being that, at the low end of the scale, the image detail is lost (either the minimum value on the scaling bounds is too high, or AWIPS uses too few shades of gray in the display, which means you lose sensitivity to small changes in value).

If you read the first post on this blog (that I linked to), or you read my previous posts about ERF-Dynamic Scaling, you know that the primary problem is this: the VIIRS Day/Night Band is sensitive to radiance values that span 8 orders-of-magnitude from full sunlight down to the levels of light observed during a new moon at night. Most image display software, of which AWIPS is an example, are capable of displaying only 256 colors (or 96 colors if you use N-AWIPS). How do you present an 8-order-of-magnitude range of values in 256 colors without losing information?

Near Constant Constrast imagery does this by modeling the sun and moon to convert the Day/Night Band radiance values into a “pseudo-albedo”. Albedo (aka reflectance) is simply the percentage of incoming solar (and lunar) radiation that is reflected back to the satellite, so you end up with a decimal number between 0 and 1. That’s easy enough to display, but we’re not done. What happens when there is no moonlight at night because the moon is below the horizon (or it’s a new moon)? What happens when there is a vivid aurora, or bright city lights, or gas flares or fires? These light sources can all be several orders of magnitude brighter than the moon, especially when there is no moonlight. There are lots of light sources at night that the DNB detects that aren’t reflecting light – they’re emitting it. That’s why the NCC doesn’t provide a true albedo value.

When VIIRS first launched into space, the NCC algorithm assumed that pseudo-albedo values over the range from 0 to 5 would be sufficient to cover all these light sources, but that turned out to be incorrect.  If you weren’t within a few days of a full moon, images contained fill values (no valid data) because these myriad light sources fell outside the allowed range of 0 to 5. It took a lot of work by the VIIRS Imagery Team to fix this and get the NCC algorithm to where it stands now. And where it stands now is that pseudo-albedo values are allowed to vary over the range from -10 to 1000. (The “-10” accounts for the occasional negative radiance in the DNB data and the “1000” allows for light sources up to three orders of magnitude brighter than the moon.) Now, the images don’t saturate or get blanked out by fill values at night away from a full moon. But, the range from -10 to 1000 still presents a challenge for those who want to display images properly.

To show this, here are the same three VIIRS NCC images linearly scaled between the full range of values (-10 to 1000), the original range of values (0 to 5) and the ideal range of values (which was subjectively determined for this scene):

Example VIIRS NCC image (08:55 UTC 5 August 2015) linearly scaled between -10 and 1000
Example VIIRS NCC image (08:55 UTC 5 August 2015) linearly scaled between -10 and 1000.

Can you see the one pixel that shows up in the above scaling? (There is one pixel with a value over 900.)

Example VIIRS NCC image (08:55 UTC 5 August 2015) scaled between 0 and 5
Example VIIRS NCC image (08:55 UTC 5 August 2015) scaled between 0 and 5.

Now you can start to see some cloud features and the city lights, but this image still looks too dark.

Example VIIRS NCC image (08:55 UTC 5 August 2015) scaled between 0 and 1.5
Example VIIRS NCC image (08:55 UTC 5 August 2015) scaled between 0 and 1.5.

Now we’re talking!

The above images were taken when there was moonlight available. What happens when there is no moonlight?

Example VIIRS NCC image (12:57 UTC 26 July 2015) scaled from -10 to 1000
Example VIIRS NCC image (12:57 UTC 26 July 2015) scaled from -10 to 1000.

Scaling over the full range of values means you only see the city lights of Honolulu and the islands drawn on the map.

Example VIIRS NCC image (12:57 UTC 26 July 2014) scaled from 0 to 1
Example VIIRS NCC image (12:57 UTC 26 July 2014) scaled from 0 to 1.

Scaling from 0 to 1 is better, but I would argue that it’s still too dark. Let’s stretch it further.

Example VIIRS NCC image (12:57 UTC 26 July 2015) scaled between 0 and 0.5
Example VIIRS NCC image (12:57 UTC 26 July 2015) scaled between 0 and 0.5.

This is about as good as you can do without the image becoming too noisy.

And, of course, the presence of the aurora gives yet another result:

Example VIIRS NCC image (11:32 UTC 22 January 2015) scaled from -10 to 1000
Example VIIRS NCC image (11:32 UTC 22 January 2015) scaled from -10 to 1000.

Can you see the aurora over northern Alaska? Maybe just barely. Once again, scaling over the full range of values doesn’t work (just like it wouldn’t for the DNB radiance values). What about using the scale of 0 to 1.5? It worked before…

Example VIIRS NCC image (11:32 UTC 22 January 2015) scaled from 0 to 1.5
Example VIIRS NCC image (11:32 UTC 22 January 2015) scaled from 0 to 1.5.

GAHH! I’m blinded! Although, you can see the clouds over the Gulf of Alaska pretty easily as well as ice leads in the Arctic Ocean. But, the aurora is too bright and you can’t see any details over most of Alaska.

It turns out, in order to prevent the aurora from saturating this scene, the image needs to be scaled over a range of 0 to 21:

Example VIIRS NCC image (11:32 UTC 22 January 2015) scaled from 0 to 21
Example VIIRS NCC image (11:32 UTC 22 January 2015) scaled from 0 to 21.

But, notice that you lose the detail of the cloud field over the Gulf of Alaska and the ice over the Arctic Ocean. This is a difficult case to scale correctly. More on that later.

So, we’ve seen that the optimum scaling bounds vary from scene to scene. The 0 to 1.5 scale seems to work for daytime and full moon scenes. New moon scenes require a scale more like 0 to 0.5 (or thereabouts) to be able to detect clouds, snow and ice. And the occasional scene requires a totally different scale altogether. Wouldn’t it be great if there were some way to automate this, so we wouldn’t have to keep fussing with the scaling on every image?

I’m here to say, “there might be.” And, it’s called “Auto Contrast.” The idea is to do what Photoshop and other image editing software do when they “automatically” improve the contrast in the image. The idea is to take the NCC image data, scaled over a range from 0 to 2, for example, bump up the maximum value bound of the scaling with the same kind of adjustment the ERF-Dynamic Scaling uses to prevent saturation in auroras, then apply something similar to Photoshop’s Auto Contrast algorithm to create the ideal scene contrast. Here’s what Auto Contrast does for the three cases above:

Example VIIRS NCC image (08:55 UTC 5 August 2015) scaled with Auto Contrast
Example VIIRS NCC image (08:55 UTC 5 August 2015) scaled with Auto Contrast.
Example VIIRS NCC image (12:57 UTC 26 July 2015) scaled with Auto Contrast
Example VIIRS NCC image (12:57 UTC 26 July 2015) scaled with Auto Contrast.
Example VIIRS NCC image (11:32 UTC 22 January 2015) scaled with Auto Contrast
Example VIIRS NCC image (11:32 UTC 22 January 2015) scaled with Auto Contrast.

For the first two cases, Auto Contrast is very similar to the subjectively determined “ideal scaling”. For the aurora case, we can see that Auto Contrast is a compromise between “not allowing the aurora to saturate” and “allowing the aurora to saturate half of the image.” The aurora does saturate a portion of the scene, but you can still see ice on the Arctic Ocean and clouds over the Gulf of Alaska when you look closely.

Of course, there are a few caveats:

1) Auto Contrast has not been fully tested. These results are promising enough that I wanted to share it right away, but it might not produce ideal results in all cases. We are continuing to investigate this.

2) Sometimes, the image has poor contrast that Auto Contrast can’t fix. For example, a new moon case over land where there are lots of city lights or a vivid aurora. Non-city areas will be more like the Hawaii case, where clouds have pseudo-albedo value between 0 and 0.5, and the city lights or aurora will have pseudo-albedo values well over 100. If you stretch the scaling enough to see the clouds, you’ll be blinded by the city lights. If you scale it to the city lights, you won’t see the clouds or snow or ice.

3) Individual users may not care that the aurora saturated half the image in the third example because they can see the clouds and ice just fine. Auto Contrast makes the clouds and ice darker and harder to see. This is example of how “ideal contrast” not only varies scene to scene, but also from one user application to another. Pretty pictures are not always the same thing as usable images.

4) Demonstrating the utility of “Auto Contrast” is not the same thing as getting the algorithm up and running within AWIPS. (Or, sending files to AWIPS that have optimized contrast.) The JPSS Imagery Team is working with the developers of the AWIPS NCC product to improve how it is displayed, but it will likely take some time.

While it’s not clear how the NCC images are currently scaled in AWIPS, they almost certainly use a fixed scale. However, the examples shown here make it clear that the scaling needs to adjust from scene to scene – even if Auto Contrast is not the ultimate solution. So while we work to figure this out, if the NCC imagery looks sub-optimal in your AWIPS system, you know why.

One final thought: the Auto Contrast algorithm is designed to work with any image, not just NCC images. It’s possible that DNB images created with ERF-Dynamic Scaling may be improved with Auto Contrast as well. But, that’s a topic for another blog post about image scaling for the future. I may yet title a post “Revisiting ‘Revisiting “Revisiting Scaling on the Solstice”‘”.

The nice (and dedicated) people of N-ICE

Imagine this scenario: you’re stuck on a boat in the Arctic Ocean in the middle of the night. The winds are howling, the air is frigid, and the boat you’re in is completely encased in ice. Step off the boat and your face is constantly sand-blasted by tiny ice particles. Blink at the wrong time and your eyes freeze shut. The ice may crack under your feet (or between you and the boat)  – without notice – leaving icy water between you and the only warm place for hundreds of kilometers. Have to swim for it? Look out for jellyfish. Decide to stay on your crumbling patch of ice? I hear polar bears can get pretty hungry. Death awaits every misstep and every wrong turn. Cowering in the boat? Internet access is limited, there are no re-runs of Friends to keep you entertained, and the shuffleboard court is outside. (Actually, it’s worse than that: there is no shuffleboard court!)

Now imagine this: you actually wanted to be there!

Most people would say, “That’s crazy! I would never do that!” But, for the scientists and crew aboard the research vessel (RV) Lance, it is a unique opportunity to further our understanding of the Arctic and its role in the Earth’s climate system.

You see, we are nearing the mid-point of the N-ICE 2015 field experiment, which is taking place from 1 January to 1 August 2015. The idea behind the experiment is to take a boat, freeze it in the Arctic ice sheet, and constantly monitor the environment around the boat for about six months. A group of scientists work in six-week shifts where they monitor everything from the weather to local biology. Of course, the primary objective is to see what happens with the ice itself.

One of our very own researchers at CIRA (and one of the world’s leading experts on snow) was on board during the first leg of the experiment.  So, what is a snow expert doing on a ship whose primary purpose is to study ice?

Here’s the lowdown. There are two types of ice that concern Arctic researchers: “young” and “multi-year”. As the name implies, multi-year ice is ice that survives the summer and lasts for more than one year. Young ice does not reach its first birthday – it melts over the summer. Arctic researchers have been finding out that, not only is the Arctic ice sheet shrinking, it’s lost most of its multi-year ice, which is being replaced by young ice.

Multi-year ice is thicker, more resilient and tends to be brighter (more reflective), while young ice is thinner, darker (less reflective of sunlight), and less resilient. The less sunlight that is reflected, the more sunlight is absorbed into the system and this leads to warming, which melts more ice (and is a positive feedback). The less ice there is, the more open ocean there is, and open water is a lot less reflective than ice, which leads to more absorption of sunlight, more warming, more melting, etc.

The thinner “young ice” breaks up more easily due to wind and waves. This creates more leads of open water. The water, being much warmer than the air above it, pumps heat and moisture into the atmosphere, creating more clouds and snow – just like lake-effect or sea-effect snow. And, while most people have a hard time believing it, snow is a good insulator. Snow on top of the ice will create a blanket that protects the ice from the really cold air above. This reduces the rate at which the ice thickens up, keeping the ice thinner, and we have another positive feedback.

That’s just one of the things being studied on the 2015 Norwegian Young Sea Ice Cruise. Of course, I wouldn’t be mentioning any of this unless VIIRS could provide information to help out with the mission.

Go back to the N-ICE 2015 website. Notice the sliding bar/calendar on the bottom of the map. You can use that to follow the progress of the ship. Or, you can use the VIIRS Day/Night Band.

At the time of this writing, the Lance is docked in Longyearbyen, the largest town on the island of Spitsbergen in Norway. (Spitsbergen is part of the Svalbard archipelago, which has a direct connection to VIIRS. Svalbard has a receiving station used by NOAA that collects and distributes data from nearly all of their polar-orbiting satellites.) Longyearbyen is where the RV Lance and Norwegian icebreaker KV Svalbard departed for the Arctic back in mid-January. KV Svalbard escorted the RV Lance into the ice sheet, then returned to Longyearbyen while the Lance froze itself into the ice. See if you can see that in this loop of VIIRS Day/Night Band images from 12 – 17 January 2015:

Animation of VIIRS Day/Night Band images from 12-17 January 2015
Animation of VIIRS Day/Night Band images from 12-17 January 2015. These images cover the area of the N-ICE field experiment, north of Svalbard.

Notice how the one bright light follows a lead in the ice until it stops. Then the light appears to split in two, with one light source heading back the way it came and the other stuck in the ice. That is the start of N-ICE 2015!  The KV Svalbard did its duty. If you look closely, there are also some other boats hanging out in the open water near the edge of the ice sheet during this time.

If you suspect there are jumps in the images you’re right. VIIRS passes over this area every day 6-8 times between 00 and 12 UTC, with no overpasses for the next 12 hours.

Toward the end of January you can see how the RV Lance drifted to the west along with the ice:

Animation of VIIRS Day/Night Band images from 23-30 January 2015
Animation of VIIRS Day/Night Band images from 23-30 January 2015. These images cover the area of the N-ICE field experiment, north of Svalbard.

This was all according to plan. But, then, in February, the winds shifted and helped the ice spit the boat back out towards the open water:

Animation of VIIRS Day/Night Band images from 8-15 February 2015
Animation of VIIRS Day/Night Band images from 8-15 February 2015. These images show the area of the N-ICE field experiment, north of Svalbard.

After this, the RV Lance needed help from the KV Svalbard to be repositioned in the ice sheet near where it started a month earlier. Otherwise, all the instruments they placed in the ice would no longer be in the ice – they’d be at the bottom of the ocean as the ice sheet broke up all around them.

If you want to know why the ship seems to disappear and reappear every day, you can thank the sun. You see, the first few weeks of the experiment took place during the long polar night. But, by mid-February, twilight began to encroach on the domain during the afternoons. This was enough light to drown out the light from the ship. (Sunrise occurred in early March.)

Another thing to notice with these last two animations: the cloud streets that form over the open water near Svalbard. The direction these cloud streets move gives a pretty good indicator of where the ice is going to go, since both the clouds and icebergs are being pushed and pulled by the same wind.

It’s fascinating to watch the movement of the ice over the first 6 weeks of the field experiment. To save on file size and downloading time, the animation below only uses one image per day (between 10 and 11 UTC). Here’s 6 weeks of images in 5 seconds:

Animation of VIIRS Day/Night Band images from 11 January to 28 February 2015
Animation of VIIRS Day/Night Band images from 11 January to 28 February 2015. These images show the area of the N-ICE field experiment, north of Svalbard.

And you probably thought of sea ice as being relatively static.

Once again, we lose sight of the RV Lance because of afternoon twilight in mid-February, so we can’t see it or the KV Svalbard after that. And note that there’s a lot less open water near Svalbard by the end of the period.

What if we didn’t have the Day/Night Band? You wouldn’t be able to see the ships at all, that’s for sure! Plus, this area was under darkness (no direct sunlight) for this six week period, so none of the other visible wavelength channels will work.  That leaves us with the infrared (IR), which looks like this:

Animation of VIIRS IR (M-15) images from 11 January to 28 February 2015
Animation of VIIRS IR (M-15) images from 11 January to 28 February 2015. These images cover the area of the N-ICE field experiment, north of Svalbard.

Note that clouds appear to have a greater impact on the detection of ice (and distinction between ice and clouds) in the IR. When it’s relatively cloud-free, there is enough of a temperature contrast between the open water and ice to see the icebergs but, pretty much any cloud will obscure the ice. So, why doesn’t the Day/Night Band have this problem?

That has to do with the optical properties of clouds at visible and IR wavelengths. Most of these clouds are optically thick in the IR and optically thin in the visible. The Day/Night Band can see through these clouds (most of them, anyway) while channels like M-15 (10.7 µm) shown here, can’t. We’ve seen more extreme examples of this before.

In the rapidly changing Arctic, it is nice to know that there are a few dedicated individuals who risk frostbite, hypothermia and polar bears to provide valuable information on how the ice impacts the environment both locally and globally. Me: I’ll just stick to analyzing satellite data from my nice, comfortable office, thank you.

By the way, the N-ICE field experiment has it’s own blog, and pictures and other snippets of information about the people and progress of the mission are regularly posted to Instagram, Facebook and Twitter.

Revisiting “Revisiting Scaling on the Solstice”

Imagine that you are an operational forecaster. (Some of you reading this don’t need to imagine it, because you are operational forecasters.) You’ve been bouncing off the walls from excitement because of all the great information the VIIRS Day/Night Band (DNB) provides. “This is so great! Visible imagery at night! It helps in so many ways,” you say to yourself or to anyone within earshot. What’s more: you read this blog and, in particular, you’ve read this blog post and/or this paper. “All our problems have been solved! We can use the DNB for any combination of sunlight and moonlight! I am so happy!” Then you come across an image like this:

VIIRS DNB image created using "erf-dynamic scaling" (15:14 UTC 21 January 2015)
VIIRS DNB image created using “erf-dynamic scaling” (15:14 UTC 21 January 2015)

If you’re short tempered, you’re thinking, “@&*!@#&#!!!” If you have better control of your emotions, you’re thinking, “Me-oh-my! Whatever happened here?” Welcome to the third installment of the seemingly-never-ending series on how difficult it is to display the highly variable DNB radiance values in an automated way.

In the previous installment, which I will keep linking to until you click on it and re-read it, I outlined a great new way to scale the radiance values as a function of solar and lunar zenith angles that I call the “erf-dynamic scaling” (EDS) algorithm because it is based on the Gaussian error function (erf). This algorithm uses smooth, continuous functions to account for the 8 orders-of-magnitude variability in DNB data that occurs between day and night, and which was demonstrated to beat many previous attempts at image scaling. Unfortunately, that algorithm produced the image you see above.

So, is my algorithm a failure?

Well, if you’re going to jump right to “failure” based on this, you need to calm down and back off the hyperbole. Do you feel like a failure every time you make a mistake? Besides, mistakes are opportunities for learning.

My demonstration of the quality of the EDS method was based on images taken near the summer solstice. Now, we’re a month after winter solstice. And you know what happens in the winter that doesn’t happen in the summer? The aurora! (Actually, the aurora is present just as much in the summer, but you can’t see it because the sun is still shining.) Now that the nights are so long and dark, the aurora is easily visible.

My EDS method accounts for sunlight and moonlight. It doesn’t account for auroras and they can be several orders of magnitude brighter than the moonlight – especially near new moon when there is no moonlight. And guess when the image above was taken relative to the lunar cycle.

Now, I knew auroras would mess up my scaling algorithm (“Oh, sure you did!”), but I underestimated their occurrence. As a “Lower-48er,” I’ve seen the aurora once in my life. But, at high latitudes (*cough* Alaska *cough*) they happen almost every night in the winter. They’re not always visible due to clouds, but you can’t call them a “rare occurrence”.

From the perspective of DNB imagery, auroras can get in the way. Or, auroras can act as another illumination source to light up important surface features. Let’s look at the above image, with the data re-scaled by manually tweaking the settings in McIDAS-v:

VIIRS DNB image manually scaled (15:14 UTC 21 January 2015)
VIIRS DNB image manually scaled (15:14 UTC 21 January 2015)

Of course, this image is rotated differently, but that’s not important. The important thing is that you can see now that it’s an aurora and you can see surface features underneath it. Cracks in the sea ice are visible! (And, remember, there is no moonlight here – just aurora and airglow.) Much better than the wall of white image, right? This proves that it’s a problem with my scaling and not with the DNB itself.

So, how do we get my scaling to work for this case? In theory, the answer is simple: bump up the max values until it’s no longer saturated. In practice, however, it’s not that simple. This was a broad, relatively diffuse aurora that was barely brighter than the max values. Some auroras are much more vivid (and much brighter than the max values), like this one:

VIIRS DNB image with modified "erf-dynamic scaling" (11:34 UTC 22 January 2015)
VIIRS DNB image with modified “erf-dynamic scaling” (11:34 UTC 22 January 2015)

If you increase the max values until nothing is saturated, you’ll only be able to see the brightest pixels (which are usually city lights) and nothing else. And, don’t forget: we don’t want to increase the max values everywhere all the time, because the algorithm works as-is when the aurora isn’t present (or when the moonlight is brighter than the aurora).

Here’s the solution: calculate max and min values with the EDS method as before, but increase the max values by 10% at a time until only a certain percentage of the image is saturated. That’s what I’ve done in the last image above, where I’ve adjusted the max values until only 0.5% of the image is saturated. In case you’re wondering, here’s the same image without this additional correction:

VIIRS DNB image with un-modified "erf-dynamic scaling" (11:34 UTC 22 January 2015)
VIIRS DNB image with unmodified “erf-dynamic scaling” (11:34 UTC 22 January 2015)

The correction makes it much better. What about for the first case I showed? Here’s the corrected version:

VIIRS DNB image with modified "erf-dynamic scaling" (15:14 UTC 21 January 2015)
VIIRS DNB image with modified “erf-dynamic scaling” (15:14 UTC 21 January 2015)

Once again, much better than before. You can see the cracks in the sea ice now! (Maybe it’s not as good as the manual scaling but, because it’s automated, it takes less time to produce. )

Of course, this correction assumes that less than 0.5% of the image is city lights or wildfires or lightning. And, it might not work too good if the data spans all the way from bright sunlight to new-moon night beyond the aurora because it darkens the non-aurora parts of the scene (as can be seen in the images from 22 January 2015). But, the great thing is: if the scene is not saturated by the aurora (or some other large bright feature) no correction is applied, so you still get the same great EDS algorithm results you had before.

As a bonus to make up for the initial flaws in the EDS algorithm (and to get any short-tempered viewers to stop cursing), enjoy the images below of a week’s worth of auroras as seen by the DNB (with the newly modified scaling). Make sure you look for the “Full Resolution” link to the upper right of each image in the gallery to see the full resolution version:

Oh, How the Seasons Change!

The transition between winter and summer happens twice a year. Unless you live in the tropics. Then you don’t really have winter. If there are seasons there, they are “dry” and “wet”. But, at high latitudes, the transition from summer to winter is often abrupt and cannot be mistaken for anything else. It’s hard not to notice when 22 hours of sunlight turns into 2 hours of sunlight and back again the following year. For places like the interior of Alaska, it’s also hard not to notice the temperatures in the 70s F giving way to temperatures below 0 °F. (Of course, here in Colorado, our temperatures went from 70 °F to 10 °F in a period of about 36 hours hours this week. Not to brag or anything.)

Summers are short at high latitudes but, autumns are shorter. So, what can VIIRS tell us about the changing seasons?

We’re going to focus on the “Natural Color” RGB composite. In this composite, the red component is the reflectance at 1.6 µm, the green component is the reflectance at 0.87 µm and the blue component is the reflectance at 0.64 µm (a red visible wavelength). The Natural Color RGB is useful for detecting snow and ice, determining cloud top phase, monitoring vegetation and detecting flooding. So, it’s good to get familiar with it.  Plus, it’s one of the best RGB composites you can make with the high-resolution (375 m) channels on VIIRS.

Here is a Natural Color RGB image of Alaska from 6 September 2014 – at the end of summer:

VIIRS Natural Color RGB composite of channels I-1, I-2 and I-3, taken 22:56 UTC 6 September 2014
VIIRS Natural Color RGB composite of channels I-1, I-2 and I-3, taken 22:56 UTC 6 September 2014.

It’s easy to pick out the ice clouds from the liquid clouds, just as it’s easy to see the snow on the Brooks Range. They appear cyan instead of white (as they would in the True Color RGB composite). If you want to know why snow and ice appear cyan in this composite, click here. But, I want to draw your attention to the third and nineteenth longest rivers in the US. Lower-48ers that didn’t click on the link are probably wondering which rivers I’m referring to. But, of course, Alaskans know which rivers I’m talking about, right?

OK, fine. Just to make sure we’re all on the same page, I’m talking about the Yukon and the Kuskokwim. These rivers are wide enough to be seen by VIIRS. Did you find them in the above image? Click on the image to see it in full resolution and make sure you see them.

Notice how the rivers are almost black. That’s because water is poorly reflective at these three wavelengths. This will come in handy later on. Now, let’s look again at these rivers a month later (7 October 2014):

VIIRS Natural Color RGB composite of channels I-1, I-2 and I-3, taken 23:19 UTC 7 October 2014
VIIRS Natural Color RGB composite of channels I-1, I-2 and I-3, taken 23:19 UTC 7 October 2014.

Why are the rivers surrounded by brown when a month earlier the river valleys were green? Deciduous trees like to hang out in the river valleys of southwestern Alaska, and these trees have already changed color and lost all their leaves over the course of this month, leaving behind only the bare branches and trunks. This is one sign of the changing seasons. (Note, however, that it is just a coincidence that these areas appear brown here. This is a false-color composite. The brown color is due to the reduced reflectivity of the deciduous forests at 0.87 µm caused by the lack of leaves, not because the tree trunks are brown. Read this if you want to learn more.)

Another sign of the changing seasons is the additional snow present. Everywhere north of the Brooks Range is snow covered. Plus, you can see pockets of snow in the Kilbuck and Kuskokwim Mountains, the Aleutian Range and in the hills and mountains surrounding Norton Sound.

Fast forward another month to 4 November 2014:

VIIRS Natural Color RGB composite of channels I-1, I-2 and I-3, taken 22:51 UTC 4 November 2014
VIIRS Natural Color RGB composite of channels I-1, I-2 and I-3, taken 22:51 UTC 4 November 2014.

Now, almost the whole state is covered by snow. But, look at the rivers! They are no longer black – they are cyan, which means they have frozen over. Although, if you look closely, you can see a few pixels suggesting open water on the lower sections of the Yukon, generally between Russian Mission and Mountain Village. Also, look closely where the Kuskokwim River flows into Kuskokwim Bay, downstream from Bethel – there is ice along the shores, but open water in the middle. Ice is also forming in Norton Sound and has covered Baird Inlet.

Two weeks earlier (21 October 2014), there is more of a mix of ice and open water on the Yukon and Kuskokwim:

VIIRS Natural Color RGB composite of channels I-1, I-2, and I-3, taken 23:59 UTC 21 October 2014
VIIRS Natural Color RGB composite of channels I-1, I-2, and I-3, taken 23:59 UTC 21 October 2014.

Identifying ice and open water on the rivers is very important. When the two coexist, ice jams can occur. When an ice jam forms, it blocks the flow of the river, which can flood areas upstream of the jam. When the jam breaks, it can cause a flash flood downstream.

Ice jams, even on small rivers, can show their power:

Imagine what they can do on the third and nineteenth largest rivers in the country!

Sometimes, you don’t have much time to get out of the way. Note: you might not want to watch this one if you are prone to motion sickness:

Who remembers what happened to Crooked Creek on the banks of the Kuskokwim in 2011? Or on the Yukon River at Eagle in 2013?

Of course, once the rivers are completely frozen over, there is no threat of an ice jam or flooding. But, now that you know how to spot ice forming on these rivers in the fall, you’ll hopefully be able to spot the return of open water in the spring, when the threat returns.

To really capture the changing of the seasons, here’s an animation of the relatively cloud-free images from 3 September 2014 to 6 November 2014:

Animation of VIIRS Natural Color RGB composites from 3 September 2014 to 6 November 2014
Animation of VIIRS Natural Color RGB composites from 3 September 2014 to 6 November 2014.

Click on the image to view the animation. It’s 17 MB, so it may take a while to load. See if you can pick out when the first ice forms on either river.

 

Camouflage Clouds

The natural world is full of examples of animals that have evolved camouflage. Check out this list and see how many of the animals you can find. Another example that I find particularly interesting is the Potoo bird. Some animals, like the Potoo, use camouflage to hide from predators, while others, like the Polar Bear, are predators who use camouflage to hide from their prey and make it easier to sneak up on them. Clouds also use camouflage (or at least it seems that way) to hide from weather satellites. Are they predators trying to hunt down and destroy innocent weather forecasts? Are they hiding because they fear some atmospheric phenomenon will find them and glaciate them? It’s tough to tell what goes on in the mind of a cloud, since it isn’t alive and has no brain.

Did you click on the first link above and take the test? If so, you are now aware of the skills you’ll need to detect clouds in the Arctic.

Let’s start with an infrared (IR) image of Alaska taken by VIIRS at 23:29 UTC on 3 February 2014:

VIIRS IR image (I-5), taken at 23:29 UTC 3 February 2014
VIIRS IR image (I-5), taken at 23:29 UTC 3 February 2014

The question is: where are all the clouds?

Colors correspond to the color table in the lower right corner of the image. IR images typically use color tables like this one to highlight the structures of cold cloud tops. And given the long Arctic winter nights, IR images like this are typically all that are available. The problem that arises is that low clouds, like fog and stratus, have a brightness temperature similar to the background surface, making them hard to spot. Sometimes temperature inversions exist and the low clouds in the image are warmer than the background surface. Cloud-free valleys and the ice in the Arctic Ocean may be colder than the clouds you’re trying to see, so you can’t always use temperature or temperature differences to detect clouds.

Now, we’ll get some help for this case, since 23:29 UTC is 2:30 in the afternoon (for most of Alaska), so there is some sunlight. This allows us to compare the IR image above with visible-wavelength images. Of course, that doesn’t always help, since clouds can be camouflaged at many different wavelengths. Here’s the VIIRS “True Color” RGB composite (a composite of M-3, M-4 and M-5, which are at blue, green and red portions of the visible spectrum, respectively):

VIIRS "True Color" RGB composite of  M-3, M-4 and M-5, taken 23:29 UTC 3 February 2014
VIIRS “True Color” RGB composite of M-3, M-4 and M-5, taken 23:29 UTC 3 February 2014

Many of the clouds here are still camouflaged because the clouds and snow and ice all appear white. The clouds that are easy to spot in the IR image (e.g. over the Gulf of Alaska) are similarly easy to spot in the True Color image. But, what about the clouds that are still hiding?

For now, we’re going to focus on three interesting regions that contain camouflage clouds: the Tanana River valley near Tok, the Arctic Ocean north of Russia, and the northern tip of the Yukon Territory. Keen-eyed observers may already be able to spot the clouds I’m referring to by noticing cloud shadows or by remembering where forests or mountains are located that are now obscured. (Although, the clouds in the northwest Yukon Territory are really difficult to see because of saturation issues at the terminator.) The three areas I’m referring to are highlighted below:

VIIRS IR image (I-5), taken 23:29 UTC 3 February 2014
VIIRS IR image (I-5), taken 23:29 UTC 3 February 2014. The areas of interest discussed in the text are highlighted.

Clouds are not so easy to see in these three areas, are they? (Remember, you can click on any image to see the high-resolution version.)

The Day/Night Band (and its Near Constant Contrast counterpart) show the clouds in these areas a bit better than the True Color image (and certainly better than the IR image). Here we show the Near Constant Contrast (NCC) image, so we’re not impacted by the presence of the day/night terminator:

VIIRS NCC image, taken 23:29 UTC 3 February 2014
VIIRS NCC image, taken 23:29 UTC 3 February 2014.

The clouds over Tok (lower right oval) are bit difficult to see, but you should be able to see the shadow they cast.

The clouds over northern Yukon Territory (upper right oval) are interesting for a couple of reasons: they obscure the terrain (the easiest way to tell those are clouds); they hug the surface so they aren’t casting any shadows; and the cloud on the northwest side of the oval is much warmer than the cloud on the southeast side of the oval even though they look similar at visible wavelengths (compare the visible images with the IR images).

The left oval over the Arctic Ocean shows the big difference in opacity between looking at a cloud in the IR versus the visible wavelengths.  The IR image shows an opaque, slightly darker (i.e. warmer) shape barely discernible from the background ocean and ice. The NCC image shows a semi-transparent cloud (also slightly darker [i.e. less reflective] than the background ice) with a lot of structure due to gravity waves. Underneath the cloud feature, you can clearly see where the icebergs and open water are located. Try doing that with the IR image.

The shortwave (or what the JPSS program office calls “midwave”) IR image (I-4) is not the most intuitive to interpret, but it also shows these camouflage clouds (some better than others):

VIIRS shortwave IR image (I-4), taken 23:29 UTC 3 February 2014
VIIRS shortwave IR image (I-4), taken 23:29 UTC 3 February 2014

The I-4 band is centered at 3.74 µm, a wavelength where reflection of solar radiation and the Earth’s emission both play an important role in what you are seeing. In the color table used here (best at highlighting wildfires and volcanic eruptions), highly reflective objects and warm objects show up darker. Ice clouds, snow and sea ice are all poorly reflective and cold, so they appear brighter. Liquid clouds are highly reflective, which makes the clouds over Tok easily visible.

The Yukon clouds are still pretty camouflaged because, even though they are liquid, they are colder, and don’t have as big a contrast with the background surface. As mentioned before, the clouds to the northwest in the oval are darker (warmer) than the clouds in the southeast part of the oval.

The Arctic Ocean clouds are interesting here. The reflective component reveals the gravity waves, but the emissive component obscures the ice and open water below. These clouds are not only camouflaged in certain wavelengths, they also act as camouflage for the ice below!

This example shows that not all clouds are easy to see with individual channels – even when looking at two or three different wavelengths. But, it does show that the visible-wavelength information provided by the NCC image is quite a bit different from the IR information that is typically used. And, even though this was a daytime scene, all the stuff I wrote still applies at night (except you lose the reflective component to the shortwave IR imagery).

Finally, let’s look at another RGB composite, what EUMETSAT calls “Natural Color”:

VIIRS "Natural Color" composite of I-1, I-2 and I-3, taken 23:29 UTC 3 February 2014
VIIRS “Natural Color” composite of I-1, I-2 and I-3, taken 23:29 UTC 3 February 2014. This image has been cropped relative to the other images to reduce the file size.

This composite uses bands I-1 (0.67 µm), I-2 (0.86 µm) and I-3 (1.61 µm) as the blue, green and red components, respectively. Snow, ice and ice clouds appear the bluish color known as cyan because they are highly reflective in I-1 and I-2, but poorly reflective in I-3. Liquid clouds appear white, to dirty white, to a grayish, pale cyan color depending on particle size and reflectivity. Vegetation is very green. Unlike the True Color RGB composite, the low liquid clouds in all three ovals are easier to see here because now they are a significantly different color than their respective backgrounds. Plus, the Arctic Ocean clouds are still transparent enough to show the ice and open water below.

The Natural Color composite may be the best way to detect low liquid clouds in this region, but it’s only available when the sun is above the horizon. The Day/Night Band (or NCC) is a useful stand-in, when it’s not available.

It just goes to show: the clouds may try to hide, but VIIRS can always find them!