Survey Overlay fetches a professional sky survey for the exact field of a plate solved image and delivers it as a new image: either pixel-matched to ours, the same star on the same pixel, or as a wide context image that shows our field in its surroundings. We use it to tell real faint nebulosity from gradients, to see where the background is truly empty, and to look at our object in light our cameras do not record.

Categories
  • Astrometry
Keywords
  • all-sky survey
  • HiPS
  • hips2fits
  • CDS
  • reprojection
  • astrometric solution
  • context image
  • DSS
  • Planck
  • IRAS
  • WISE
  • GALEX
  • H-alpha
  • dust
  • galactic cirrus
  • integrated flux nebula

1Introduction

The sky has been mapped many times over, in light our cameras do not record and to depths a single night does not reach. The Planck and IRAS dust maps show galactic cirrus however faint it is in visible light; the H-alpha surveys trace ionized hydrogen across the whole sky; GALEX shows the ultraviolet, WISE and 2MASS the infrared, and the DSS, Pan-STARRS and the DESI Legacy Surveys give a deep optical view of almost any field. With one of them registered to our image, questions that usually take guesswork become a matter of looking: is that faint smudge real, or a gradient? Where is the background empty? What does this object look like in the infrared?

Survey Overlay needs two things: an image with an astrometric solution, and a connection to the Internet. It works out which piece of the sky the image covers, asks the hips2fits service of the CDS (the Strasbourg astronomical Data Center) for that piece of the survey we chose, and reprojects it through our image's own solution, distortion model included, so the survey follows our image into the corners. Our image is never changed: the survey always arrives as a new image.

Thirty four surveys are in its list, fifteen of them in color, and any other image survey published in the HiPS network can be fetched by typing its identifier.

The Wizard Nebula and the same field from the DSS2 color survey
The same field, seen by a survey. Left, a Wizard Nebula; right, the new image Survey Overlay made of it from the DSS2 color survey, with the image's size, orientation and astrometric solution. Every star of the survey sits on the pixel of the same star in our image.

2Quick Start

  1. Open an image with an astrometric solution and choose Process > Astrometry > Survey Overlay. An image that has none can be solved first with Plate Solve; applying Survey Overlay to it offers that solve too.
  2. Click List beside HiPS identifier and choose a survey: Color: DSS2 for a first look, a dust map such as Planck 857 GHz (dust) for a wide field.
  3. Leave Output on Pixel-matched image and click Apply. The download takes from a few seconds to a minute, and its progress shows in the panel.
  4. The survey opens in a new tab, named after the image and the survey: RGB_Solved_DSS2_color for RGB_Solved. Its screen stretch shows it at once; the Log says where the data came from.
DSPX with the survey image in a tab of its own
After Apply. The survey is a new image beside ours, with the same size and the same astrometric solution. The Log says where the data came from (here a survey image downloaded before and kept, so nothing was asked of hips2fits), the survey's copyright notice and the range of its values.

3Interface & Parameters

The panel has three sections: Survey, which survey to fetch; Output, what to make of it; and Context image, the settings of the wide view, enabled only when Output asks for one. Then come the Preview box, the image the panel applies to and the buttons.

The Survey Overlay panel
The Survey Overlay panel with its default settings. The context image's settings are grayed out while the output is a pixel-matched image.

3.1Survey

HiPS identifier: The survey, by the name it has in the HiPS network, the system professional observatories use to publish their surveys: CDS/P/DSS2/red, say. List beside it offers the 34 surveys of Survey Overlay's own list (below); any other image survey can be typed, and the full catalog of several hundred is at aladin.cds.unistra.fr/hips/list. A survey published only as color JPEG or PNG images gives an RGB image. The default is CDS/P/DSS2/color.

3.2Output

Output: What Survey Overlay makes:

Rescale the survey values to [0,1]: A survey comes in its own units: megajanskys per steradian, Rayleighs, counts, magnitudes of reddening, negative values included. On (the default), the lowest value in our field becomes 0 and the highest 1, and the two are written to the new image's keywords, SVOLOW and SVOHIGH, so the original units can always be recovered. Off, the values are stored exactly as the survey gives them: the choice when we want to measure the survey, or work on its real values with Pixel Math. A context image is always mapped to 0 to 1.

Automatic screen stretch: On (the default), the new image is shown with an automatic screen stretch, so the survey is visible at once; its pixels are not changed. A color survey is already stretched for the screen and gets none. For a context image of a single band survey, the stretch goes into the pixels instead: a screen stretch of the whole context would stretch our image a second time.

3.3Context Image

These settings apply only when Output is Context image.

Layers: How the context is delivered:

Width: How much sky the context covers: 2 x the image (the default), 4 x, 8 x or 16 x the image, that many times the larger side of our image. The context stays 5000 pixels across, so a wider one shows the surroundings in less detail and our image smaller in it. A context can be up to 180 degrees across; a wider one is refused with a message to choose a narrower width.

Opacity: How much of our image shows over the survey, from 1 (the default), our image alone where it is, to 0, the survey alone.

Blend: How our image combines with the survey under it. Normal (the default) puts it on top as it is; the others are the usual blend modes of image editors, with the survey as the lower layer and our image as the upper one: Multiply, Screen, Overlay, Darken, Lighten, Subtract, Color Burn, Linear Burn, Color Dodge, Linear Dodge, Soft Light, Hard Light, Vivid Light, Linear Light, Pin Light, Difference, Exclusion and Divide.

Soft edge (px): A width, in pixels of the context image, over which our image fades in from its border, from 0 (the default, a hard edge) to 500. A soft edge makes the blends look natural, and gives the mask a gentle border.

Create a mask of the image: Also creates a mask the size of the context image (..._context_mask): white where our image is, with the same soft edge, black on the survey. It separates the two, to work on the survey or on our image alone.

Outline (px): A line just inside the border of our image, 1 to 10 pixels of the context image wide, to show exactly what our image covers; 0 (the default) draws none. The outline is amber. A saved process or a PixInsight icon may carry another color, which is kept and used; the panel has no control for it yet. With separate images, the outline goes on our image.

3.4Preview, Apply and Instance

Preview: Shows what Apply would make in place of the image, without changing anything, on The visible area, on A region we draw with Draw Region, or on The whole image, which Apply then reuses. A preview never starts by itself, since the survey comes from the network: it runs when we click Preview, with Stop beside it. On a part of the image, the survey is fetched for that part's field alone, which is the quick way to look closely at one part of a large image.

Applies to: The image the panel works on: the image in front, or another open image picked in the list. A picked image stays the panel's while other images come to the front, and Follow Active beside the list goes back to following the image in front.

Apply: Fetches the survey and makes the new image or images. Our image is only read: no history step is made on it, and we can apply one survey after another to the same image, each giving its own new image. While it runs, the panel shows its progress and Cancel. The system bar along the bottom of the panel has Apply too, and drag to apply, the icon at its left: dragged onto any image window, it applies the panel's settings to that image.

Instance: Opens a window with the process as the panel has it now, as text, in DSPX's format (.dsproc) or as a PixInsight process icon (.xpsm) that SurveyOverlay's PixInsight module opens. Copy puts the text on the clipboard; Save... saves it as a file and puts it on the Process Shelf.

Reset: Puts every setting back to its default.

4The Surveys

The color surveys are pictures made for the screen: already stretched, with 8 bits per channel. They come back as an RGB image that is good to look at and to compare with ours, not data to measure.

In the listHiPS identifierWhat it shows
Color: DSS2CDS/P/DSS2/colorOptical color from the red and blue plates of the Digitized Sky Survey. All sky.
Color: Mellinger opticalCDS/P/Mellinger/colorA true color panorama of the whole sky, at 36"/px: the one for very wide fields.
Color: Pan-STARRS DR1 (i, r, g)CDS/P/PanSTARRS/DR1/color-i-r-gOptical CCD color. North of declination −30°.
Color: DESI Legacy Surveys DR10CDS/P/DESI-Legacy-Surveys/DR10/colorDeep optical CCD color. About two thirds of the sky, away from the Milky Way.
Color: SDSS9CDS/P/SDSS9/colorOptical CCD color. About a third of the sky.
Color: Gaia DR3 flux map (Rp, G, Bp)CDS/P/DM/flux-color-Rp-G-Bp/I/355/gaiadr3 The light of the Gaia stars shown as color, made from the catalog. All sky.
Color: GALEX ultravioletCDS/P/GALEXGR6_7/colorFar and near ultraviolet. Most of the sky away from the Milky Way.
Color: 2MASS (J, H, K)CDS/P/2MASS/colorNear infrared. All sky.
Color: AllWISE (W4, W2, W1)CDS/P/allWISE/colorMid infrared. All sky.
Color: SPHEREx QR2CDS/P/SPHEREx/QR2/colorNear infrared from the SPHEREx all-sky survey.
Color: IRAS-IRIS (dust)CDS/P/IRIS/colorFar infrared dust emission. All sky, 4' resolution.
Color: AKARI FIS (140, 90, 65 um) (dust)CDS/P/AKARI/FIS/ColorFar infrared dust emission. All sky, about 1' resolution.
Color: Planck 353-545-857 GHz (dust)CDS/P/PLANCK/R2/HFI/colorCold dust. All sky, 5' resolution.
Color: LAB HI, Doppler colors (gas)CAMRAS/P/LABHI/RGBNeutral hydrogen, colored by its velocity along the line of sight. About 0.6° resolution.
Color: SkyMapper DR4 (i, r, g)CDS/P/Skymapper/DR4/colorOptical CCD color. The southern sky.

The single band surveys come back as a gray image that holds the survey's own values: the ones to use for anything beyond looking.

In the listHiPS identifierWhat it shows
DSS2 Red, Blue, Near infraredCDS/P/DSS2/red, blue, NIR The plates of the Digitized Sky Survey. All sky, about 1"/px. Photographic: not linear.
Pan-STARRS DR1 rCDS/P/PanSTARRS/DR1/rCCD, r band. North of declination −30°, 0.25"/px.
Planck 857 GHz, 545 GHz (dust)CDS/P/PLANCK/R2/HFI857, HFI545 Thermal emission of cold dust: the reference for galactic cirrus. All sky, 5' resolution.
IRAS-IRIS 100 um (dust)ov-gso/P/IRIS/4Far infrared dust emission. All sky, 4' resolution.
AKARI 90 um (dust)CDS/P/AKARI/FIS/WideSFar infrared dust emission. About 1' resolution.
WISE 12 um diffuse dust (WSSA)CDS/P/WISE/WSSA/12umDiffuse dust with the stars removed. 15" resolution.
AllWISE W3 (12 um)CDS/P/allWISE/W3Mid infrared, stars included. 6.5" resolution.
E(B-V) reddening (SFD98)ov-gso/P/EBV/SFD98The dust reddening map of Schlegel, Finkbeiner and Davis. 6' resolution.
HI4PI neutral hydrogenCDS/P/HI4PI/NHIColumn density of atomic hydrogen. 16' resolution.
H-alpha composite (Finkbeiner)CDS/P/FinkbeinerThe WHAM, VTSS and SHASSA surveys combined. All sky, 6' resolution.
SHASSA H-alpha; continuum subtractedCDS/P/SHASSA/H, SM H-alpha of the southern sky, with the stars (about 1') or without them (4').
WHAM H-alphaov-gso/P/WHAMThe faintest H-alpha emission. 1° resolution.
GALEX Near and Far ultravioletCDS/P/GALEXGR6_7/NUV, FUVAway from the Milky Way, 4" to 5" resolution.
2MASS K (2.16 um)CDS/P/2MASS/KNear infrared. All sky, 2" resolution.

Coverage and resolution are each survey's own, given as a guide. Where a survey does not reach our field the new image is black, and the Log says how much of the image has no data.

5The Context Image

A context image shows where our image sits on the sky, and what surrounds it. It is always 5000 by 5000 pixels, north up, centered on our image, and 2 to 16 times as wide as its larger side. Our image goes on top of the survey at its true place, size and rotation, placed there through its own astrometric solution, and as it is displayed: with its screen stretch, so a linear image looks in the context as it does on our screen. When the context has room for fewer pixels than our image has, our image is first reduced by averaging.

The context is a stereographic projection, which keeps the shapes of the sky and stretches it little toward the edges, so even a very wide context looks right. It carries an astrometric solution of its own, so the astrometric processes work on it as on any solved image, and keywords that say how it was made.

A context image: the Wizard Nebula outlined in its surroundings
A context image from DSS2 color, four times the image's width, with a 4 pixel outline. Our image sits at its place among the clouds of the Milky Way; the change of tone across the survey is the edge of two DSS plates.
A context image with the outline of our image at its center
Another context image, from DSS2 color, with our image outlined at its center.

6What Survey Overlay Does

  1. The field. From the image's astrometric solution, it computes the sky position of the image's center, the radius of the circle that holds the whole image, and the image's scale.
  2. The request. It asks hips2fits for a square image of the survey around that position, in a tangent projection, north up, at our image's scale or the survey's, whichever is coarser. A large request is made as tiles, several at a time, each an exact piece of the whole. Each request carries the survey's name and the position and size of the field: no part of our image leaves the computer. The Log lists every request.
  3. The reprojection. For each pixel of the new image, it takes the sky position of the same pixel of our image, through our solution, finds where that position falls in the survey image and interpolates the survey there. The result follows our image into the corners, exactly as far as our solution does.
  4. The new image. A 32-bit floating point image of exactly our image's size, gray for a single band survey and RGB for a color one, with our image's astrometric solution and the keywords SVOSURV (the survey), SVOLOW and SVOHIGH (the values stored as 0 and 1).

The survey images it downloads are kept for a while in a folder of DSPX's own data, and a request that is the same as an earlier one (the same survey for the same field and size) uses the kept image instead of asking again. That makes trying the options of a context image quick: after the first download, a new blend, opacity, soft edge, outline or mask starts at once.

7Usage Tips and Tricks

Is it real? A faint cloud in our background that also shows in a dust map is galactic cirrus, and deserves to be kept. One that the survey does not have is a gradient, a flat field residue or a reflection.

Before removing gradients. A dust or H-alpha map shows which parts of the field hold real signal and which are empty sky: what we need to know before we place background samples.

The overlay is as good as the solution. A solution with a distortion model matches from center to corners; one without it can be off by several pixels at the edges of a wide field.

Mind the survey's resolution. The dust and H-alpha maps have a resolution of arcminutes: on a wide field they show a wealth of structure, on a long focal length image only a smooth glow. The optical surveys, GALEX, 2MASS and WISE hold their detail on narrow fields.

Not every survey covers the whole sky. Pan-STARRS stops at declination −30°, SHASSA and SkyMapper are southern, GALEX and the DESI Legacy Surveys avoid the Milky Way. When a survey has nothing at all for our field, no image is made and the Log says so.

Large images, coarser surveys. A request is limited to 6000 pixels on a side, so a larger image gets the survey at a slightly coarser scale than its own. A preview of a region gets one part at full detail.

The values are the survey's. With the rescale on, a single bright star in the field sets the top of the range, so a single band survey can look almost black until it is stretched, which is what the automatic screen stretch is for. The DSS is photographic and not linear.

A survey is a reference, not a second exposure. Its resolution, depth and date differ from ours, and it has artifacts of its own: plate edges, satellite trails, ghosts around bright stars. What matters is the structure the two images share.

When the service is slow. hips2fits is shared by astronomers everywhere; it is sometimes slow and now and then down for a while. Survey Overlay tries a mirror before it gives up, and asking again a little later is usually all it takes.

Plate Solve: gives the image the astrometric solution Survey Overlay needs, from its stars alone.

Background Extraction: corrects gradients; a dust or H-alpha survey of the field shows where its samples belong.

Pixel Math: combines the survey with our image pixel by pixel, which the pixel-matched image makes direct. The Layers panel blends them as layers.

Photometric Glow Subtraction and Catalog Star Color: the other processes that work through the image's astrometric solution.