Topcat X Plane

Posted onby

Mark Taylor
December 2015

  1. Topcat For X-plane
  2. Topcat X Plane 11
  3. Topcat X Plane
  4. Topcat X Plane 11

In this video I go over my Flight Sim setup, how to make a OFP in PFPX and how to use TOPCAT for inflight calculations. Topcat1952 posted a topic in The X-Plane General Discussions Forum Having just acquired two of the new Thrustmaster TCA Throttle Quadrants, I am totally perplexed on how to set up the throttle and prop response curves in XP11 for turboprop aircraft. XMAPSY V3 THE EFB - CONNECTOR FSX P3D MSFS X-PLANE. GSX LEVEL 2 EXPANSION FSX P3D. ENVSOUND FSX P3D. AVIACDU FSX P3D Customer Reviews. TOPER WEB - ONLINE AIRCRAFT PERFORMANCE TOOL. Very easy to use and fun to use when planning a flight. Your country/region of residence.

Contents

1 Introduction

These are notes for the Advanced TOPCAT tutorial at theASTERICS VO school at ESAC, December 2015.It covers use of the desktop GUI toolTOPCATand its command-line evil twinSTILTS.

These tools are designed to do things with tabular data -typically source catalogues. They don't do science for you,but they let you do the mechanical manipulation of tables thatyou need to do to understand their science content in detail.

TOPCAT and STILTS can do basically the same things,but are used in different ways.TOPCAT is easier to learn, and good for interactive use,especially exploring data to get a feel for what's there.For production work, it is sometimes better to move on to STILTS,which has a steeper learning curve but can be scripted forrepeated or reproducible work.STILTS can also, for some purposes, be used for larger datasets.

Most links in the document are to:

  • SUN/253, the TOPCAT user document
  • SUN/256, the STILTS user document
These manuals contain much more detailed reference documentation,so should be consulted for more information.

Some of the data files used below are:

Plane
  • 2mass-pleiades.fits (10Mb)
  • rave-dr4.fits (25Mb)

2 Data Acquisition

2.1 File Formats

TOPCAT/STILTS like FITS files.They can work with some other formats (CSV, VOTable, IPAC, a few others)but they are slower.More details here.f you're going to work with a table (especially a large one)a lot it's a good idea to convert it to FITS first.

What file format?
  • Small table (<1000 rows): doesn't matter.
  • Medium-sized (fits into physical memory; (rows*cols) < 20million?): FITS:
    • Binary format, loads fast
    • Topcat/stilts usually use FITS-plus, a variant that stores extra metadata. You can mostly forget this fact.
  • Big (millions of rows, especially with lots of columns): colfits:
    • Stores each column contiguously (normal FITS stores each row contiguously); works better for very wide tables when you only need a few columns
Already got the data locally?
  • In the right format (see above)?
    • Load it
  • In TOPCAT-friendly-format (CSV, VOTable, IPAC)?
    • Convert to FITS/colfits
      • either load into TOPCAT and save as FITS/colfits
      • or convert using STILTS:
        • stilts tpipe in=xxx.csv ifmt=csv out=xxx.fits
  • In some other format (HDF5, your favourite ASCII variant, ...)?
    • Use some other way to convert it; either to FITS directly, or to e.g. CSV so you can convert it as above. AstroPy supports a wide range of formats.
What about VOTable?
VOTable is mostly intended for data transfer. It's not particularly efficient for data access (especially random access). VO services use it to exchange data and metadata, but topcat prefers FITS locally.

VOTable is good for storing metadata - column descriptions, units, UCDs, history information etc. FITS isn't. TOPCAT uses a home-made FITS variant it calls FITS-plus that has the best of both worlds. You don't need to worry about the details, but if you use topcat/stilts to convert from VOTable to FITS, the metadata isn't lost.

2.2 Getting data from the VO

There are various ways to get data from the VO.Some are more straightforward than others.

Data acquisition tips
  • If it's small enough, grab the whole thing
    • VizieR with All Rows
    • TAPSELECT * FROM table
    • Google? Visit survey home page? (not very VO)
  • If not, you have to think about what parts you need:
    • Select by sky region
      • VizieR with Cone Selection
      • TAPSELECT ... FROM table WHERE 1=CONTAINS(POINT(..),CIRCLE(..))
    • Select by some other criterion
      • TAPSELECT ... FROM table WHERE ...
    • Select by crossmatching with another dataset (see Section 5)
What counts as 'small enough'? As far as TOPCAT's concerned, that's around a million rows. However, if you're on a slow internet link you may have to adjust this downwards.
Vizier dialogue example
This gets a list of Tycho detections in the region of the Pleiades. We'll use this later for crossmatching examples.
  1. Open the Vizier Load window from the VO VizieR CatalogueService menu
  2. Ensure Cone Selection radio button (not All Rows) is selected
  3. Enter 'pleiades' in the Object Name field
  4. Hit the Resolve button to fill in the RA and Dec fields
  5. Enter '2' (degrees) in the Radius field
  6. In the Catalogue Selection panel at the bottom, select the Surveys tab
  7. Scroll down to Tycho-2 (they're alphabetical) and click on it
  8. Hit OK.
  9. This loads two new tables into topcat; one for the main table, and one for the supplement. Ignore the supplement (you can File Discard Table if you like), but (for convenience) rename the other one (I_259_tyc2) as 'tycho' by typing in the Label field of the main control window with that table selected.

3 Linked Views

Here we plot data in one parameter space, identify the points ina subregion, and see where those fall in a different parameter space.First we do this using topcat windows,then, using SAMP, between topcat and another application.

3.1 Linked views in TOPCAT

Linked views in TOPCAT:

  1. Use the Tycho-2 data (cone around pleiades location) downloaded from VizieR earlier.
  2. Plot a a colour-magnitude diagram: X=VTmag-BTmag, Y=VTmag. Use the Axes control control to flip the Y axis.
  3. Open another Plane Plot window, and plot proper motions: X=pmRA, Y=pmDE.
  4. Click on a point in one plot; the same object is highlighted in both plots.
  5. Open the Data View window clicking on points highlights the corresponding row and vice versa.
  6. In the proper motion plot, see that there is a cluster of co-moving objects. Draw a blob around it to create a new subset (click , drag out the cluster region, and then click the same button again). The New Subset window will pop up; choose a name (e.g. 'comoving') and hit Add Subset.
  7. The selected points are plotted in a different colour on the colour-magnitude diagram. If you look at the proper motion plot, you can see they are also identified in a different colour on that one - you can see the main sequence traced out by the comoving stars that form a single population.
  8. Look at the Subset tab in the plot windows. You can use that to control the colour of different subsets and which ones are plotted.
  9. Look at the Subsets Window from the main control window toolbar. You can see the new subset. You can use this for other things.

3.2 Linking with other tools using SAMP

Many VO tools can communicate with each other usingSimple Application Messaging Protocol (SAMP).A SAMP Hub process needs to be running on the desktop.Usually, this just works, since topcat and other toolsstart such a hub when they start up.

Here is an example of it in operation:

  1. Start up Aladin.
  2. Select some all-sky imagery (e.g. DSS from the list across the top of the screen.
  3. Enter 'pleiades' in the Location field, and zoom in.
  4. Select the Tycho table in topcat, and use the Interop Send Table To... Aladin menu item. Positions of all the table rows are plotted.
  5. From the Subsets window , select the comoving subset, and use the Interop Send Subset To... Aladin menu item. Positons of the comoving subset are highlighted in Aladin.
  6. If you hover the mouse over positions in Aladin, they are hightlighted in topcat plots. Check the Broadcast Row checkbox in topcat's main control window, and the same thing happens the other way round (clicking on a row in topcat highlights the same one in Aladin.

4 TAP

TAP is the Table Access Protocol.It lets you perform queries against a remote relational database.In TOPCAT, you write queries in ADQL (Astronomical Data Query Language).This is essentially a dialect of SQL.

TOPCAT gives you theTAP Load Window.Open it using the button on themain toolbar; it's also available from the VO menuor the Load window.

It's a complicated window, because it does a lot of stuff.It's organised in several tabs, and some of the tabbed parts havetabs of their own.

The most important jobs it lets you do are:

Topcat for x-plane
  • Find/choose a TAP service to talk to
  • See information about the tables available in that service
  • Construct and submit ADQL queries, retrieving the results as tables loaded into TOPCAT
(it also lets you monitor running jobs and return to previously started ones).

4.1 Locate a TAP service

Use theSelect Service tab(this is visible by default when you open the TAP window).The job of this tab is to let you choose a service to talk to.(If you try to open the Use Service now it won't let you,because you haven't chosen one).

You should see a list of all known TAP services(this is all the registered TAP services;some others for non-public use may exist as well).If you don't see that after a short delay ... there's probably anetwork or registry error.The services are listed in order of the number of tables they contain(this number is in brackets after the name).

If you know what service you want to use, you can browse the list andjust click its name.

More often, you want to search for a given data set.To search for (e.g.) the RAVE survey:

  • Type 'rave' (it's not case-sensitive) into the Keywords field
  • Click the Find Services button (or hit return)
  • After a short delay, you should see a shorter list (3 items?) of services. These have tables with names or descriptions containing the term 'rave'. E.g. the line 'GAVO DC TAP (3/142)' means the service 'GAVO DC' has 142 tables altogether, and 3 of them (maybe) have something to do with RAVE.
  • Click on the 'handle' to the left of the GAVO service to open it up. This will list the three tables. If one of them looks like what you're after (rave.main) then click on that, or the service name, to tell topcat this service is the one you want to use.
  • This fills in the TAP URL field at the bottom of the window.
  • Now you can hit the Use Service button next to it, or alternatively the Use Service tab at the top.

Note: not all TAP services are equal.This GAVO one (and some others using the same software) generally worksvery well, and supports many optional features like table uploadand examples.Some other services may work less smoothly.Don't be too surprised if some things break.Hopefully, this will improve in the future...

4.2 Explore Metadata

When you open theUse Service tab,after a short delay, you should see on the left of the windowa list of tables in the service's database.The top level of this tree shows you Schemas;these are just an organisational level that (sometimes)groups tables into related sets.Click on the handles to expand schemas and see the tables inside.The tabs to the right contain information depending what schema/tableyou have selected in the tree.

Find a table you're interested in:
Browse the tree
If the service doesn't have too many tables, and they have sensible names, you might find the one(s) you're looking for by scrolling and clicking.
Search by metadata
If the list is very long, or the tables have unintuitive names, use the Find field. As you type in one or more search terms, the list below will be narrowed down to include only the relevant items. You can control whether the terms are combined using And/Or, and whether they match just table/schema name or description as well.
  • Type in 'rave' - you'll see three tables
  • Type in 'radial' - with just the Name checkbox checked you see none. If you check Description as well, it will show you more tables with 'radial' in their table/schema description.

Topcat For X-plane

Use the different tabs to show you different information:
  • Click on the Service tab: This contains general information about the current TAP service. Near the bottom is (maybe) a list of User-Defined Functions - non-standard functions offered by the service, that may be useful.
  • Click on the Schema tab. As you select different schemas in the tree, it will give you descriptions.
  • Click on the Table tab. As you select different tables in the tree, it will give you descriptions.
  • Click on the Columns tab. When you select a table in the tree, this will show you all the columns in that table. This is the main useful information you will need to construct a query and understand the results. You can click on the column-headers of this display to sort the table columns (i.e. displayed rows in this panel). Sorting by Unit can be useful to group table columns with similar values.
  • Click on the Hints tab. Use this to give you a clue how to write ADQL!. Follow its advice about Examples at the top.

4.3 Write/Run a query

Now you can type an ADQL query into the text field at the bottomof the window.If you don't know how to do that, don't worry;there is help at hand.

Use the Hints tab
This gives you a very basic cheat sheet as a reminder of how to put together an ADQL query. At the bottom, it links to some other resources with a bit more information; clicking on blue links should open them in your browser. It also tells you to use the examples.
Use the Examples menu
At the bottom left of the window is an Examples menu. When you select an item, it will enter text into the entry box. In most cases, it relates to the table you are currently looking at in the metadata browser. Try some out; when the text appears, hit the Run Query button. Edit the text; if you make a syntax error it will be highlighted in red.
Service-Provided examples
Service-Provided examples are written by the hosting TAP service, so may give you some good ideas about what will work with these specific tables. Follow the instructions in the Hints tab to see them.

When you've got the idea, try your own queries, or edit the examplesto taste.Useful hints:

  • Syntax errors are highlighted for you with a red background.
  • You can have multiple queries on the go at once in different tabs: opens a new blank tab, and copies the current text into a new tab.
  • Text editing has full Undo/Redo using the / buttons or Ctrl-Z/Ctrl-Shift-Z.
  • Insert a list of column names into the query by highlighting them in the column browser (ctrl-click) and then hitting the button. The button works the same way for the currently selected table name.

5 Crossmatching

There are various different ways to crossmatch tables againsteach other. Which is best depends on the details of what you want to do,how big the tables you want to match are,and what data services are available that provide the (large)tables of interest.

There are four main options available from TOPCAT (and STILTS),described below.The examples here identify objects in the regionof the Pleiades with detections in both Tycho-2 and 2MASS,though note some of these methods are more appropriate thanothers for this job.These examples use the Tychocatalogue from the previous section.Alternatively, just download itfrom http://andromeda.star.bris.ac.uk/data/tycho-pleiades.fits.

5.1 Crossmatch Window(s)

The Crossmatch Windowis generally the easiest way to do it, very flexible, and usually quite fast.

Notes
For this, you need both catalogues loaded into TOPCAT, so they can't be too big (<million rows?).
  • For large tables, the crossmatch can run out of memory (symptoms: memory error popup window or it just grinds to a halt. Keep an eye on the Control Window Memory Monitor). Increasing heap memory (run with -Xmx1000M) may help.
  • Think about the output options. Especially in crowded fields, the default Best Match, Symmetric can give surprising results. If you want Best Match for each Table x Row, select that.
  • There are lots of different match types (Algorithm selector), not just Sky.
  • You can do single-table or 3-, 4-, 5-table matches too - see the Joins menu.
Example
Topcat X Plane
  1. You need to start with all the rows from the 2MASS Point Source Catalogue in the region of interest to do it this way (in some cases that's not feasible). Get them from the VizieR window (2MASS-PSC) like for the Tycho data above. You may need to increase the Maximum Row Count (plot the result on the sky when loaded to check that the region looks like a circle, not a circle with some parts missing). You can relabel it 2mass.
  2. Open the Pair Match window using the button in the main toolbar (or the Join menu)
  3. Check the Match Criteria panel at the top; the defaults of Sky match with 1 arcsec error are reasonable.
  4. Fill in the Table selectors with tycho and 2mass tables.
  5. Check that the two RA and Dec selectors are filled in with suitable columns
  6. Hit Go.
  7. It should do some calculations and pop up a window telling you how many matches have been found (about 500?). Click the Plot Result button.
Stilts equivalents
tskymatch2, tmatch2, tmatch1, tmatchn. Note these are still vulnerable to running out of memory.

The above example in STILTS looks like:

5.2 CDS X-Match window

The CDS X-Match window is based on the X-Match service provided by CDS.If you have one table loaded in topcat, and want to match againstanother one that's in VizieR (or the SIMBAD database),it works well, and is very fast, even for large tables.

Notes
  • It's not that straightforward to find out the VizieR ID for the remote table, if it's not one of the popular named ones in the selector box. You need the table id not catalogue id. The table searching facility at TAPVizieR web page is a good place to look.
  • Only a restricted set of columns is available (not all from VizieR). If the columns you get back don't include the ones you want, you'll have to use a different method.
  • You can only specify simple positional criteria.
  • Increasing the Block Size may make it go faster. Or fail.
Example
  1. Open the CDS Upload X-Match window , using the button in the main toolbar (or VO menu).
  2. Choose 2MASS in the VizieR Table ID/Alias selector. If the table you want isn't there, try searching at http://tapvizier.u-strasbg.fr/adql/ and use the table identifier (e.g. II/246/out) in the right hand column.
  3. Select tycho as the Input Table
  4. Check the RA and Dec columns are filled in correctly.
  5. Check the Match Parameters. The defaults should be OK.
  6. Hit Go
  7. It should (quickly) tell you that a new table has been created.
  8. You can overplot the results it on the same plot as before to compare the results. Add a new plot layer with the Add Position Control button and select the new table. Vary the marker Shape and Size (in the Form tab) and Colour (in the Subsets tab) so that all the different markers are visible at the same time.
STILTS equivalent
cdsskymatch. This will work with a local table of unlimited size.

The above example in STILTS looks like:

5.3 TAP Join

TAP joins use theTAP window .If there are two huge tables in a remote TAP database,use TAP to join them.If you want to join a local table with a huge table in a remote TAPdatabase, use a TAP Upload query (if available).

Notes
  • TAP is very powerful...
  • ... but it's not so simple to use. Look at the Hints tab and examples!
  • Not all TAP services support uploads.
  • TAP service implementation is patchy. Not all services have the same capabilities. Some are a bit broken. This may get better in the future.
Example
  1. Open the TAP Window using the button in the main toolbar (or VO menu).
  2. Find a TAP service containing 2mass data. Type 2MASS in the Keywords field and hit the Find Services button. It seems there are lots of services providing 2MASS or 2MASS-related data. Let's use GAVO DC TAP (near the top, probably). Select that row, and hit the Use Service button at the bottom.
  3. When it's finished loading the metadata, type 2mass in the Find box. No results. Try clicking the Description checkbox, which will check for text matches in the table description as well as name. Open the twomass entry in the tree and select table twomass.data.
  4. Do the upload match the easy way: use the Examples. Make sure the tycho table is selected in the main Control Window, and twomass.data is selected in the TAP window. Then click the Examples button at the bottom of the screen, and select Upload Upload Join. It puts some text (an upload join query) into the ADQL text box.
  5. Take a look at the query. Delete 'TOP 1000'.
  6. Hit the Run Query button.
  7. It should load a new table in topcat. You can overplot this one too.
STILTS equivalents
tapquery, tapskymatch. tapskymatch only does positional sky matches: but it works on unlimited sized tables, and is more straightforward to use.

The above example in STILTS looks like: or

5.4 Multi-Cone

The Multi-Cone windowlets you make one cone search for each rowof a local table, effectively joining it with the remote one that isexposed via a Cone Search service.

Topcat X Plane 11

Notes
  • These are v..e..r..y s..l..o..w and not usually a good idea, but if the remote data you need is not available in another form, it may be necessary.
  • Multi-SIA and Multi-SSA do the same thing for Simple Image and Spectral Access services.
  • ObsTAP services (TAP services with the ivoa.obscore table) may be another way to get image/spectral observation data).
Plane
Example
  1. Open the Multi-Cone window using the VO Multicone menu item
  2. Search for a Cone Search service providing the 2MASS Point Source Catalogue. Type in '2mass' to the Keywords field and hit Find Services. It gives you too many results ... try '2mass point'. Pick one that looks OK - (hint: the VizieR one ('II/246') will probably work best). When selected this will fill in the Cone Search URL field.
  3. Enter tycho as the Input Table
  4. Check that the RA column and Dec Column fields are filled in correctly.
  5. Adjust the Search Radius column field - arsec not degrees!
  6. Hit Go
  7. It should, after a while (see the progress bar at the bottom), load a new table with the result. You can overplot it on the others.
STILTS equivalent
coneskymatch

Topcat X Plane

The above example in STILTS looks like:

5.5 Crossmatching Tips

To summarise, the best choice mainly depends on whether yourtables areSmall (<thousand row),Medium (<million row), orHuge.

Some miscellaneous tips:

  • When you've done a crossmatch, plot the results to see if they look sensible
  • Crossmatching works on the Apparent Table - Current Subset and currently visible rows only.
  • Before you do a crossmatch, you might like to restrict the columns (or rows?) in the local table(s) so the result isn't too unwieldy.

6 Visualisation

6.1 Get RAVE data

  1. Acquire the RAVE DR4 dataset. There are various ways to do it. Try one of:
    • VizieR all-sky
    • TAP
  2. Acquire the list of Messier objects (http://andromeda.star.bris.ac.uk/data/messier.xml, or some other way).
  3. Look at the columns ( button on main toolbar). Make sure you have (2MASS) J, H and K magnitudes, heliocentric radial velocity (rv), parallax (Plx) and calibrated metallicity (met). If they don't have those names, you can rename the columns by double-clicking on the names in the columns display and typing the new name.

6.2 Sky plot

View the RAVE data on the sky.

  1. Open a Sky Plot window .
  2. You might want to split the display and control panels with the Float Controls button, especially if your screen is small/short.
  3. Ensure the RAVE table is selected in the Table selector.
  4. The Lon and Lat fields should be filled in automatically; if not, select RA and Dec values
  5. Note that darker coloured regions are denser. You can see slight inhomogeneities in the observation pattern.
  6. Navigate on the plot using the mouse. See line at the bottom of the window with the little mouse icons to see what you can do. There's more detail (including what to do if you don't have 3 mouse buttons) if you click the little question mark button bottom left (it takes you here).
  7. Change the view by opening the Axes control and adjusting the options:
    1. Select View Sky System:galactic to see positions in galactic (rather than equatorial) coordinates
    2. Select Projection:aitoff to see an all-sky projection
    3. You can fiddle around with the way the coordinate grid is drawn and labelled in the Grid and Font tabs

For fun, you can overplot the Messier objects on the same plot.

  1. Add a new layer by clicking the Add Position Layer button
  2. Select the Messier table in the Table selector.
  3. The Lon and Lat fields should be filled in automatically; if not, select RA and Dec values
  4. See the new points plotted.
  5. Make them more obvious by adjusting options in the Form tab
  6. Change the size and shape with the Size and Shape selectors.
  7. Change the colour using the Subsets tab.
  8. Add a text label layer with the button
  9. Select the Name or ID column in the Label selector
  10. Change the font size etc to taste.

This is how you do that in STILTS:

6.3 Plane Plot

Do a colour-colour plot of RAVE data:

  1. Open the Plane Plot window
  2. You might want to split the display and control panels with the Float Controls button, especially if your screen is small/short.
  3. Select the RAVE table in the Table selector.
  4. Enter the colour quantities as coordinates: X as h-j and Y as h-k. Note these are using topcat's expression language; in this case the expressions are pretty simple.
  5. Navigate so that most of the ploted points fill the screen (navigation hints at the bottom of the window; details if you click the little question mark or here).
  6. Investigate the density profile of the plot.
    • Experiment with different settings of the Shading selector in the Form tab:
      • Auto (default): you can get a fairly good idea that the density is bimodal, but not all the details
      • Flat: hopeless for this kind of high-density plot
      • Translucent: adjust the Transparency Level slider. Can see bimodality, but hard to see all levels of detail at once.
      • Transparent: like Translucent, but behaves differently if you zoom in/out
      • Density: more options to explore density profiles. Fiddle with colour maps, scaling, clips, quantisation, ...
    • You can also try other Forms:
      • Density
      • Contour (probably need to increase Smoothing)
  7. Investigate how metallicity (the column may be called [M/H] or something else, depending where you got the data) varies over the colour-colour space. You can do this by using the metallicity value to colour-code plotted points with the remaiing Shading Modes. In both these cases, a colour ramp is displayed on the right, and you can control the map using the Aux Axis Control control that appears in the control stack on the left. Play around with the colour map etc in the Map tab and the data range in the Range tab for best results. The Aux and Weighted shading modes can both do this:
    • Aux: select the metallicity column as the Aux coordinate. You can see some low-metallicity hotspots, but they're a bit noisy because points are plotted over each other. Adjusting transparency, zooming in, or making points smaller may help a bit.
    • Weighted: select the metallicity column as the Weight coordinate. This averages the values at each pixel and makes it easier to see what's going on. The combination method is Mean by default; you can experiment with the others. Median may give you a more robust view, but note it's slower.
    There are three regions of the colour-colour space with low metallicity. What's going on here? (Hint: I don't know!)

This is how you do that in STILTS:

6.4 3D Plot

Get some theoretical data from the Milliennium simulationin one of the following ways:

  • From the Millennium Query load dialogue:
    1. Use the VO GAVO Millennium Run Query menu item
    2. Select the example menu item GalaxySamples G2
    3. Hit OK
  • If that doesn't work, just download it from http://andromeda.star.bris.ac.uk/data/millennium-g2.fits.

Plot X,Y,Z positions:

  1. Open the Cube Plot window
  2. You might want to split the display and control panels with the Float Controls button, especially if your screen is small/short.
  3. Ensure the simulation table is selected in the Table selector.
  4. Select columns x, y and z as the X, Y and Z coordinates.
Note the default shading mode in 3D is Flat .There's no Auto because it plays badly with multi-dataset plots.The transparency options , are OK.But if you have a single-dataset plot you can useDensity mode.

Navigate in 3D:

  • Most useful actions:
    • Drag to rotate around the center of the cube
    • To look at a particular point or group of points, right-click (or CTRL-click) to re-center around that point
    • Use the mouse wheel (or your equivalent - 2-fingered drag on mouse pad?) to zoom in/out around the center
  • Use the button to rescale if you get lost.
  • The navigation hints are at the bottom of the window as usual, and the help link points here.

Plot velocities:

  • In the Form tab, add a new XYZVector layer by clicking .
  • Fill in the X/Y/ZDelta fields with the velocity columns, velX/Y/Z. See the little arrows.
  • Uncheck the Mark control, so only the arrows and not the spots are visible
  • Try different shapes in the Arrow selector.
  • The arrows are automatically scaled to be a sensible size. You can make them all bigger or smaller by sliding the Scale slider. If you want to see the absolute sizes represented by the DeltaX/Y/Z coordinates, you can uncheck the Auto Scale control.

Plot separate subsets:

  • This table has a column type which identifies galaxies as central/FOF (0), central/subhalo (1) or satellite. It's useful to plot these as separate subsets.
  • Open the Subsets window
  • You could add three new subsets using the Add New Subset button using the expressions type0, type1 and type2.
  • But to save you the trouble, you can use the Classify By Column window (in the Subsets menu, or on the toolbar)
  • Enter type in the Classification Value selector, and hit Classify button
  • Review the subsets it's identified, and if you like them hit Add Subsets.
  • It will add the new subsets, and they will be reflected in the plot. In the plot window you can use the Subsets tab to control which ones are plotted and what colours are used.

This is how you do one of those plots in STILTS:

7 Activation Actions

Activation Actions are things you can cause to happen when you'activate' a row. Activation happens when you click on a row in theData Window or click on a point in a plot.Some of these use SAMP.

They are controlled from theActivation Window,which you can reach using theActivation Action button in the main Control Window.

This example uses a list of HST spectral observations ofpositions in the Asiago supernova catalog (B/sn in VizieR).It was obtained by using theMultiple SSA window from the VO menu with B/sn as the localtable and ivo://mast.stsci/ssap/hst as the remote service.Alternatively, like this (which took about 5 minutes):You can find the data file at http://andromeda.star.bris.ac.uk/data/sn-hst-spectra.vot.

We will try a few activation actions.Click the Activation Action button in the Control Windowto open the Activation Windowand select different options by selecting one of the radio buttonson the left, filling in the corresponding panel,and clicking OK at the bottom (which closes the window).

Display Cutout Image
Check the RA/Dec columns are filled in, and pick an all-sky cutout service. Activating rows displays a postage stamp image in a basic image viewer.
Transmit Coordinates
Start up Aladin, choose (e.g.) 2MASS All-Sky imagery from the menu along the top, and zoom in (e.g. mouse wheel). Check the RA/Dec columns are filled in. Activating rows moves the Aladin view to the position of that row.
View URL as Spectrum
Start up a SAMP-capable spectrum viewer (e.g. SPLAT-VO). The Spectrum Location Column should be the url column (may get filled in automatically). Activating rows loads the corresponding spectrum into SPAT.
Custom code
You can enter here functions that are executed on activation. Look at the Activation Functions section in the Available Functions window for the options. One of the most useful are the exec functions listed under System. These let you execute a shell command. If you enter 'exec('curl', url, '-o', sn+'.fits')', then every row activation will result in a FITS file being written to the current directory, named after the nearby supernova (e.g. 1987A.fits), containing the corresponding HST spectrum. For more control over what happens, you could write a custom shell script that takes command-line parameters supplied by such an exec invocation.

8 STILTS/JyStilts

STILTS is a set of command line tools that can do more or lessthe same things as TOPCAT.For full details see the manual,but here is some explanation of the basic concepts.

Invocation
The easiest thing is to copy the files stilts.jar and stilts files into the same directory, set stilts executable (chmod u+x stilts) and use that. Alternatively, do java -jar stilts.jar.

All commands are of the form

tpipe
The most basic command is tpipe. This takes an input file, lets you apply a number of filters (zero or more cmd=... parameters) that modify the table data or metadata, and output it in some way (omode=... parameter). It works like a Unix pipeline, but processing table data and metadata not lines of an input stream. If there are no cmd parameters, no changes are made. If there is no omode parameter, the result is just written to file (format default or as specified)
Format conversion
stilts tpipe in=messier.xml out=messier.fits
Row selection
stilts tpipe in=rave-dr4.fits cmd='select abs(hrv)>100' omode=count
Filters
Many filters are listed in the manual.. In tpipe they are given as cmd= arguments. For some other commands which distinguish between different table streams they can be e.g. icmd/ocmd (for input/output) or cmd1/cmd1 (for two different input tables) etc. Here are some examples of using filters:
Add a new calculated column
cmd=’addcol B_R BMAG-RMAG’
Select only rows in a given region
cmd=’select skyDistanceDegrees(RA,DEC,78.63,-8.20)<0.001’
Select only ten reddest objects
cmd=’sort RMAG-BMAG’ cmd=’head 10’
Expression language
  • Mostly 'common-sense' programming language syntax (it's actually java syntax)
  • Column names as variables, expressions are evaluated for each row
  • Avoid funny characters in column names (start with alphabetic; then alphanumeric/underscore)
  • You can use '$n' syntax as alias for column #n.
  • Various maths/astro functions (exp(x), janskyToAb(flux), substring(str,index), ...) - use stilts funcs to investigate.
  • Logical expressions: && (and), (or), (equals), ! (not), ...
  • Conditional expression: <expr>?<value-if-true>:<value-if-false>
Getting help
Use the manual!
  • Identify the command you want from the Commands by Category section (if in doubt, try tpipe)
  • Look at its Usage subsection to see what the parameters are
  • Look at its Examples subsection to see examples of it in use

Help is available from the command line too:

  • If you omit a required parameter you will be prompted
  • You can type stilts <task-name> -help for help on the command
  • You can type stilts <task-name> help=<param-name> (or ? at the prompt) for help on a parameter.

Topcat X Plane 11

Admittedly, the plotting commands can be quite complicated... They have their chapter in the manual to help.

8.1 JyStilts

JyStilts is a Jython (like python, but implementedin Java and with no C extensions) front-end to stilts.

Invocation
jython -jar jystilts.jar.
Documentation
JyStilts chapter in the manual.
Comparison with command-line stilts
From the shell
JyStilts
Pythonic features
  • Array-like row-counting: len(t)
  • Array-like row slicing: t[100:200]
  • Iteration over rows: for row in t:
  • Index columns by name or number: row['BMAG'] or row[2]
  • Docstring help: help(t.cmd_addcol)
  • ...
JyStilts Advantages
  • Good if you like python
  • Syntax is less tortured (parameter quoting problems not so bad)
  • Can be more efficient for multi-step procedures: intermediate results are kept as objects in memory, they don't have to be de/serialised to (e.g.) FITS files for every command.
  • Pythonic access (to some extent) to table data/metadata.
TOPCAT/STILTS Advanced Tutorial

All apologies to Cliff Telford

By Ken Burdick
June 2020

The top Cat was designed in 1958 by Clifford Telford. One of the prettiest Speed planes built. Steve Helmick introduced me to his when we were pretty young and I never forgot the lines on it.

Fast Forward: Now I’m an old man and sequestered by threat of catching some COVID virus from China. I had pretty well built all my projects and needed something to keep me occupied, so I built a Top Cat from the sketch provided in the December 1991 Flying Lines newsletter. I for one really enjoy carving old Speed ships so this was a perfect project.

Getting the project started. All photos by Ken Burdick.

What’s in the drawer?

SuperTigre X-40 engines.

Looking through my ever-growing stash of speed engines, I noticed that I have four really nice Super Tiger X-40s. “Perfect,” I thought, and took one out. The one I chose was marked with the TDC on its case so head setup is a snap, I measured it and all looked pretty nice so X-40 it shall be! I fabricated a mini-pipe and internal ring collar so it would fit the ST manifold. Spinner work was from Richard Heart. I decided to make the needle valve and venturi out of an ST 35 after-market that I bought so as to maximize the amount of air into out X-beast.

The mini-pipe parts (above) and venturi (below).

Wood pile

Looking over some sketchy plans, I determined that the crutch needed to be ¾” basswood, and I had just one piece left. The thing would have to be narrow compared to the original which sported a McCoy 60. I think the X-40 is about half in weight and breadth, so some liberty was taken on ol' Cliff’s gem. The wing is 3/8” thick as per the original, but is basswood-lined balsa wood; the stab is 3/16' basswood.

Design changes

The original Top Cat and plans.

Some changes were made to match the new skinny version of this vintage ship. For one thing, it's now a rear -exhaust and that threw a wrench right through the cowling. One of the most distinctive features is the swooping lines from the rear of the cowl to the tail; putting a big hole in it for a mini pipe sort of throws that out da window. I was able to match the angle on the cowl, but not the look. Wings and stab were calculated and then eyeballed to proportions needed from a top view.

Where to put the stab? His model has the tail well back of the stab so some eyeballing was again in order. When I had all the rough edges chiseled out, the stone began to take shape.

Getting the stabilizer location figured out.

The Big Ugly!

Why go through all the simple stuff, huh? Let’s get to the awful crap. The model was carved, sanded and a reasonable cowing attached. I coated her with several coats of nitrate and covered it old school (silkspan) with more nitrate coats. I have been finishing with Rustoleum and then a top coat of auto clear coat, but have been spending too much time screwing around with wrinkles in the paint from reaction with Rustoleum and the nitrate.

I was reading an old issue of Flying Lines and found that Bruce Duncan had built a speed plane in the 90s and used an epoxy named Enduro. Being in British Columbia makes some of the modeling stuff I took for granted in the U.S. much different. Finding a Canadian-made epoxy finish would save me a lot of freight and fiddling with border issues.

I bought some plain part A and B from Enduro, it arrived in two days! Unheard of in these parts (Kamloops, B.C.). I wasn’t thinking when I bought it and didn’t buy the reducer -- dang! So I tried it without reducing it. The tack coat went on like it should, but the top coat sagged and just didn’t look right. Many days later, I was sanding down the blue goo that had cured to a rock hard finish. Meanwhile I sent for the reducer! The second try was on a stick of bass I had primed -- “looks pretty good!” So I mixed a batch and it snuck in through the basement door and gassed out the house. This paint was quickly becoming a problem. The second coat that was thinned about 40% went on perfectly and looks pretty good, so I’d call it a draw.

The Top Cat ready to fly.

Future Plans

Too much guesswork, even though it produced a very nice model. I sent away for the AMA plans for the Top Cat. That was several weeks ago and is in keeping with the mail and border shenanigans.

I have already envisioned yet another Top Cat and this one will use a Nelson .40 front intake, side exhaust. The rear of the cowling will be as per plans, with only a giant hole in the front for the intake.

Somehow, they will have to open the border so I can get to my Seattle address and retrieve the engine, but oh well, all things in good time.

-- Kennyb

Back to Bod Busters main page

Back to Speed main page

Flying Lines home page

This page was upated June 11, 2020