Setup

Python

To install crowdastro and dependencies, you need Python 3.4 or greater. crowdastro can be installed through pip:

pip3 install crowdastro

MongoDB

Install and run MongoDB. On Mac OS X or Linux, you can run MongoDB as follows:

mongod --config /usr/local/etc/mongod.conf --fork

On Windows:

K:\MongoDB\Server\3.2\bin\mongod.exe --dbpath J:\data\mongodb

Data

You need the following data files:

  • ATLASDR3_cmpcat_23July2015.dat.gz
  • cdfs_11JAN2014_2x2_5x5.tgz
  • radio_galaxy_zoo_2016-08-28.tar.gz
  • RGZ-ATLAS-Bookkeeping.csv
  • SWIRE3_CDFS_cat_IRAC24_21Dec05.tbl.gz or an AllWISE catalogue covering the CDFS field
  • norris_2006_atlas_classifications_ra_dec_only.dat (pipe-separated RA/DEC from Norris et al. (2006) Table 6)
  • wise_allwise.wise_allwise_p3as_psd4511.tbl
  • fan_2015_swire_only.csv
  • CDFSmosaic_allch_8March2015.fits

These files are currently not easily available. In the future, we will add download links.

The following steps assume the files are in the project root. If this isn't the case, modify paths in setup_data.sh, mongo_load_json.sh, and crowdastro/crowdastro.json.

From the project root, run setup_data.sh. If this doesn't work, extract radio_galaxy_zoo_2016-08-28.tar.gz, SWIRE3_CDFS_cat_IRAC24_21Dec05.tbl.gz, and ATLASDR3_cmpcat_23July2015.dat.gz to data/, and cdfs_11JAN2014_2x2_5x5.tgz to data/cdfs. Copy RGZ-ATLAS-Bookkeeping.csv and any other files to data/. These paths can all be modified in crowdastro.json in the root directory.

Run mongo_load_json.sh to import the files into the radio MongoDB database. You will now be able to access the collections radio.radio_classifications, radio.radio_groups, and radio.radio_subjects.

Note that crowdastro.json assumes the existence of a data/ directory in the current working directory.