Installing the LSST Science Pipelines¶

Mac OS X¶

We have tested the Science Pipelines on OS X Yosemite (10.10).

The Science Pipelines are not currently supported on OS X El Capitan (10.11). See Known Issues for v11.0. Versions prior to OS X 10.9 and earlier have not been tested recently and may not work.

You will need to install developer tools, which we recommend you obtain with Apple’s Xcode command line tools package. To do this, run from the command line (e.g. Terminal.app or similar):

xcode-select --install

and follow the on-screen instructions. You can verify where the tools are installed by running:

xcode-select -p

Debian / Ubuntu¶

apt-get install make bison curl ca-certificates flex \
    g++ git libbz2-dev libreadline6-dev libx11-dev \
    libxt-dev m4 zlib1g-dev libxrender1 libfontconfig1 \
    libncurses5-dev cmake libglib2.0-dev openjdk-7-jre \
    gettext libcurl4-openssl-dev perl-modules -y

Prefix the apt-get command with sudo if necessary.

RedHat / CentOS¶

yum install bison curl blas bzip2-devel bzip2 flex fontconfig \
    freetype-devel gcc-c++ gcc-gfortran git libuuid-devel \
    libXext libXrender libXt-devel make openssl-devel patch perl \
    readline-devel tar zlib-devel ncurses-devel cmake glib2-devel \
    java-1.8.0-openjdk gettext libcurl-devel \
    perl-ExtUtils-MakeMaker

Prefix the yum command with sudo if necessary.

Upgrading compilers for legacy RedHat / CentOS 6¶

The minimum gcc version required to compile the Stack is gcc 4.8. This comes as standard in the LSST “factory” platform, Red Hat / CentOS 7.

On our previous factory platform, Red Hat / CentOS 6, you will need to use a more current version of gcc that what is available with your system. If you can go to Red Hat 7, we recommend that you do; if you cannot, we recommend that you use a newer gcc version for the stack by using a Software Collection (SCL) with a different version of devtoolset. This will enable you to safely use a different version of gcc (4.9) for the stack than that used by your operating system (4.4).

First, install devtoolset-3 (after the installing the standard pre-requisites (above)):

sudo yum install -y https://dl.fedoraproject.org/pub/epel/epel-release-latest-6.noarch.rpm
sudo yum install -y https://www.softwarecollections.org/en/scls/rhscl/rh-java-common/epel-6-x86_64/download/rhscl-rh-java-common-epel-6-x86_64.noarch.rpm
sudo yum install -y https://www.softwarecollections.org/en/scls/rhscl/devtoolset-3/epel-6-x86_64/download/rhscl-devtoolset-3-epel-6-x86_64.noarch.rpm
sudo yum install -y scl-utils
sudo yum install -y devtoolset-3

Then enable devtoolset-3 by including this line in your ~/.bash_profile:

scl enable devtoolset-3 bash

Python dependencies¶

You can use your own Python 2.7.* install or let newinstall.sh install Anaconda in your local directory.

Optional dependencies¶

Although not required, we recommend you install the matplotlib and scipy Python packages:

pip install -U matplotlib scipy

Note these are included by default in Anaconda, which newinstall.sh can obtain for you.

We also use SAOImage DS9 to display images for debugging.

1. Choose an installation directory¶

First, choose where you want to install the LSST Science Pipelines. We’ll use $HOME/lsst_stack in this example. Create and change into that directory:

mkdir -p $HOME/lsst_stack
cd $HOME/lsst_stack

2. Unset environment variables¶

If you’ve run the LSST Science Pipelines previously, you may have conflicting environment variables setup. To be safe, run:

unset LSST_HOME EUPS_PATH LSST_DEVEL EUPS_PKGROOT REPOSITORY_PATH

3. Installation set-up¶

Download and run the installation setup script, which installs the basic packages required to install other packages:

curl -OL https://sw.lsstcorp.org/eupspkg/newinstall.sh
bash newinstall.sh

This installs the loadLSST.* scripts, which you should source to ensure that LSST tools (e.g., the eups command) are included in your path.

The install script will check your system to ensure that appropriate versions of critical packages are installed on your system, to enable bootstrapping the Science Pipelines, including git, and python. If these packages are not available, the script will offer to install them for you (using the Anaconda Python distribution for the latter packages).

Allowing the installation of these core packages will not replace or modify any other version of these packages that may be installed on your system. If you do not choose the Anaconda Python install, and subsequent package build steps fail, you can do one of two things:

• Report the problem to community.lsst.org. Include your OS, a description of the problem, plus any error messages. Community members will provide assistance.
• Consider removing all contents of the install directory and start from scratch, and accepting the Anaconda Python installation option.

Once newinstall.sh has finished, source the LSST environment to continue the installation by running the appropriate command for your shell:

source $LSST_INSTALL_DIR/loadLSST.bash # for bash users
source $LSST_INSTALL_DIR/loadLSST.csh  # for csh users
source $LSST_INSTALL_DIR/loadLSST.ksh  # for ksh users
source $LSST_INSTALL_DIR/loadLSST.zsh  # for zsh users

where $LSST_INSTALL_DIR is expanded to your installation directory.

4. Install packages¶

Finally, build/install any other components of the LSST Science Pipelines that are relevant for your work. A simple way to ensure that you have a fairly complete set of packages for this need is to install lsst_apps. The dependency tree for lsst_apps ensures that many other packages (about 70, including e.g., pipe_tasks) are also installed.

Installing lsst_apps may take a little while (about 1.2 hr on a 2014-era iMac with 32 GB of memory and 8 cores):

eups distrib install -t v11_0 lsst_apps

After this initial setup, it is a good idea to test the installation. See Testing Your Installation.

5. Source the LSST environment in each shell session¶

Whenever you want to run the installed LSST Science Pipelines in a new terminal session, be sure to source the appropriate loadLSST.{bash,csh,ksh,zsh} script.