VISTA data flow system: pipeline processing for WFCAM and VISTA

Mike J. Irwin; Jim Lewis; Simon Hodgkin; Peter Bunclark; Dafydd Evans; Richard McMahon; James P. Emerson; Malcolm Stewart; Steven Beard

doi:10.1117/12.551449

16 September 2004 VISTA data flow system: pipeline processing for WFCAM and VISTA

Mike J. Irwin, Jim Lewis, Simon Hodgkin, Peter Bunclark, Dafydd Evans, Richard McMahon, James P. Emerson, Malcolm Stewart, Steven Beard

Author Affiliations +

Proceedings Volume 5493, Optimizing Scientific Return for Astronomy through Information Technologies; (2004) https://doi.org/10.1117/12.551449
Event: SPIE Astronomical Telescopes + Instrumentation, 2004, Glasgow, United Kingdom

Abstract

The UKIRT Wide Field Camera (WFCAM) on Mauna Kea and the VISTA IR mosaic camera at ESO, Paranal, with respectively 4 Rockwell 2kx2k and 16 Raytheon 2kx2k IR arrays on 4m-class telescopes, represent an enormous leap in deep IR survey capability. With combined nightly data-rates of typically 1TB, automated pipeline processing and data management requirements are paramount. Pipeline processing of IR data is far more technically challenging than for optical data. IR detectors are inherently more unstable, while the sky emission is over 100 times brighter than most objects of interest, and varies in a complex spatial and temporal manner. In this presentation we describe the pipeline architecture being developed to deal with the IR imaging data from WFCAM and VISTA, and discuss the primary issues involved in an end-to-end system capable of: robustly removing instrument and night sky signatures; monitoring data quality and system integrity; providing astrometric and photometric calibration; and generating photon noise-limited images and astronomical catalogues. Accompanying papers by Emerson etal and Hambly etal provide an overview of the project and a detailed description of the science archive aspects.

Citation Download Citation

Mike J. Irwin, Jim Lewis, Simon Hodgkin, Peter Bunclark, Dafydd Evans, Richard McMahon, James P. Emerson, Malcolm Stewart, and Steven Beard "VISTA data flow system: pipeline processing for WFCAM and VISTA", Proc. SPIE 5493, Optimizing Scientific Return for Astronomy through Information Technologies, (16 September 2004); https://doi.org/10.1117/12.551449

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available