Storage options for petabytes of data

Lisa Paton; Jonathan Cirtain; Paul Grant

doi:10.1117/12.789763

21 July 2008 Storage options for petabytes of data

Lisa Paton, Jonathan Cirtain, Paul Grant

Proceedings Volume 7019, Advanced Software and Control for Astronomy II; 70192Z (2008) https://doi.org/10.1117/12.789763
Event: SPIE Astronomical Telescopes + Instrumentation, 2008, Marseille, France

Abstract

New instrumentation that produces extremely large quantities of data presents a challenge in data processing and management. The Solar Dynamics Observatory (SDO) will house instruments that will produce 1.4TB of data per day. Processing and storing that quantity of data is a serious challenge. The instrument team for the Atmospheric Imaging Assembly (AIA) that will fly on SDO spent the last 2 weeks in September doing a large-scale side-by-side comparison of archive equipment from Apple, BlueArc, EMC, Network Appliance, SGI and Sun Microsystems. Each vendor provided 100TB of SATA disk space and the required servers to showcase their unique solutions to the problem of petabyte sized archives. The results of the testing demonstrate some of the options available in this arena. We will discuss the results of the testing, the differences and similarities between the vendors and the applicability of the technologies to various environments.

Citation Download Citation

Lisa Paton, Jonathan Cirtain, and Paul Grant "Storage options for petabytes of data", Proc. SPIE 7019, Advanced Software and Control for Astronomy II, 70192Z (21 July 2008); https://doi.org/10.1117/12.789763

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available