Massive data processing on the Acxiom cluster testbed

Amy W. Apon; Pawel Dominik Wolinski; Dennis Alan Reed; Greg M. Amerson; Prathima Gorjala

doi:10.1117/12.434867

27 July 2001 Massive data processing on the Acxiom cluster testbed

Amy W. Apon, Pawel Dominik Wolinski, Dennis Alan Reed, Greg M. Amerson, Prathima Gorjala

Proceedings Volume 4528, Commercial Applications for High-Performance Computing; (2001) https://doi.org/10.1117/12.434867
Event: ITCom 2001: International Symposium on the Convergence of IT and Communications, 2001, Denver, CO, United States

Abstract

The Acxiom Cluster Testbed is a high-performance, low-cost cluster that is being constructed at the University of Arkansas for the purpose of designing, constructing, and evaluating cluster architectures for massive data processing. Our evaluation efforts include performance testing of cluster hardware and a variety of middleware configurations for the cluster. One of the most important middleware components for massive data processing is a high-performance cluster file system. In this paper we present system requirements for a parallel cluster-based file system, our experimental evaluation of the NFS file system and the PVFS parallel file system for Linux, and future research goals.

Citation Download Citation

Amy W. Apon, Pawel Dominik Wolinski, Dennis Alan Reed, Greg M. Amerson, and Prathima Gorjala "Massive data processing on the Acxiom cluster testbed", Proc. SPIE 4528, Commercial Applications for High-Performance Computing, (27 July 2001); https://doi.org/10.1117/12.434867

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available