An analysis of optimal compression for the advanced baseline imager based on entropy and noise estimation

M. Grossberg; S. Gottipati; I. Gladkova; M. Goldberg; L. Roytman

doi:10.1117/12.681487

1 September 2006 An analysis of optimal compression for the advanced baseline imager based on entropy and noise estimation

M. Grossberg, S. Gottipati, I. Gladkova, M. Goldberg, L. Roytman

Author Affiliations +

Proceedings Volume 6300, Satellite Data Compression, Communications, and Archiving II; 63000M (2006) https://doi.org/10.1117/12.681487
Event: SPIE Optics + Photonics, 2006, San Diego, California, United States

Abstract

As new instruments are developed, it is becoming clear that our ability to generate data is rapidly outstripping our ability to transmit this data. The Advanced Baseline Imager (ABI), that is currently being developed as the future imager on the Geostationary Environmental Satellite (GOES-R) series, will offer more spectral bands, higher spatial resolution, and faster imaging than the current GOES imager. As a result of the instrument development, enormous amounts of data must be transmitted from the platform to the ground, redistributed globally through band-limited channels, as well as archived. This makes efficient compression critical. According to Shannon's Noiseless Coding Theorem, an a upper bound on the compression ratio can be computed by estimating the entropy of the data. Since the data is essentially a stream, we must determine a partition of the data into samples that capture the important correlations. We use a spatial window partition so that as the window size is increased the estimated entropy stabilizes. As part of our analysis we show that we can estimate the entropy despite the high-dimensionality of the data. We achieve this by using nearest neighbor based estimates. We complement these a posteriori estimates with a priori estimates based on an analysis of sensor noise. Using this noise analysis we propose an upper bound on the compression achievable. We apply our analysis to an ABI proxy in order estimate bounds for compression on the upcoming GOES-R imager.

Citation Download Citation

M. Grossberg, S. Gottipati, I. Gladkova, M. Goldberg, and L. Roytman "An analysis of optimal compression for the advanced baseline imager based on entropy and noise estimation", Proc. SPIE 6300, Satellite Data Compression, Communications, and Archiving II, 63000M (1 September 2006); https://doi.org/10.1117/12.681487

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available