Independence diagrams: a technique for data visualization

Stefan Berchtold; H. V. Jagadish; Kenneth A. Ross

doi:10.1117/1.1289356

1 October 2000 Independence diagrams: a technique for data visualization

Stefan Berchtold, H. V. Jagadish, Kenneth A. Ross

Journal of Electronic Imaging, Vol. 9, Issue 4, (October 2000). https://doi.org/10.1117/1.1289356

An important issue in data visualization is the recognition of complex dependencies between attributes. Past techniques for identifying attribute dependence include correlation coefficients, scatterplots, and equi-width histograms. These techniques are sensitive to outliers, and often are not sufficiently informative to identify the kind of attribute dependence present. We propose a new approach, which we call independence diagrams. We divide each attribute into ranges; for each pair of attributes, the combination of these ranges defines a two-dimensional grid. For each cell of this grid, we store the number of data items in it. We display the grid, scaling each attribute axis so that the displayed width of a range is proportional to the total number of data items within that range. The brightness of a cell is proportional to the density of data items in it. As a result, both attributes are independently normalized by frequency, ensuring insensitivity to outliers and skew, and allowing specific focus on attribute dependencies. Furthermore, independence diagrams provide quantitative measures of the interaction between two attributes, and allow formal reasoning about issues such as statistical significance. We have addressed several technical challenges in making independence diagrams work, ranging from the treatment of categorical attributes to visual artifacts of cell-topixel mapping. Our experimental evaluation, using both AT&T and synthetic data, shows that independence diagrams allow the easy identification of various kinds of attribute dependence that would be difficult to identify using conventional techniques.

Citation Download Citation

Stefan Berchtold, H. V. Jagadish, and Kenneth A. Ross "Independence diagrams: a technique for data visualization," Journal of Electronic Imaging 9(4), (1 October 2000). https://doi.org/10.1117/1.1289356

Published: 1 October 2000

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available