SPECIAL SECTION ON SECURITY AND WATERMARKING OF MULTIMEDIA CONTENTS

Fair evaluation methods for image watermarking systems

[+] Author Affiliations
M. Kutter

Signal Processing Laboratory, Swiss Federal Institute of Technology, Ecublens, 1015?Lausanne, Switzerland

F. A. P. Petitcolas

The Computer Laboratory, University of Cambridge, Pembroke Street, Cambridge CB2?3QG, United Kingdom

J. Electron. Imaging. 9(4), 445-455 (Oct 01, 2000). doi:10.1117/1.1287594
History: Received Apr. 15, 1999; Revised May 25, 2000; Accepted June 5, 2000
Text Size: A A A

Abstract

Since the early 1990s a number of papers on “robust” digital watermarking systems have been presented but none of them uses the same robustness criteria. This is not practical at all for comparison and slows down progress in this area. To address this issue, we present an evaluation procedure of image watermarking systems. First we identify all necessary parameters for proper benchmarking and investigate how to quantitatively describe the image degradation introduced by the watermarking process. For this, we show the weaknesses of usual image quality measures in the context watermarking and propose a novel measure adapted to the human visual system. Then we show how to efficiently evaluate the watermark performance in such a way that fair comparisons between different methods are possible. The usefulness of three graphs: “attack versus visual-quality,” “bit error versus visual quality,” and “bit error versus attack” are investigated. In addition the receiver operating characteristic graphs are reviewed and proposed to describe statistical detection behavior of watermarking methods. Finally we review a number of attacks that any system should survive to be really useful and propose a benchmark and a set of different suitable images. © 2000 SPIE and IS&T.

© 2000 SPIE and IS&T

Citation

M. Kutter and F. A. P. Petitcolas
"Fair evaluation methods for image watermarking systems", J. Electron. Imaging. 9(4), 445-455 (Oct 01, 2000). ; http://dx.doi.org/10.1117/1.1287594


Figures

Tables

Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.