# Application of reversible denoising and lifting steps with step skipping to color space transforms for improved lossless compression

**Roman Starosolski**

Silesian University of Technology, Institute of Informatics, Akademicka 16, 44-100 Gliwice, Poland

*J. Electron. Imaging*. 25(4), 043025 (Aug 12, 2016). doi:10.1117/1.JEI.25.4.043025

#### Open Access

## Abstract

**Abstract.**
Reversible denoising and lifting steps (RDLS) are lifting steps integrated with denoising filters in such a way that, despite the inherently irreversible nature of denoising, they are perfectly reversible. We investigated the application of RDLS to reversible color space transforms: RCT, YCoCg-R, RDgDb, and LDgEb. In order to improve RDLS effects, we propose a heuristic for image-adaptive denoising filter selection, a fast estimator of the compressed image bitrate, and a special filter that may result in skipping of the steps. We analyzed the properties of the presented methods, paying special attention to their usefulness from a practical standpoint. For a diverse image test-set and lossless JPEG-LS, JPEG 2000, and JPEG XR algorithms, RDLS improves the bitrates of all the examined transforms. The most interesting results were obtained for an estimation-based heuristic filter selection out of a set of seven filters; the cost of this variant was similar to or lower than the transform cost, and it improved the average lossless JPEG 2000 bitrates by 2.65% for RDgDb and by over 1% for other transforms; bitrates of certain images were improved to a significantly greater extent.

Most color image compression algorithms independently compress the image components; since components in the RGB space are correlated, the compression is performed after transforming image data to a less correlated color space. For the lossless compression, reversible color space transforms are employed, which are built using lifting steps.^{1}^{,}^{2} In Ref. ^{3}, it was noticed that such a step might increase the total amount of noise that had to be encoded during compression. To remove correlation without increasing noise, lifting steps were replaced with reversible denoising and lifting steps (RDLS), which are lifting steps integrated with denoising filters. The step is modified in such a way that, despite involving the inherently irreversible denoising, it is perfectly reversible. RDLS was applied to a simple RDgDb^{4} transform (also known as $A2,1$^{5}) and it was found that RDLS improved bitrates of images in optical resolutions of acquisition devices. Experiments were performed for three significantly different standard image compression algorithms in the lossless mode (JPEG-LS,^{6} JPEG 2000,^{7} and JPEG XR^{8}) and for simple linear denoising filters (“smoothing” filters). The memoryless entropy of the component prediction error obtained with the MED predictor^{9} was a very efficient estimator of image component transform effects that was found suitable for selecting a filter for a given image component independently of the image compression algorithm.

An intermediate stage of the research reported herein was presented in Ref. ^{10}, where RDLS was applied to more complex color space transforms LDgEb^{4} (denoted $A4,10$ in Ref. ^{5}) and RCT (among others, used in JPEG 2000). RDLS effects were evaluated using the same denoising filters, compression algorithms, and test images, as in Ref. ^{3}. Entropy estimation employing MED was used for selecting the denoising filter and deciding whether to exploit denoising. The selection of filters for a given transform step was based only on the estimated filtering effects on a bitrate of component modified by this step. As a result, the filtering might, for RCT and LDgEb, result in worsening of the overall image bitrate even if assuming the perfect estimation.

In Ref. ^{3}, it was also observed that, although RDgDb or its RDLS-modified variant improves bitrates in the average case, for some color images, the best ratios were obtained when untransformed components were compressed. In Ref. ^{11}, RDLS was applied to discrete wavelet transform (DWT) in lossless JPEG 2000 compression of grayscale images. The noise filtering was the most effective when applied only to some steps. Some images were compressed better when the DWT stage of this algorithm was skipped, although in the average case, RDLS improved bitrates. Thus, it was suspected that the optimum might be in-between skipping and applying the transform, i.e., that better bitrates may be obtained by skipping only some of the steps of the transform.

The new contributions of this study are mainly motivated by conclusions from earlier works and are aimed at properties of RDLS-modified color space transforms that are worthwhile from a practical standpoint. Since sometimes it is better to compress an untransformed image, we propose employing a special filter, named “null,” which may make the RDLS-modified color space transform skip all or some of its steps. We also propose an image-adaptive denoising filter selection heuristic that, as compared to the heuristic exploited in Ref. ^{10}, avoids worsening of the image bitrate and for more complex transforms is faster. As the heuristic cost (i.e., its computational time complexity) may still be too high for practical applications, we propose the limited complexity estimator of compression effects H0_pMED(10k:100), which is based on a fast estimator from Ref. ^{5}. The cost of the latter, however, significantly increased if RDLS was employed. The evaluation of the effects of the above contributions is performed using the same transforms, compression algorithms, and test images, as in Ref. ^{10}. Additionally, we apply RDLS to the YCoCg-R transform,^{1} test the heuristic against an exhaustive filter search, and the estimators against the actual bitrates of lossless image compression algorithms.

The remainder of this paper is organized as follows. In Sec. 2, first, the reversible color space transforms and the RDLS method are briefly described. Next, in Sec. 2.3, we present the RDLS-modified transforms including the new RDLS-YCoCg-R and compare their dynamic ranges and bit-depths to the non-RDLS counterparts. In Sec. 2.4, we demonstrate the transform reversibility in a step-by-step example and present sample effects that RDLS may have on the transformed components of a noisy image. In Sec. 2.5, we describe the denoising filters used in the research including the proposed null filter. Then we introduce the filter selection heuristic (Sec. 2.6) along with the compression effect estimators including the proposed H0_pMED(10k:100) (Sec. 2.7) and report their complexities for various transforms. We also describe the compression algorithms, implementations, and test data (Sec. 2.8). Results are presented and discussed in Sec. 3. We start from analyzing the effects of contributions that are aimed at the bitrate improvement (i.e., the new heuristic and the null filter) and comparing them to the previously known methods. Next (Sec. 3.2), we reduce the cost of the bitrate improvement by limiting the number of denoising filters and iterations of the heuristic and by applying H0_pMED(10k:100). We also perform certain additional experiments (Sec. 3.3), among others, to check how far from optimal are our heuristic and estimation method. Finally, the extensive summary is followed by a brief conclusion.

Reversible color space transforms investigated in this study are sequences of lifting steps. Below, we characterize them briefly and refer the reader to Refs. ^{1}, ^{4}, and ^{5} for more detailed descriptions and comparisons among them. In each lifting step of a transform, a single pixel component is modified by adding to it a linear combination of other components of the same pixel; the sum may be negated. Up to three steps are needed to transform an RGB pixel to any of the spaces discussed in this section. A transform realized as a sequence of lifting steps has advantageous properties: it may be computed in-place, it is reversible when transformed components are stored using integers (it is integer-reversible), and it is easily and perfectly invertible. To obtain an inverse transform, the inverses of lifting steps should be applied in an order exactly opposite to the order employed by the forward transform. However, transforms are usually presented using different symbols for components before and after applying lifting steps to them, lifting equations are simplified, or a lifting sequence is transformed in order to present an optimized method of transform implementation. Thus, it may not be obvious which component is modified in a given step or how to inverse the step. In this section, we follow the usual way of presentation; for transforms presented as sequences of lifting steps, see Sec. 2.3.

Probably the most frequently used reversible color space transform is the RCT transform employed in JPEG 2000 for lossless compression, which is an approximation of an irreversible ICT transform used in JPEG 2000 for lossy compression, that in turn may be seen as an approximation of an irreversible YCbCr color space transform.^{7} Equation (1) presents forward (left-hand side) and inverse RCT:

Another standard transform, among others used in JPEG XR, is YCoCg-R. In Eq. (2), it is presented as it was originally proposed in Ref. ^{12}, i.e., as a sequence of steps involving storing an intermediate result in a temporary variable $t$; $Y$ represents pixel luminance, whereas $Co$ and $Cg$ are chrominance components:

In Ref. ^{3}, RDLS was applied to the RDgDb transform [Eq. (3)],^{4} which is also known as $A2,1$.^{5} RDgDb was chosen because of its simplicity and good performance. It requires only two simple integer operations (add or subtract) per pixel, which for the three-component RGB color space is possible because we do not transform all the components. There are two transformed chrominance components $Dg$ and $Db$, but instead of luminance, the untransformed primary color $R$ is used:

In this research, we also include the LDgEb transform [Eq. (4)]^{4} (denoted $A4,10$ in Ref. ^{5}). Like typical transforms, it results in a luminance ($L$) and two chrominance ($Dg$ and $Eb$) components; interestingly, the component formulas are based on actual analog transforms from the human visual system:

A lifting step in a reversible color space transform may propagate the noise to the component it modifies from other components. In Ref. ^{3}, integrating denoising into lifting steps was proposed in order to avoid noise propagation while preserving other transform properties (i.e., reversibility, in-place operation, and removing correlation). The method was based on the generalized lifting step of a color space transform:

By denoising of arguments of function f in the generalized lifting step [Eq. (5)], a reversible denoising and lifting step [RDLS, Eq. (6)] was constructed:

Despite the inherently lossy nature of denoising, RDLS exploiting denoising is perfectly and easily invertible. An inverse of an RDLS-modified color space transform is obtained by applying inverses of RDLS:

In Eq. (8), the RCT transform is defined as a sequence of lifting steps—both the forward RCT transform (left-hand side) and inverse:

The RDLS-modified RCT [RDLS-RCT, Eq. (9)] is obtained by simply replacing the RCT [Eq. (8)] lifting steps [Eq. (5)] with the RDLS [Eq. (6)] constructed based on them:

The dynamic range of RDLS-RCT components differs from RCT components’ range in the case of the $C2$ component. We assume that denoising of the pixel component $Cn$ may result in any integer within the dynamic range of the image component $Cn$. Note that the “component” term may refer to a pixel and to an image; in the latter case, the image component $Cn$ is an image consisting of $Cn$ components of all pixels of a color image. In RDLS-RCT, for the $[0,2b\u22121]$ range of untransformed RGB components, the range of $C1$ and $C3$ before performing the forward step 3 is $[\u22122b+1,2b\u22121]$. Due to denoising, step 3 of RDLS-RCT adds to $C2$, a floor of a quarter of a sum of two values, each of which may be any integer from the $[\u22122b+1,2b\u22121]$ range. Thus, the range of the RDLS-RCT transformed $C2$ is $[\u22122b\u22121,3\xb72b\u22121\u22122]$.

As noted in Ref. ^{3}, a lifting-based color space transform may be performed for each pixel independently of others. The RDLS sequence, constructed based on a color space transform, is a transform of the whole image components. It is not a color space transform, since denoising of a specific pixel’s component $Cn$ requires to access the $Cn$ of (at least) neighboring pixels. The lifting-based color space transform of an image may be performed in a pixel-by-pixel regime, i.e., we apply all transform steps to a pixel, then we proceed to the next pixel, or step-by-step, i.e., we apply a lifting step to all pixels, and then we proceed to the next step; these regimes are equivalent. Also for the RDLS-modified transform, both regimes may be exploited, but they are not equivalent as filters depend on the regime. In this study, we employ the step-by-step regime. In this regime, for each image component, except for the component being modified in the current step, either all pixels are transformed or all are untransformed. Assuming that each untransformed and each transformed image component has invariant characteristics, the same filter may be selected for all image pixels in a given RDLS-modified transform step for denoising of a given component.

Presented below are the RDLS-modified variants of YCoCg-R [RDLS-YCoCg-R, Eq. (10)], RDgDb [RDLS-RDgDb, Eq. (11)], and LDgEb [RDLS-LDgEb, Eq. (12)]:

Transform | $C1$ | $C2$ | $C3$ | ||||||
---|---|---|---|---|---|---|---|---|---|

Name | range | depth | name | range | depth | name | range | depth | |

RGB | $R$ | $[0,2b\u22121]$ | $b$ | $G$ | $[0,2b\u22121]$ | $b$ | $B$ | $[0,2b\u22121]$ | $b$ |

RCT | $Ur$ | $[\u22122b+1,2b\u22121]$ | $b+1$ | $Yr$ | $[0,2b\u22121]$ | $b$ | $Vr$ | $[\u22122b+1,2b\u22121]$ | $b+1$ |

RDLS-RCT | $Ur$ | $[\u22122b+1,2b\u22121]$ | $b+1$ | $Yr$ | $[\u22122b\u22121,3\xb72b\u22121\u22122]$ | $b+1$ | $Vr$ | $[\u22122b+1,2b\u22121]$ | $b+1$ |

YCoCg-R | $Co$ | $[\u22122b+1,2b\u22121]$ | $b+1$ | $Y$ | $[0,2b\u22121]$ | $b$ | $Cg$ | $[\u22122b+1,2b\u22121]$ | $b+1$ |

RDLS-YCoCg-R | $Co$ | $[\u22122b+1,2b\u22121]$ | $b+1$ | $Y$ | $[\u22123\xb72b\u22122,7\xb72b\u22122\u22122]$ | $b+2$ | $Cg$ | $[\u22123\xb72b\u22121+2,3\xb72b\u22121\u22121]$ | $b+2$ |

RDgDb | $R$ | $[0,2b\u22121]$ | $b$ | $Dg$ | $[\u22122b+1,2b\u22121]$ | $b+1$ | $Db$ | $[\u22122b+1,2b\u22121]$ | $b+1$ |

RDLS-RDgDb | $R$ | $[0,2b\u22121]$ | $b$ | $Dg$ | $[\u22122b+1,2b\u22121]$ | $b+1$ | $Db$ | $[\u22122b+1,2b\u22121]$ | $b+1$ |

LDgEb | $L$ | $[0,2b\u22121]$ | $b$ | $Dg$ | $[\u22122b+1,2b\u22121]$ | $b+1$ | $Eb$ | $[\u22122b+1,2b\u22121]$ | $b+1$ |

RDLS-LDgEb | $L$ | $[\u22122b\u22121+1,3\xb72b\u22121\u22121]$ | $b+1$ | $Dg$ | $[\u22122b+1,2b\u22121]$ | $b+1$ | $Eb$ | $[\u22123\xb72b\u22121+1,3\xb72b\u22121\u22122]$ | $b+2$ |

Table 1 also presents dynamic ranges and bit-depths of components of all transforms investigated in this study. As opposed to RDLS-RDgDb, some components of RDLS-RCT ($Yr$), RDLS-YCoCg-R ($Y$ and $Cg$), and RDLS-LDgEb ($L$ and $Eb$) may require greater bit-depths than their non-RDLS counterparts. In such cases, the range of the non-RDLS transformed component is placed approximately in the center of the corresponding RDLS transformed component range. The dynamic range expansion with respect to the non-RDLS transform is the greatest for the RDLS-YCoCg-R transform, which needs 2 bits more than YCoCg-R for encoding the $Y$ component.

In this section, using the RDLS-RCT as an example, we demonstrate how an RDLS-modified transform processes an image and how the transform reversibility is maintained despite involving the inherently irreversible denoising. Next, we present sample effects that RDLS may have on the transformed components.

The diagram in Fig. 1 presents operations performed by consecutive steps of forward and inverse RDLS-RCT. Effects of these operations on components of a sample noisy image are presented in Fig. 2; letters surrounded by dashed lines in Fig. 1 denote the panels in Fig. 2 that contain the current appearance of the component. In this example, we use the same denoising filter in all transform steps for all components requiring denoising and employ the step-by-step regime.

**F1 :**

Example of forward and inverse RDLS-RCT. $\u2211$, weighted arithmetic mean of components; $d$, denoising of a component; dashed lines surround labels of Fig. 2 panels with the transformed component of a sample image.

**F2 :**

Effects of RCT and RDLS-RCT on components of a noisy image. (a–c) Untransformed components of the original image, (d–f) temporary denoised components created while computing RDLS-RCT, (g–i) RDLS-RCT transformed components, and (j–l) RCT transformed components; image sizes are $74\xd771\u2009\u2009pixels$, transformed components are presented normalized to the dynamic range of original ones, for denoising the median filter with $3\xd73\u2009\u2009pixels$ window was used; H0_pMED, estimated bitrate of the component (see Sec. 2.7).

Step 1 of forward RDLS-RCT applied to all image pixels transforms $C1$, $C2$, and $C3$ components of the untransformed image (i.e., $R$, $G$, and $B$ primary color components, respectively) by modifying only the $C1$ component. The latter is modified by subtracting from it the temporarily created component obtained by denoising of the $C2$ component. In step 2, we modify in an analogical way the $C3$ component. Step 3 ($C2\u2190C2+\u230a(C1d+C3d)/4\u230b$) is more complicated. For brevity in Fig. 1, we ignore computing of the floor. In this step, we add to the $C2$ component the quarter of the sum of the temporary denoised components $C1$ and $C3$, which are obtained based on the components already transformed in earlier steps. To $C2$ of each pixel, we add the quarter of the sum of the temporary denoised components $C1$ and $C3$ of the same pixel. After step 3, we have the RDLS-RCT transformed $C1$, $C2$, and $C3$ components, i.e., $Ur$, $Yr$, and $Vr$, respectively.

Inverse transform simply applies inverses of the forward transform steps in a reversed order. Step 1 of the inverse transform ($C2\u2190C2\u2212\u230a(C1+C3)/4\u230b$) is an inverse of the forward step 3. These two steps modify the $C2$ component only. Other components are not changed by them but are used in a read-only manner to obtain temporary denoised components. Thus, components $C1$ and $C3$ before inverse transform step 1 are exactly the same as before forward step 3. Inverse transform step 1 subtracts from $C2$ the quarter of the sum of the denoised components $C1$ and $C3$—subtracts from $C2$ of each pixel exactly the same value that was added to it in forward step 3. The reversibility is maintained because, based on the same $C1$ and $C3$ as in forward step 3, we obtained the same temporary denoised components. Therefore, the denoising filter must be deterministic but does not have to be reversible, or invertible; we perform “forward” denoising in both the forward and the inverse RDLS-modified color space transform. In this example, we use the same denoising filter for all the components. However, in a general case, for denoising of a given component in the inverse of a certain forward step, we must use the same denoising filter that was used for this component in the forward step. As a result of inverse step 1, we obtain the untransformed $C2$, i.e., the $G$ primary color component, that is then used in inverse transform steps 2 and 3 to obtain the temporary denoised untransformed $C2$. The latter was in forward transform subtracted from the untransformed $C1$ and $C3$; in inverse transform, we add it to the transformed $C3$ and $C1$, reconstructing the untransformed $C3$ and $C1$—the primary color components $B$ and $R$.

In Fig. 2, we compare effects of RCT and RDLS-RCT for a noisy image. Components of an original untransformed image [Figs. 2(a)–2(c)] are contaminated with impulse noise (10% of white pixels were replaced by black ones). Impulse noise is not a typical distortion found in real-life images; we use it because it is easy to observe and, in most cases, may be efficiently removed by using a simple median denoising filter. Hence, in this example, for denoising, within all RDLS steps of RDLS-RCT we employ the median denoising filter with $3\xd73\u2009\u2009pixels$ window. This filter may fail to remove noise from components of our image, or introduce distortions, only at the edges between areas of different brightness [in Fig. 2, compare panels (d), (e), and (f) with (g), (b), and (i), respectively]. Figure 2 also reports the component bit-depths and bitrates of a lossless image compression algorithm (estimated using the H0_pMED estimator, which is described in Sec. 2.7).

Looking at the effects of RCT [Figs. 2(j)–2(l)], we see that the transformed components contain noise from all the components used to calculate them. When we compress these components independently, then we encode the information on noise from the untransformed components twice (noise from the $C1$ and $C3$ components) or three times (noise from $C2$). The most pronounced effect of RDLS [Figs. 2(g)–2(i)] is that the transformed components contain noise only from their untransformed counterparts.

A more subtle difference between RDLS-based and lifting-based transform effects may be noticed for components that, during transform, are modified based on themselves. For example, the component $C2$ in step 3 is modified based on components $C1$ and $C3$ that have already been modified based on $C2$ in earlier steps 1 and 2, respectively. Basically, step 3 of the lifting-based RCT transform makes $C2$ contain a weighted arithmetic mean of the untransformed $C1$, $C2$, and $C3$ components. Therefore, it decreases in $C2$ the amplitude of the signal originally present in this component, that is, of both the ideal noise-free image and noise contaminating it. On the other hand, assuming the perfect denoising, the RDLS modifies a component based only on the ideal noise-free images contained in other components. Thus, the ideal noise-free image is transformed differently than noise. The former is transformed as in a regular lifting-based transform, while the latter does not get propagated to other components and cannot be “weighted” using its copy from other components. The RDLS-RCT transformed $C2$ contains a weighted arithmetic mean of ideal noise-free images from the $C1$, $C2$, and $C3$ components and unmodified noise originally present in $C2$. Therefore, the amplitude of noise from unmodified $C2$ in transformed $C2$ is greater after RDLS-RCT than after RCT. The above effect may be hard to notice on Fig. 2. The pixels affected by noise from untransformed $C2$ appear similarly dark in $C2$ transformed by RCT [Fig. 2(k)] and RDLS-RCT [Fig. 2(h)] because all components in Fig. 2 are presented normalized to the dynamic range of untransformed primary colors, so the actual dynamic range of $C2$ in the case of RDLS-RCT was reduced twice, whereas for RCT, it was not changed.

It is worth noting that the actual denoising is not perfect, which may affect bitrates of RDLS-modified color space transforms. For our example image, the effects of the imperfect denoising we applied are rough edges between areas of different brightness (noticeable in all RDLS-RCT transformed components) and additional noisy pixels in transformed $C2$ (of intensity different to pixels that were noisy in untransformed $C2$).

The estimated bitrates of RDLS-RCT components are significantly lower than bitrates of RCT components. Interestingly, bitrates of untransformed components are even better, which suggests that for some images, the untransformed components should be compressed. In the next section, we propose a special case of a denoising filter for RDLS, which may result in skipping of the RDLS-modified color space transform.

For denoising, we employed simple low-pass linear averaging filters (smoothing filters) with $3\xd73\u2009\u2009pixels$ windows; these filters were previously found effective for RDLS-RDgDb, RDLS-LDgEb, and RDLS-RCT.^{3}^{,}^{10} The filtered pixel component $Cnd$ was calculated as a weighted arithmetic mean of the $Cn$ components of pixels from the window. The weight of the window center point varied for different filters, while its neighbors’ weights were fixed to 1. We tested 11 smoothing filters with window center point weights from 1 to 1024 (integer powers of 2 only).

The filter set contains the none filter for which $Cnd=Cn$. The none filter turns RDLS into a regular lifting step if it is applied to all arguments of function f [see Eqs. (5) and (6)]. The heuristic we employ for an image-adaptive filter selection (see the next section) requires this filter to be present in the filter set.

We also used the null special filter case, for which $Cnd=0$. For the examined RDLS-modified color space transforms, the null filter may result in step skipping. If it is applied to all arguments of function f, then RDLS becomes $Cx\u2190Cx$ or $Cx\u2190\u2212Cx$ and negating the image component does not change its entropy and has virtually no effect on its compression ratio.

It is noteworthy that the none and null filters may turn the RDLS-modified transform into a lifting transform or cause skipping it as a whole or partially—because different filters may be selected for different steps by the filter selection heuristic we employ. On the other hand, the specific RDLS may be only partially affected if its function f has more than one argument.

We used a simple and greedy denoising filter selection heuristic based on one applied in Ref. ^{11} for the RDLS-modified DWT transform. It consists of the below described steps: A and B.

- Transform the image using the none filter in all steps for all arguments of function f. Store the estimated bitrates of the transformed components and, for each component in each step, assign the none filter.
- In each transform step $s$ (starting from step 1) for each function f argument $Cn$ (analyzed in the $C1,\u2026,C3$ order), try to find a better denoising filter by checking for each filter (except for the one already selected), the overall estimated bitrate obtained by using in step $s$ this filter for denoising of component $Cn$ for all image pixels, while the filters selected so far are used for other components and in other steps.

Step B of the heuristic may be repeated for a given number of iterations. This step of the heuristic in each RDLS-modified forward transform step for each component requiring denoising greedily selects the denoising filter to be applied to all image pixels. For example, in step 3 of forward RDLS-RCT [Eq. (9)], first, a filter for $C1$ is selected for denoising of all the image pixels and then a filter for $C3$ is also selected for all pixels.

To obtain the estimated overall image bitrate after changing a filter, it may be sufficient to estimate bitrates of some components only—depending on the transform and the step, the changing of a denoising filter may not affect all components. Table 2 presents computational time complexities of the filter selection heuristic that take into account the above-mentioned property. Complexities are, for the investigated RDLS-modified transforms, expressed using the cost of operations on a single image component. For comparison, the complexities of compression using these transforms with the already selected filters and compression with the non-RDLS transforms are also reported. We assumed that all image pixels are used in bitrate estimation. Using for this purpose only some of the pixels allows lowering the complexity, which is discussed in the next section.

Transform | Heuristic | Compression (RDLS transform) | Compression (non-RDLS transform) |
---|---|---|---|

RDLS-RCT | $6h(f\u22121)(ce+cl+cd)+3ce+3cl$ | $3cc+3cl+4cd$ | $3cc+3cl$ |

RDLS-YCoCg-R | $8h(f\u22121)(ce+cl+cd)+3ce+3cl$ | $3cc+3cl+4cd$ | $3cc+3cl$ |

RDLS-RDgDb | $2h(f\u22121)(ce+cl+cd)+3ce+2cl$ | $3cc+2cl+2cd$ | $3cc+2cl$ |

RDLS-LDgEb | $6h(f\u22121)(ce+cl+cd)+3ce+3cl$ | $3cc+3cl+3cd$ | $3cc+3cl$ |

These estimations are rough, among others because the complexity of denoising may differ significantly for different filters and because different lifting steps are not equally complex (we took into account that step 3 of forward RDgDb is done at no cost and that no actual denoising is applied in step A of the heuristic). However, they allow making certain general observations. The complexity of the heuristic depends linearly on the number of iterations of step B, the number of filters, and on complexities of bitrate estimation, lifting, and denoising. It also depends on the RDLS-modified transform it selects filters for; it is the smallest for RDLS-RDgDb, whereas for others, it is about three (for RDLS-RCT and RDLS-LDgEb) or four (RDLS-YCoCg-R) times greater.

Assuming the perfect bitrate estimation, the step-by-step regime, and that for denoising of $Cn$ of a specific pixel only $Cn$ of this and of other pixels are used, the results obtained after a single iteration of step B of the heuristic are optimal in the case of the RDLS-RDgDb transform. In this transform, a component modified in a given step is modified based on only one other component and is not used in the next steps. Therefore, the filter selected for this step affects the bitrate of the component modified by it only.

The selected filters have to be passed to the decoder along with the compressed data. In this research, we initially used up to 13 filters (described in Sec. 2.5) and from two to four filters must be selected for an image depending on the applied transform. The cost of encoding the filter selection using a fixed-length binary code is at most 20 bits per image—it is negligible.

As the primary estimator of the image component compression effects, denoted H0_pMED, we used the memoryless entropy of the component residual image, i.e., of a single-component image consisting of prediction errors calculated as differences between actual and predicted component pixels. The bitrate of the three-component image was estimated as a sum of the estimated bitrates of its three components. The memoryless entropy of a single-component image (a residual image in this case) is $H0=\u2212\u2211i=0N\u22121pi\u2009log2\u2009pi$, where $N$ is the alphabet size and $pi$ is the probability of occurrence of pixel value $i$ in the image. For prediction, we used the nonlinear edge-detecting predictor MED [Eq. (13)],^{9} which originates from the median adaptive prediction coding of video data:^{13}^{,}^{14}

We also examined limited-complexity estimation methods, where for each transformed image component, instead of entropy of prediction errors of all the pixels, we used:

- the memoryless entropy of 10,000 pseudorandomly selected pixels’ component prediction errors, this estimator is denoted H0_pMED(10k:1), and
- the memoryless entropy of 10,000 component prediction errors from 100 pseudorandomly selected nonoverlapping $10\xd710\u2009\u2009pixels$ rectangles, denoted H0_pMED(10k:100).

For the selection of pixels in H0_pMED(10k:1) and H0_pMED(10k:100), we reinitialized the pseudorandom number generator each time the image component bitrate was estimated. Thus, from all components of an image, in all steps and iterations of the heuristic, the same pixels were used for estimation.

H0_pMED(10k:1) was found by Strutz to be a sufficient estimator for a close to the optimum color space transform selection.^{5} For typical image sizes, compared to using for all image pixels, a simpler predictor or to computing the entropy of the image component instead of the component prediction error, it allows a greater reduction of the computational time complexity of the compression effects estimation for the lifting-based transforms.^{15} Computing H0_pMED(10k:1) for the three-component image transformed with non-RDLS transform is of low complexity; in order to obtain 30,000 component prediction errors (10,000 in each component), we have to transform 40,000 pixels and compute the MED predictor 30,000 times, whereas the smallest image used in this study contained 262,144 pixels. In the case of the RDLS-modified transform, however, there appears the large extra cost of denoising operations necessary to obtain the prediction errors of individual pixels; denoising operations are the most important factor of the complexity of the heuristic employing H0_pMED(10k:1).

For example, 72 pixel components must be denoised in order to obtain the prediction errors of the single pixel components computed by RDLS-YCoCg-R, which was calculated as follows. We assumed that neighborhoods of individual pixels whose prediction errors are selected for bitrate estimation are not overlapping or an accidental overlapping is not exploited to reduce the estimation cost and that we use denoising filters with $3\xd73\u2009\u2009pixels$ windows. To obtain the MED prediction error of a transformed $C2$ component of a pixel, which is computed in step 3 of RDLS-YCoCg-R [Eq. (10)], we need $C2$ of this pixel and of its neighbors (upper, left-hand, and upper-left)—a $2\xd72$ pixels rectangle area; these pixels are computed in step 3 based on a $2\xd72\u2009\u2009pixels$ rectangle of $C3d$ components (requiring four denoising operations). To obtain a $2\xd72\u2009\u2009pixels$ rectangle of $C3d$ components, we use a $4\xd74\u2009\u2009pixels$ rectangle of transformed $C3$ components that are computed in step 2. In step 2, to obtain a $4\xd74\u2009\u2009pixels$ rectangle of $C3$, we use $4\xd74\u2009\u2009pixels$ rectangles of $C1d$ and $C2d$ (32 denoisings); $C2$ in this step is an untransformed $G$ primary color component, but $C1$ is computed in step 1. To obtain a $4\xd74\u2009\u2009pixels$ rectangle of $C1d$, we need a $6\xd76\u2009\u2009pixels$ rectangle of transformed $C1$, that, in step 1, is computed using a $6\xd76\u2009\u2009pixels$ rectangle of $C3d$ (36 denoisings). While computing the $C2$ prediction error, we obtained data sufficient for computing prediction errors of the remaining components. All in all, we have to perform the pixel’s component denoising 72 times per pixel and 720,000 times to get the H0_pMED(10k:1) estimation of the image compression ratio.

For RDLS-YCoCg-R and the smallest images used in this research, the number of denoising operations required by H0_pMED(10k:1) is not much smaller compared to H0_pMED, which requires four denoising operations per image pixel. To reduce the estimation cost, we proposed the H0_pMED(10k:100) estimator that requires 68,400 denoising operations to obtain the bitrate estimation of an RDLS-YCoCg-R transformed image (assuming the $3\xd73\u2009\u2009pixels$ window of denoising filter and that the neighborhoods of the $10\xd710\u2009\u2009pixels$ rectangles selected for bitrate estimation are not overlapping or that an accidental overlapping is not exploited to reduce the estimation cost).

As already noted, the heuristic does not require performing all of the transform steps after each filter change and not all components’ bitrates must be estimated each time an overall image bitrate is estimated, which allows certain optimizations. Taking them into account, we present in Table 3 the cost of the heuristic for various RDLS-modified transforms, expressed as a number of denoisings of a component of a single pixel. The cost is calculated assuming that in step A of the heuristic, no actual denoising is used, but each time we estimate the bitrate in step B, we do it as if all filters used a $3\xd73\u2009\u2009pixels$ window. In the cases when the heuristic cost for H0_pMED(10k:1) is the highest (i.e., for RDLS-YCoCg-R and RDLS-LDgEb), employing H0_pMED(10k:100) decreases it over eight times.

Transform | Heuristic cost | Transform cost | ||
---|---|---|---|---|

H0_pMED | H0_pMED(10k:1) | H0_pMED(10k:100) | ||

RDLS-RCT | $6t(f\u22121)h$ | $480000(f\u22121)h$ | $82200(f\u22121)h$ | $4\u2009\u2009t$ |

RDLS-YCoCg-R | $8t(f\u22121)h$ | $1000000(f\u22121)h$ | $121600(f\u22121)h$ | $4\u2009\u2009t$ |

RDLS-RDgDb | $2t(f\u22121)h$ | $80000(f\u22121)h$ | $24200(f\u22121)h$ | $2\u2009\u2009t$ |

RDLS-LDgEb | $6t(f\u22121)h$ | $800000(f\u22121)h$ | $92600(f\u22121)h$ | $3\u2009\u2009t$ |

We also note that the filtering operation may be optimized. For example, computing the smoothing filter with a $3\xd73\u2009\u2009pixels$ window and center point weight 1 for an individual pixel [which is needed for the H0_pMED(10k:1) estimator] requires nine arithmetic operations; for pixels inside a contiguous rectangular area [for H0_pMED and H0_pMED(10k:100)], the cost of this filter drops to five arithmetic operations. Having computed the smoothing filter with a certain center point weight, computing it for some other weight requires just three arithmetic operations.

- Waterloo—a set of eight color images from the University of Waterloo, image sizes range from $512\xd7512$ to $1118\xd71105\u2009\u2009pixels$;
^{16} - Kodak—a set of 23 images released by the Kodak corporation, all images are of size $768\xd7512\u2009\u2009pixels$;
^{17} - EPFL—a set of 10 images used at the École polytechnique fédérale de Lausanne for subjective JPEG XR quality evaluation,
^{18}images sizes: $1280\xd71506$ to $1280\xd71600\u2009\u2009pixels$;^{19} - A1—a set of three large images scanned from a 36-mm high quality diapositive film, image sizes range from $7376\xd74832$ to $7424\xd74864\u2009\u2009pixels$;
^{20} - A2—a set of 17 images acquired from 36 mm negatives, image sizes are from $1620\xd71128$ to $1740\xd71164\u2009\u2009pixels$;
^{20} - A3—a set of 116 images acquired using a camera equipped with a Bayer-pattern RGGB color filter array, all images are of size $1992\xd71493\u2009\u2009pixels$;
^{20} - A1-red.3, A2-red.3, and A3-red.3—sets of reduced size ($3\xd7$) images from sets A1, A2, and A3, respectively.

The sets A1, A2, and A3 contain unprocessed photographic images in optical resolutions of acquisition devices, or (A3) as close to such resolution as possible without interpolation of all components. Except for Waterloo, all images may be characterized as continuous-tone photographic. The most widely known Waterloo set contains both photographic and artificial images; some of them are dithered, sharpened, computer-generated, composed of others, or have globally or locally highly sparse histograms of intensity levels.^{21}^{,}^{22} The same image sets were used for experiments in Ref. ^{3}, where their more detailed characteristics may be found.

RDLS effects on bitrates were analyzed for three significantly different standard image compression algorithms in the lossless mode: the predictive JPEG-LS,^{6}^{,}^{9} the DWT-based JPEG 2000,^{7}^{,}^{23} and the JPEG XR employing the discrete cosine transform.^{8}^{,}^{24}^{,}^{25} We used the Signal Processing and Multimedia Group, Univ. of British Columbia JPEG-LS implementation, version 2.2,^{26} the JasPer implementation of JPEG 2000 by M. Adams, version 1.900,^{27}^{,}^{28} and the JPEG XR reference software.^{29}

All algorithms were used to compress individual transformed components, one component at a time. Due to requirements of employed file formats and implementations, all components were stored using non-negative integers. Components transformed with the lifting transforms were stored using the nominal component bit-depths. See Table 1 for nominal depths of components of all the examined, lifting-based and RDLS-modified transforms. Since in initial tests, the greater nominal depth of the RDLS-modified transform was rarely needed, for these transforms, we used the bit-depth of the lifting counterpart or, only if pixels of an actual transformed image component exceeded this depth, we increased the component bit-depth up to the nominal depth of the RDLS-modified transform component. The implementation used for applying transforms and the heuristic is freely available.^{30} The compression ratio or bitrate $r$, expressed in bits per pixel (bpp), is calculated based on the total size in bytes of the individually and independently compressed three components of the transformed image, including compressed file format headers; smaller $r$ denotes better compression.

In Fig. 3, we present the RDLS effects on the bitrates of individual RDLS-RCT transformed components and on the overall image bitrates of each of the examined transforms. Bitrates for non-RDLS and RDLS-modified transforms, obtained using denoising filters selected based on H0_pMED estimator in three iterations of step B of the heuristic, were averaged for each set. For easier comparison of RDLS effects, in figures we show the bitrate changes due to RDLS expressed as the percentages of the bitrates obtained with a non-RDLS transform, whereas the absolute bitrates of selected variants of transforms are presented in tables. We also report an average for all sets, however, calculated using average of set-averages, not the direct average of all images. The A3 and A3-red.3x sets contain many more images (116 in each) than all other sets (81 images); therefore, a simple average would be biased toward the A3 and A3-red.3x.

**F3 :**

(a–c) Average JPEG 2000 bitrate changes due to RDLS, for the individual RDLS-RCT components, and (d–i) the overall for examined transforms, obtained using denoising filters described in Sec. 2.5 (all, unless indicated otherwise) selected in three iterations of step B of the heuristic based on bitrates estimated with H0_pMED.

Figures 3(a)–3(c) show that for RDLS-RCT, the overall bitrate improvement due to RDLS is, in many cases, a result of improved bitrates of chrominance components and worsened bitrates of luminance. The above is also true for RDLS-YCoCg-R and RDLS-LDgEb (not shown in Fig. 3). The overall three-component improvements for the RDLS-RCT transform [Fig. 3(d)] result from both employing the actual denoising filters [Fig. 3(e)] and the step skipping by applying the null filter to RDLS [Fig. 3(f)]. Looking at the RDLS effects for other transforms [Fig. 3(g)–3(i)], we see that the greatest bitrate improvements of over 2% on average for all sets were obtained for RDLS-RDgDb. For this transform, the improvements for chrominance components are not accompanied by a worsened bitrate of the third component (i.e., the unmodified primary color $R$). Generally, the bitrate improvements due to application of RDLS to a color space transform may significantly differ for different sets and for different transforms in the case of a specific set, but are similar for different compression algorithms. Similarity among compression algorithms is stronger when we do not use the null filter. RDLS effects are less pronounced for the JPEG XR algorithm, especially in the case of Waterloo images.

We examined the RDLS effects on color space transforms using several compression algorithms and test image sets. For brevity, we focus on results of the most popular JPEG 2000 algorithm, averaged for all sets. In Table 4, for various transform variants, we report both the bitrates obtained by the RDLS-modified transforms and the bitrate improvements with respect to the non-RDLS transform. To provide a single measure allowing comparisons of variants, we also report the RDLS bitrate change averaged for all the transforms (column labeled “All”). Employing only the transform step skipping, implemented as a special case of the RDLS [i.e., using a null filter and not using smoothing filters, row “RDLS (no smoothing)”], allows bitrate improvements comparable to those obtained by RDLS with the typical denoising and without the step skipping [row “RDLS (no null)”]—better for RCT and YCoCg-R, worse for RDgDb and LDgEb. Step skipping results are better than results obtained by simply deciding, based on the estimated bitrate, whether to perform unmodified transform or to skip it [row “min(RGB, non-RDLS)”], although for YCoCg-R, the simpler method is better. Finally, employing both the step skipping and typical denoising filters allows significantly larger RDLS bitrate improvements, than those obtained when using only the typical denoising filters (compare the two last rows in Table 4). Compared to the filter selection heuristic from Ref. ^{10} (row “RDLS (Ref. ^{10}, no null)”), for the same filter set, the heuristic we propose in this study results in greater bitrate improvements [row “RDLS (no null)”] and it is of significantly lower complexity in the case of RCT and YCoCg-R.

^{10}, no null), filters selected as in Ref.

^{10}.

Transform variant | RCT | YCoCg-R | RDgDb | LDgEb | All | |||||
---|---|---|---|---|---|---|---|---|---|---|

$r$ | $\Delta r$ | $r$ | $\Delta r$ | $r$ | $\Delta r$ | $r$ | $\Delta r$ | $r$ | $\Delta r$ | |

non-RDLS transform | 11.4374 | 0.00% | 11.4977 | 0.00% | 11.6173 | 0.00% | 11.5039 | 0.00% | 11.5141 | 0.00% |

min(RGB, non-RDLS) | 11.3890 | $\u22120.42%$ | 11.3921 | $\u22120.92%$ | 11.4460 | $\u22121.47%$ | 11.4637 | $\u22120.35%$ | 11.4227 | $\u22120.79%$ |

RDLS (no smoothing) | 11.3452 | $\u22120.81%$ | 11.4174 | $\u22120.70%$ | 11.4067 | $\u22121.81%$ | 11.4113 | $\u22120.81%$ | 11.3951 | $\u22121.03%$ |

RDLS (Ref. ^{10}, no null) | 11.3704 | $\u22120.59%$ | 11.5184 | 0.18% | 11.3333 | $\u22122.44%$ | 11.4640 | $\u22120.35%$ | 11.4215 | $\u22120.80%$ |

RDLS (no null) | 11.3568 | $\u22120.71%$ | 11.4345 | $\u22120.55%$ | 11.3333 | $\u22122.44%$ | 11.4000 | $\u22120.90%$ | 11.3812 | $\u22121.15%$ |

RDLS | 11.3004 | $\u22121.20%$ | 11.3635 | $\u22121.17%$ | 11.2995 | $\u22122.74%$ | 11.3531 | $\u22121.31%$ | 11.3291 | $\u22121.61%$ |

The average level of improvement of over 1% that we obtained for RCT, YCoCg-R, and LDgEb by using all the denoising filters described in Sec. 2.5 selected based on the H0_pMED estimator in three iterations of the heuristic step B is not negligible as for lossless image compression. However, the heuristic cost may be too high for practical applications. Significantly larger improvements were obtained for specific sets and in the case of RDgDb. In the next section, we reduce the heuristic cost without sacrificing most of the bitrate improvements.

For the above variant, we checked the actual bit-depth expansion of the transformed components. For each transform that may result in a component bit depth greater than the non-RDLS counterpart (RDLS-RCT, RDLS-YCoCg-R, and RDLS-LDgEb), such expansion happened for about two thirds of the images in the case of the luminance component, which each time was expanded by 1 bit.

As shown in Sec. 2.6, the heuristic complexity is proportional to the number of iterations of its step B and to the number of denoising filters. Therefore, we investigated decreasing the iterations number and smaller filter sets. For RDLS-RDgDb, a single iteration of heuristic step B results in the optimal filter selection; bitrate improvements due to RDLS obtained for other transforms in 1, 2, and 3 iterations are presented in Fig. 4. In practice, two iterations seem sufficient; the average bitrates for all sets, obtained in two and three iterations, do not differ noticeably and for individual sets only in three cases the bitrate differs by more than 0.1 percentage points (for the A1.red.3 set in the case of RDLS-RCT and RDLS-YCoCg-R and for A1 in the case of the former transform). On the other hand, by using only one iteration, as compared to two iterations, average bitrates for all sets get over 0.1 percentage point worse for RDLS-YCoCg-R and RDLS-LDgEb, whereas for individual sets, one iteration may be worse by over 1 percentage point. Thus, remembering that in the case of RDLS-RDgDb, the single iteration is optimal, we use two iterations as a starting point for testing other options of the complexity reduction.

**F4 :**

Average JPEG 2000 bitrate changes due to RDLS obtained using denoising filters selected in 1, 2, and 3 iterations of the heuristic step B out of all filters described in Sec. 2.5. (a) RDLS-RCT, (b) RDLS-YCoCg-R, and (c) RDLS-LDgEb.

In Table 5, we report the JPEG 2000 bitrate changes for a couple of reduced complexity filter selection variants. As previously, we also report the RDLS bitrate change averaged for all the transforms in the column labeled “All.” Among others, we examined reducing the number of denoising filters by rejecting of some of the smoothing filters. By using filters with center point weights being even powers of 2 in range from 1 to 256 (row labeled “2 iterations, 7 filters, H0_pMED”), instead of integer powers in range from 1 to 1024, we decrease the complexity of the heuristic about two times (as the filter number drops from 13 to 7) at the acceptable cost of a smaller compression ratio improvement by below 0.05 percentage points on average for all transforms. Further reducing the set by using only three smoothing filters (row “2 iterations, 5 filters, H0_pMED”) results in a smaller complexity decrease and a greater cost. Therefore, for the former variant, we applied the simplified compression effect estimation methods.

Filter selection variant | RDLS-RCT | RDLS-YCoCg-R | RDLS-RDgDb | RDLS-LDgEb | All |
---|---|---|---|---|---|

3 iterations, 13 filters, H0_pMED | $\u22121.20%$ | $\u22121.17%$ | $\u22122.74%$ | $\u22121.31%$ | $\u22121.61%$ |

2 iterations, 13 filters, H0_pMED | $\u22121.17%$ | $\u22121.13%$ | $\u22122.74%$ | $\u22121.30%$ | $\u22121.59%$ |

2 iterations, 7 filters, H0_pMED | $\u22121.13%$ | $\u22121.11%$ | $\u22122.68%$ | $\u22121.27%$ | $\u22121.55%$ |

2 iterations, 5 filters, H0_pMED | $\u22121.08%$ | $\u22120.98%$ | $\u22122.57%$ | $\u22121.19%$ | $\u22121.46%$ |

2 iterations, 7 filters, H0_pMED(10k:1) | $\u22121.13%$ | $\u22121.10%$ | $\u22122.68%$ | $\u22121.29%$ | $\u22121.55%$ |

2 iterations, 7 filters, H0_pMED(10k:100) | $\u22121.02%$ | $\u22121.09%$ | $\u22122.65%$ | $\u22121.26%$ | $\u22121.51%$ |

The differences between effects of H0_pMED and H0_pMED(10k:1) estimators are negligible. On average for all transforms, they are below 0.005 percentage points. Interestingly, the case of the RDLS-LDgEb transform the H0_pMED(10k:1) estimator results in a better average bitrate for all sets than H0_pMED (better by 0.02 percentage points). Our results show that the close to the optimum performance of H0_pMED(10k:1), first observed by Strutz for lifting color space transforms, is a more general property of this estimator. Note that by the optimum performance, we mean estimation effects obtained using H0_pMED; in the next section, we check, among others, how good H0_pMED estimation is compared to the actual bitrate of the actual compression algorithm.

The H0_pMED(10k:100) estimator we proposed in order to lower the bitrate estimation cost results in bitrates little worse than H0_pMED(10k:1); on average, for all transforms, it is by 0.04 percentage points worse, for the RDLS-RCT (the worst case) by 0.11 percentage points. The H0_pMED(10k:100) appears to be the most interesting general purpose estimator from a practical standpoint—it allows fast heuristic filter selection that results in bitrates that are close to the bitrates obtained using the most complex variant examined so far (using H0_pMED, three iterations, and all filters described in Sec. 2.5). Compared to the latter, we get bitrates worse by 0.1 percentage points on average for all transforms and sets in the case of the JPEG 2000 coding.

We do not report the actual filter search time of the heuristic or the time of transforming the image with RDLS-modified transforms because our research implementation was not optimized; among others, we did not exploit the possibility of partial estimation of the image bitrate after changing a single filter by the heuristic and each time before outputting a transformed image, the transform reversibility was verified by performing an inverse transform. However, knowing the parameters of the heuristic, its cost may be compared to the cost of the transform it selects filter for. For the smallest images we used (containing 262,144 pixels), with respect to the number of denoising operations (that is to the most expensive part of the heuristic). In Table 6, we report the transform cost and the heuristic cost. The heuristic cost is reported for the H0_pMED(10k:100)-based selection of filters done in two iterations of step B from the set of seven filters using up to $3\xd73\u2009\u2009pixels$ windows. The heuristic cost is generally close to the transform cost. It is by 6% lower in the case of RDLS-RCT, for RDLS-YCoCg-R and RDLS-LDgEb, it is by about 40% higher, and for RDLS-RDgDb, it is two times lower. Note that for the latter transform, we may use only one iteration as it will not affect the filter selection and further decrease the cost two times. For this transform also, the H0_pMED(10k:1) estimator is practically acceptable, as for one iteration of step B, it requires 480,000 denoisings, i.e., 92% of the number of denoisings required by the RDLS-RDgDb transform. For larger images, the cost of the heuristic exploiting H0_pMED(10k:100) or H0_pMED(10k:1) remains constant, whereas the transform cost grows in direct proportion to the number of pixels in the image.

Transform | Heuristic cost | Transform cost |
---|---|---|

RDLS-RCT | 986,400 | 1,048,576 |

RDLS-YCoCg-R | 1,459,200 | 1,048,576 |

RDLS-RDgDb | 288,240 | 524,288 |

RDLS-LDgEb | 1,111,200 | 786,432 |

To verify how the modifications we selected based on the RDLS effects on JPEG 2000 coding affect other algorithms, in Table 7, we report bitrates and bitrate changes obtained for different compression algorithms. Simplifying the estimation method and reducing the size of the filter set and the number of iterations did not change the general way RDLS affects bitrates in the case of different algorithms and color space transforms. RDLS effects for JPEG-LS and JPEG 2000 are close to each other, whereas for the JPEG XR algorithm, the improvements are smaller. The bitrate improvement due to RDLS is the greatest in the case of RDgDb (2.15% for JPEG XR, 2.65% or more for JPEG-LS and JPEG 2000), whereas the bitrates of more complex transforms were improved by over 1% in the case of JPEG-LS and JPEG 2000, and by over 0.5% for JPEG XR. In Fig. 5, the bitrate changes for individual sets are presented and compared to a variant employing H0_pMED estimation, three iterations and a larger set of denoising filters. The greatest differences in effects for these variants may be noticed for RDLS-RCT and RDLS-YCoCg-R in the case of some sets only. In a single case of the former transform for Waterloo images and the JPEG XR algorithm, the simplified filter selection results in about 1.2% worse bitrates than the non-RDLS transform; for this algorithm, images, and transform, the more complex filter selection variant resulted in bitrate worsening (by below 0.1%). For RDLS-RDgDb and RDLS-LDgEb, the results of the simplified filter selection for individual sets are similarly close to effects of the more complex variant as on average for all sets.

Algorithm | RDLS-RCT | RDLS-YCoCg-R | RDLS-RDgDb | RDLS-LDgEb | All | |||||
---|---|---|---|---|---|---|---|---|---|---|

$r$ | $\Delta r$ | $r$ | $\Delta r$ | $r$ | $\Delta r$ | $r$ | $\Delta r$ | $r$ | $\Delta r$ | |

JPEG-LS | 10.8840 | $\u22121.13%$ | 10.9616 | $\u22121.10%$ | 10.8621 | $\u22122.82%$ | 10.9075 | $\u22121.35%$ | 10.9038 | $\u22121.60%$ |

JPEG 2000 | 11.3208 | $\u22121.02%$ | 11.3726 | $\u22121.09%$ | 11.3089 | $\u22122.65%$ | 11.3594 | $\u22121.26%$ | 11.3404 | $\u22121.51%$ |

JPEG XR | 12.4776 | $\u22120.51%$ | 12.5078 | $\u22120.66%$ | 12.4494 | $\u22122.15%$ | 12.5056 | $\u22120.83%$ | 12.4851 | $\u22121.04%$ |

**F5 :**

Average JPEG-LS, JPEG 2000, and JPEG XR bitrate changes due to RDLS with respect to the non-RDLS transform. The denoising filters were selected using the H0_pMED(10k:100) estimator in two iterations of the heuristic step B out of: none, null, and smoothing filters with center point weights 1, 4, 16, 64, and 256, or using H0_pMED in three iterations of the heuristic step B out of all filters described in Sec. 2.5. (a) RDLS-RCT, (b) RDLS-YCoCg-R, (c) RDLS-RDgDb, and (d) RDLS-LDgEb.

Looking at the absolute bitrates (Table 7), we notice that differences between compression algorithms for a specific transform are much larger than differences between transforms for a given algorithm. JPEG-LS is consistently the best, JPEG XR the worst. RDLS-RDgDb obtains the best average bitrates for each algorithm which is an effect of the greatest bitrate improvement due to RDLS. In the case of unmodified transforms (recall Table 4), on average for all sets we used in this research, RCT was the best. The bitrate improvements that we attained at a reduced cost appear worthwhile from a practical standpoint. For example, for the lossless JPEG 2000, the bitrates were improved on average for all sets and all transforms by about 1.5%. This improvement is not small if we consider that the best unmodified transform we evaluated (RCT) obtained an average bitrate better than the worst one (RDgDb) by about 1.2% only.

We started experiments using the H0_pMED estimator that was found effective for a non-RDLS color space transform selection^{5}^{,}^{15} as well as for the selection of denoising filters for some of the RDLS-modified color space transforms investigated in this study.^{3}^{,}^{10} We found that by using H0_pMED(10k:100), the estimation complexity may be significantly reduced without sacrificing the RDLS bitrate improvement. But how far from perfect is the H0_pMED or H0_pMED(10k:100) estimation in the case of the investigated RDLS-modified transforms? To check it, we compared the estimation effects to using in the filter selection heuristic the actual image compression algorithm instead of estimating its results (see top three rows in Table 8). The estimation effects are very good from a practical standpoint. Using the actual compressor results in bitrate improvements better than estimation-based by less than 0.1 percentage point on average for all transforms; the greatest difference is for RDLS-RCT, where the H0_pMED(10k:100)-based bitrate is by 0.2 percentage point worse. Interestingly, for RDLS-YCoCg-R, the use of actual compressor results in bitrates that are worse than estimation-based. Results of the heuristic may not be optimal even when we use the perfect estimation.

Filter selection variant | RDLS-RCT | RDLS-YCoCg-R | RDLS-RDgDb | RDLS-LDgEb | All |
---|---|---|---|---|---|

2 iterations, 7 filters, H0_pMED(10k:100) | $\u22121.02%$ | $\u22121.09%$ | $\u22122.65%$ | $\u22121.26%$ | $\u22121.51%$ |

2 iterations, 7 filters, H0_pMED | $\u22121.13%$ | $\u22121.11%$ | $\u22122.68%$ | $\u22121.27%$ | $\u22121.55%$ |

2 iterations, 7 filters, $r_JPEG_2000$ | $\u22121.22%$ | $\u22121.06%$ | $\u22122.72%$ | $\u22121.35%$ | $\u22121.59%$ |

exhaustive, 7 filters, $r_JPEG_2000$ | $\u22121.32%$ | $\u22121.48%$ | $\u22122.72%$ | $\u22121.39%$ | $\u22121.73%$ |

The heuristic finds optimal filters for the RDLS-RDgDb transform and for this transform, we obtained the greatest bitrate improvement with respect to the non-RDLS transform. Should the RDLS effects on RDgDb be attributed to the imperfect heuristic filter selection in the case of more complex transforms, or is RDLS the most effective for the simplest transform also when for all transforms we employ optimal filters? We performed the exhaustive filter search and selected for each image and transform the optimal filters out of the set of seven denoising filters. For seven filters, such a search is impractical but realizable, as for the most complex transforms, RDLS-RCT and RDLS-YCoCg-R, it involves testing 2401 filter combinations per image. In Table 8 (row labeled “exhaustive,…”) we report the effects of the RDLS-modified transforms for the optimal filter selection based on the actual JPEG 2000 compression bitrate. Let us compare the effects of the heuristic when employing two iterations of step B and actual compression instead of bitrate estimation, to optimal filter selection. The effects of the heuristic significantly vary for different transforms. Indeed, for RDLS-RDgDb, the heuristic filter selection is optimal. For the RDLS-RCT and RDLS-LDgEb, the heuristic is by 0.1 and 0.04 percentage points, respectively, worse than the optimum. However, for RDLS-YCoCg-R, the heuristic result is worse by about 1/4 than the bitrate improvement obtainable for this transform with optimal filter selection. A heuristic based on a different filter search strategy might be better in the case of RDLS-YCoCg-R. Also in the case of the optimal filter selection for all transforms, the largest improvement due to RDLS is for RDgDb—also for the optimal filter selection, RDLS is the most effective for RDgDb.

RDLS recently was found effective for a transform that is much more complex then a color space transform and involves more interdependent steps, i.e., for the multilevel 2-D DWT transform in lossless JPEG 2000 compression.^{11} The bitrate improvements exceeding 13% were observed for grayscale images of nonphotographic content when the nonlinear denoising filters were applied. We checked if those filters could be used to further improve the effects of the RDLS-modified color space transforms. We tested all the additional filters from Ref. ^{11} that were not already used in this study:

- Smoothing filters, with $5\xd75\u2009\u2009pixels$ windows, employing the same weights of the window center point, as before (11 filters).
- Median—two median filters ($3\xd73$ and $5\xd75\u2009\u2009pixels$ windows), the median $5\xd75\u2009\u2009pixels$ filter was the strongest (the most harsh) filter used in Ref.
^{11}and it was found the most effective in the bitrate improvement. - RCRS-1—two filters ($3\xd73$ and $5\xd75\u2009\u2009pixels$ windows), which belong to a general family of rank-conditioned rank selection (RCRS) filters.
^{31}RCRS-1 filters replace a sample with the window median if the sample is greater than or smaller than all other samples in the window. - RCRS-2—two filters ($3\xd73$ and $5\xd75\u2009\u2009pixels$ windows) that replace a sample with the second greatest window sample value if the sample is greater than the median and the greatest; or, if it is smaller than the median and the smallest, they replace a sample with the second smallest window sample value.

Since only the Waterloo set contains nonphotographic images, in Table 9, we report the effects of extending the filter set for RDLS-modified color space transforms with the above filters for both the Waterloo set and average for all the sets. Unfortunately, such a naive approach did not result in practically useful bitrate improvements, especially if we consider the increased complexity of selecting the filters from the set of 30 denoising filters containing filters with larger windows.

Filters | Sets | RDLS-RCT | RDLS-YCoCg-R | RDLS-RDgDb | RDLS-LDgEb | All |
---|---|---|---|---|---|---|

13 | All sets | $\u22121.20%$ | $\u22121.17%$ | $\u22122.74%$ | $\u22121.31%$ | $\u22121.61%$ |

30 | All sets | $\u22121.22%$ | $\u22121.23%$ | $\u22122.78%$ | $\u22121.34%$ | $\u22121.65%$ |

13 | Waterloo only | $\u22121.07%$ | $\u22121.04%$ | $\u22120.81%$ | $\u22121.33%$ | $\u22121.06%$ |

30 | Waterloo only | $\u22121.08%$ | $\u22121.03%$ | $\u22120.83%$ | $\u22121.34%$ | $\u22121.07%$ |

RDLS improvements differ for various sets, thus it could be expected that by finding filters better matching the actual image characteristics, greater bitrate improvements due to RDLS could be obtained. Instead of basing on an estimated component bitrate, the noise parameters might be estimated and the denoising filters might be selected based directly on the analysis of the component to be denoised. For a specific acquisition device, the device model may be constructed that allows determining the denoising filters based directly on the acquisition process parameters (e.g., see Refs. ^{32} and ^{33}). The former approach has an additional advantage. The component that is available as the function f argument for filters selection in RDLS in forward transform [Eq. (6)], is also available for inverse RDLS in inverse transform [Eq. (7)]. Signaling the filter selection (or parameters of a more sophisticated filter) to the decoder might be avoided at the cost of increased decoder complexity, as the same filters, or filter parameters, can be found by the decoder based on analysis of the same data. On the other hand, in Ref. ^{10}, we used a heuristic that performed an exhaustive search of filters in a given step based on the estimated bitrate of the component modified by this step only and in the case of RDLS-RCT and RDLS-LDgEb, it resulted in significant worsening of bitrates of some images. Therefore, it may be expected that selecting a filter for the data to be denoised based on this data may be effective for the simplest RDLS-RDgDb transform and not necessarily for others, which is an interesting topic that we leave for future research.

In this study, we examined the application of RDLS to the RCT, YCoCg-R, RDgDb, and LDgEb color space transforms; the RDLS-modified transforms are named RDLS-RCT, RDLS-YCoCg-R, RDLS-RDgDb, and RDLS-LDgEb, respectively. For the image-adaptive denoising filter selection, we proposed a simple and greedy heuristic consisting of steps A and B, where step B may be performed for a given number of iterations. In the heuristic, we used compression algorithm independent estimators of the filter selection effects on the transformed image bitrate. Initially, we used an estimator based on the memoryless entropy of the transformed image MED prediction errors of all pixels of each component (H0_pMED). We also employed a simplified, limited computational time complexity estimator that uses 10,000 pseudorandomly selected pixels [H0_pMED(10k:1)]. To further decrease the complexity of bitrate estimation, we proposed the H0_pMED(10k:100) estimator that also uses 10,000 pixels, but due to grouping them, in the case of the most complex RDLS-modified color space transforms, its complexity is over eight times lower compared to the H0_pMED(10k:1). Beside typical denoising filters (11 linear smoothing filters with $3\xd73\u2009\u2009pixels$ windows) and the none filter, that may turn RDLS into the regular lifting step, we proposed the special filter case named the null filter. For the null filter, the denoised sample equals 0, which may result in the step skipping. In the experiments, we used several test image sets and significantly different standard image compression algorithms in the lossless mode: JPEG-LS, JPEG 2000, and JPEG XR.

We found that generally, the RDLS effects significantly differ for different image sets and for different transforms in the case of a specific set. They are similar for different compression algorithms, but they are less pronounced in the case of the JPEG XR algorithm. The largest average bitrate improvements were obtained for the simplest transform RDLS-RDgDb and improvements for others were roughly two times smaller. The overall bitrate improvements due to RDLS result from employing of both the actual denoising filters and the null filter. Although a certain level of bitrate improvement might be obtained by simply checking the estimated effects of skipping the entire color space transform, greater improvements were obtained by employing the null filter that may result in a partial transform skipping. The initial number of smoothing filters could be reduced without sacrificing the bitrate improvements. Assuming the perfect bitrate estimation, due to properties of RDLS-RDgDb, the proposed heuristic in one iteration of step B finds optimal filters for this transform. For other transforms, performing two iterations of step B is justified as using more iterations does not improve RDLS effects noticeably.

The most expensive element of the computational time complexity of the heuristic is the denoising of pixel components. This cost may be limited and reduced by employing simplified compression effect estimators. When using the H0_pMED(10k:100) estimator, the heuristic cost (for two iterations of its step B and seven denoising filters) gets close to the transform cost for RDLS-RCT, RDLS-YCoCg-R, and RDLS-LDgEb transforms. The heuristic cost for RDLS-RDgDb is four times lower than the transform cost (here, one iteration suffices) and for this transform, the cost of the more expensive H0_pMED(10k:1) estimator is still lower than the transform cost. For larger images, the cost of the heuristic exploiting H0_pMED(10k:100) or H0_pMED(10k:1) remains constant, whereas the transform cost (and the cost of the heuristic exploiting H0_pMED) grows in direct proportion to the number of pixels in the image. The H0_pMED(10k:100)-based heuristic filter selection results in at least about three fourths of the bitrate improvement obtainable with RDLS for the optimal filter selection based on the actual bitrate of the compression algorithm.

All in all, the most interesting results from a practical standpoint were obtained for an image-adaptive heuristic filter selection from the set of seven filters (none, null, and smoothing with center point weights 1, 4, 16, 64, and 256) using the simplified estimator of compression effects H0_pMED(10k:100), which is independent of the actually employed compression algorithm. On average, the bitrate improvement due to RDLS is the greatest in the case of RDLS-RDgDb (2.65% or more for JPEG-LS and JPEG 2000, 2.15% for JPEG XR), while the bitrates of more complex transforms were improved by over 1% in the case of JPEG-LS and JPEG 2000, and by over 0.5% for JPEG XR. For some sets, the improvements due to RDLS-RDgDb exceed 5%. Also, with respect to the absolute bitrate, this transform was the best for all the image compression algorithms investigated in this study. In addition to the better average bitrates and bitrate improvements as well as the lower filter selection cost, another advantage of this transform is that its dynamic range is not increased compared to the non-RDLS counterpart.

We suppose that by finding filters better matching the actual image characteristics greater bitrate improvements due to RDLS could be obtained. For a given acquisition device, the denoising filters may probably be selected based on the acquisition process parameters rather than by using the heuristic employing estimated compression ratio of the denoised component. For RDLS-RDgDb, they may be selected or constructed directly based on the component being denoised, thus avoiding the need to signal to the decoder the filter selection.

RDLS applied to color space transforms allows the improvement of the bitrates of lossless image compression algorithms, however, RDLS effects depend on selecting proper denoising filters for the image being compressed. By exploiting the new contributions of this study, i.e., the filter-selection heuristic and the special filter case (the null filter), we attained bitrate improvements that on average are about two times higher than those obtained using the previously reported methods. Another new contribution, the H0_pMED(10k:100) compression effect estimator, reduced the cost of the filter selection process without sacrificing the majority of the bitrate improvement. The filter selection cost gets this way close to or lower than the transform cost, while on average for all the investigated transforms and images, the lossless JPEG 2000 bitrates are improved by about 1.5%; bitrates of certain images are improved to a significantly greater extent. All in all, the RDLS-modified color space transforms appear worthwhile from a practical standpoint.

This work was supported by the BK-219/RAU2/2016 grant from the Institute of Informatics, Silesian University of Technology and by the 02/020/RGH15/0060 grant from the Silesian University of Technology. A patent application on the RDLS-modified color space transforms presented in this work was filed to the Polish Patent Office (application number: P.396766).

## References

**Malvar H. S.,**,

**Sullivan G. J.,**and

**Srinivasan S.**, “Lifting-based reversible color transformations for image compression,” Proc. SPIE. 7073, , 707307 (2008). 0277-786X

**CrossRef**

**Sweldens W.**, “The lifting scheme: a custom-design construction of biorthogonal wavelets,” Appl. Comput. Harmonic Anal.. 3, , 186 –200 (1996). 1063-5203

**CrossRef**

**Starosolski R.**, “Reversible denoising and lifting based color component transformation for lossless image compression,” arXiv:1508.06106 [cs.MM],

**http://arxiv.org/abs/1508.06106**(2016) (Submitted).

**Starosolski R.**, “New simple and efficient color space transformations for lossless image compression,” J. Vis. Commun. Image Represent.. 25, (5 ), 1056 –1063 (2014). 1047-3203

**CrossRef**

**Strutz T.**, “Multiplierless reversible colour transforms and their automatic selection for image data compression,” IEEE Trans. Circ. Syst. Video Technol.. 23, (7 ), 1249 –1259 (2013). 1051-8215

**CrossRef**

**Weinberger M. J.,**,

**Seroussi G.,**and

**Sapiro G.**, “The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS,” IEEE Trans. Image Process.. 9, (8 ), 1309 –1324 (2000).

**CrossRef**

**Starosolski R.**, “Application of reversible denoising and lifting steps to LDgEb and RCT color space transforms for improved lossless compression,” in Proc. BDAS 2016, Springer CCIS , Vol. 613, pp. 623 –632 (2016).

**CrossRef**

**Starosolski R.**, “Application of reversible denoising and lifting steps to DWT in lossless JPEG 2000 for improved bitrates,” Signal Process. Image Commun.. 39, , 249 –263 (2015). 0923-5965

**CrossRef**

**Malvar H. S.,**and

**Sullivan G. J.**, “YCoCg-R: a color space with RGB reversibility and low dynamic range,” ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6 Document JVT-I014r3 (2003).

**Murakami H.,**,

**Matsumoto S.,**,

**Hatori Y.,**and

**Yamamoto H.**, “15/30 Mbit/s universal digital TV codec using a median adaptive predictive coding method,” IEEE Trans. Commun.. 35, (6 ), 637 –645 (1987).

**CrossRef**

**Martucci S. A.**, “Reversible compression of HDTV images using median adaptive prediction and arithmetic coding,” in Proc. IEEE Int. Symp. Circuits Systems , Vol. 2, pp. 1310 –1313 (1990).

**CrossRef**

**Strutz T.**, “Adaptive selection of colour transformations for reversible image compression,” in Proc. 20th European Signal Processing Conf. , pp. 1204 –1208 (2012).

**http://links.uwaterloo.ca/Repository.html**(21 February 2016).

**http://www.cipr.rpi.edu/resource/stills/kodak.html**(21 February 2016)

**De Simone F.**et al., “Subjective evaluation of JPEG XR image compression,” Proc. SPIE. 7443, , 74430L (2009). 0277-786X

**CrossRef**

**http://documents.epfl.ch/groups/g/gr/gr-eb-unit/www/IQA/Original.zip**(21 February 2016)

**http://sun.aei.polsl.pl/~rstaros/optres/**(21 February 2016)

**Starosolski R.**, “Compressing high bit depth images of sparse histograms,” in Int. Electronic Conf. on Computer Science, AIP Conf. Proc. Vol. 1060, pp. 269 –272, American Institute of Physics (2008).

**CrossRef**

**Pinho A. J.**, “Preprocessing techniques for improving the lossless compression of images with quasi-sparse and locally sparse histograms,” in Proc. ICME , Vol. 1, pp. 633 –636 (2002).

**CrossRef**

**Taubman D. S.,**and

**Marcellin M. W.**, JPEG2000 Image Compression Fundamentals, Standards and Practice. , Springer Science + Business Media , New York (2002).

**Srinivasan S.**et al., “HD Photo: a new image coding technology for digital photography,” Proc. SPIE. 6696, , 66960A (2007). 0277-786X

**CrossRef**

**Dufaux F.,**,

**Sullivan G. J.,**and

**Ebrahimi T.**, “The JPEG XR image coding standard,” IEEE Signal Proc. Mag.. 26, (6 ), 195 –199 (2009). 1053-5888

**CrossRef**

**http://www.stat.columbia.edu/~jakulin/jpeg-ls/mirror.htm**(21 February 2016).

**Adams M.**, “JasPer implementation of JPEG 2000, version 1.900,”

**http://www.ece.uvic.ca/~mdadams/jasper/**(21 February 2016).

**Adams M. D.,**and

**Ward R. K.**, “JasPer: a portable flexible open-source software tool kit for image coding/processing,” in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing , Vol. 5, pp. 241 –244 (2004).

**CrossRef**

**http://sun.aei.polsl.pl/~rstaros/colortransf-rdls/**(21 February 2016)

**Hardie R. C.,**and

**Barner K. E.**, “Rank conditioned rank selection filters for signal restoration,” IEEE Trans. Image Process.. 3, (2 ), 192 –206 (1994).

**CrossRef**

**Bernas T.**et al., “Application of detector precision characteristics and histogram packing for compression of biological fluorescence micrographs,” Comput. Methods Programs Biomed.. 108, (2 ), 511 –523 (2012). 0169-2607

**CrossRef**

**Roman Starosolski** is an assistant professor at the Institute of Informatics, Silesian University of Technology. He received his MSc and PhD degrees in computer science from the Silesian University of Technology in 1995 and 2002, respectively. He is the author of about 30 papers and has written five book chapters. His current research interests include image processing, compression of image, video and volumetric data, color space transforms, medical imaging, and image compression standards.

Roman Starosolski

"Application of reversible denoising and lifting steps with step skipping to color space transforms for improved lossless compression", *J. Electron. Imaging*. 25(4), 043025 (Aug 12, 2016). ; http://dx.doi.org/10.1117/1.JEI.25.4.043025

## Figures

**F1 :**

Example of forward and inverse RDLS-RCT. $\u2211$, weighted arithmetic mean of components; $d$, denoising of a component; dashed lines surround labels of Fig. 2 panels with the transformed component of a sample image.

**F2 :**

Effects of RCT and RDLS-RCT on components of a noisy image. (a–c) Untransformed components of the original image, (d–f) temporary denoised components created while computing RDLS-RCT, (g–i) RDLS-RCT transformed components, and (j–l) RCT transformed components; image sizes are $74\xd771\u2009\u2009pixels$, transformed components are presented normalized to the dynamic range of original ones, for denoising the median filter with $3\xd73\u2009\u2009pixels$ window was used; H0_pMED, estimated bitrate of the component (see Sec. 2.7).

**F3 :**

(a–c) Average JPEG 2000 bitrate changes due to RDLS, for the individual RDLS-RCT components, and (d–i) the overall for examined transforms, obtained using denoising filters described in Sec. 2.5 (all, unless indicated otherwise) selected in three iterations of step B of the heuristic based on bitrates estimated with H0_pMED.

**F4 :**

Average JPEG 2000 bitrate changes due to RDLS obtained using denoising filters selected in 1, 2, and 3 iterations of the heuristic step B out of all filters described in Sec. 2.5. (a) RDLS-RCT, (b) RDLS-YCoCg-R, and (c) RDLS-LDgEb.

**F5 :**

Average JPEG-LS, JPEG 2000, and JPEG XR bitrate changes due to RDLS with respect to the non-RDLS transform. The denoising filters were selected using the H0_pMED(10k:100) estimator in two iterations of the heuristic step B out of: none, null, and smoothing filters with center point weights 1, 4, 16, 64, and 256, or using H0_pMED in three iterations of the heuristic step B out of all filters described in Sec. 2.5. (a) RDLS-RCT, (b) RDLS-YCoCg-R, (c) RDLS-RDgDb, and (d) RDLS-LDgEb.

## Tables

Transform | $C1$ | $C2$ | $C3$ | ||||||
---|---|---|---|---|---|---|---|---|---|

Name | range | depth | name | range | depth | name | range | depth | |

RGB | $R$ | $[0,2b\u22121]$ | $b$ | $G$ | $[0,2b\u22121]$ | $b$ | $B$ | $[0,2b\u22121]$ | $b$ |

RCT | $Ur$ |