This paper shows that motion vectors representing the true motion of an object in a scene can be exploited to improve the encoding process of computer generated video sequences. Therefore, a set of sequences is presented for which the true motion vectors of the corresponding objects were generated on a per-pixel basis during the rendering process. In addition to conventional motion estimation methods, it is proposed to exploit the computer generated motion vectors to enhance the rate-distortion performance. To this end, a motion vector mapping method including disocclusion handling is presented. It is shown that mean rate savings of 3.78% can be achieved.
Pixelwise linear prediction using backward-adaptive least-squares or weighted least-squares estimation of prediction coefficients is currently among the state-of-the-art methods for lossless image compression. While current research is focused on mean intensity prediction of the pixel to be transmitted, best compression requires occurrence probability estimates for all possible intensity values. Apart from common heuristic approaches, we show how prediction error variance estimates can be derived from the (weighted) least-squares training region and how a complete probability distribution can be built based on an autoregressive image model. The analysis of image stationarity properties further allows deriving a novel formula for weight computation in weighted least-squares proofing and generalizing ad hoc equations from the literature. For sparse intensity distributions in non-natural images, a modified image model is presented. Evaluations were done in the newly developed C++ framework volumetric, artificial, and natural image lossless coder (Vanilc), which can compress a wide range of images, including 16-bit medical 3D volumes or multichannel data. A comparison with several of the best available lossless image codecs proofs that the method can achieve very competitive compression ratios. In terms of reproducible research, the source code of Vanilc has been made public.
The design of new HEVC extensions comes with the need for careful analysis of internal HEVC codec decisions. Several bitstream analyzers have evolved for this purpose and provide a visualization of encoder decisions as seen from a decoder viewpoint. None of the existing solutions is able to provide actual insight into the encoder and its RDO decision process. With one exception, all solutions are closed source and make adaption of their code to specific implementation needs impossible. Overall, development with the HM code base remains a time-consuming task. Here, we present the HEVC Analyzer for Rapid Prototyping (HARP), which directly addresses the above issues and is freely available under www.lms.lnt.de/HARP.
This paper presents a method for iterative minimization of combined residual and prediction error for near-lossless compression of medical computed tomography acquisitions using pixel-wise least-squares prediction. While most other lossy state-of-the-art image compression systems like JPEG 2000 make use of transform-based coding, in lossless coding higher compression ratios can be achieved with plain predictive algorithms like JPEG-LS because of their non-linear data adaptive energy reduction. Yet, applying these algorithms in lossy coding, simple quantization usually leads to error propagation and therefore serious quality loss or rate increase, as prediction accuracy of a pixel value and thus data rate depends on the previously reconstructed image region. The proposed minimization approach modifies the original image to be coded in a way such that the edge-directed prediction method from literature may achieve better predictions while introducing only a minimum amount of distortion. Compared to transform-based coding methods, the distortion introduced by the proposed scheme mostly consists in noise reduction instead of blurring or the introduction of artificial structures. The method also prevents error propagation due to the consideration of all pixel dependencies of the prediction. It is shown that, combined with a context-adaptive arithmetic coder, in high-fidelity coding (i. e., PSNR higher than 55 dB) the proposed method can achieve higher compression ratios than the transform-based approaches JPEG 2000, H.264/AVC, and HEVC intra coding.
A new approach for volumetric deformation compensation in temporally predictive coding of dynamic medical heart images is presented. Instead of using conventional vectors, motion is represented by deformation values to model 3-D muscle contractions. In this way, estimated motion is more homogeneous among the image domain and predictions do not contain disturbing blocking artifacts making the approach suitable also for non-block-based transform coding. It is shown that with equal numbers of motion values the method can achieve prediction accuracies similar to cube-based motion estimation. The run time of the described parallel implementation in Nvidia CUDA is shown to be shorter than for an equivalent implementation of cube-based motion estimation.
Medical imaging in hospitals requires fast and efficient image compression to support the clinical work flow and to save costs. Least-squares autoregressive pixel prediction methods combined with arithmetic coding constitutes the state of the art in lossless image compression. However, a high computational complexity of both prevents the application of respective CPU implementations in practice. We present a massively parallel compression system for medical volume images which runs on graphics cards. Image blocks are processed independently by separate processing threads. After pixel prediction with specialized border treatment, prediction errors are entropy coded with an adaptive binary arithmetic coder. Both steps are designed to match particular demands of the parallel hardware architecture. Comparisons with current image and video coders show efficiency gains of 3.3-13.6% while compression times can be reduced to a few seconds.
Predictive coding is applied in many state-of-the-art lossless image compression algorithms like JPEG-LS, CALIC, or least-squares-based methods. We propose a new approach for accurate intensity prediction in pixel-predictive coding of computed tomography (CT) images. Exploiting their particular edge characteristic, the method only relies on a small twelve-pixel context. It does neither require adaptation to larger-region image characteristics nor the transmission of side-information and therefore may be particularly suitable for compression of small images like in region-of-interest coding. While applying simple linear prediction with fixed weights in homogeneous regions, a Gauss error model-function is fit to given contexts in edge regions and then sampled at the position corresponding to the pixel to be predicted in order to obtain prediction values. By the example of CALIC, it is shown that for CT data the edge modeling prediction (EMP) approach can yield an even smaller prediction error than other methods relying on context modeling.
We present a new approach for efficient estimation and storage of tissue deformation in dynamic medical image data like 3-D+t computed tomography reconstructions of human heart acquisitions. Tissue deformation between two points in time can be described by means of a displacement vector field indicating for each voxel of a slice, from which position in the previous slice at a fixed position in the third dimension it has moved to this position. Our deformation model represents the motion in a compact manner using a down-sampled potential function of the displacement vector field. This function is obtained by a Gauss-Newton minimization of the estimation error image, i. e., the difference between the current and the deformed previous slice. For lossless or lossy compression of volume slices, the potential function and the error image can afterwards be coded separately. By assuming deformations instead of translational motion, a subsequent coding algorithm using this method will achieve better compression ratios for medical volume data than with conventional block-based motion compensation known from video coding. Due to the smooth prediction without block artifacts, particularly whole-image transforms like wavelet decomposition as well as intra-slice prediction methods can benefit from this approach. We show that with discrete cosine as well as with Karhunen-Lo`eve transform the method can achieve a better energy compaction of the error image than block-based motion compensation while reaching approximately the same prediction error energy.
We present a new method for data-adaptive compression of dense vector fields in dynamic medical volume data. Conventional block-based motion compensation used for temporal prediction in video compression cannot conveniently cope with deformable motion typically found in medical image sequences encoded over time. Based on an approximation of physiologic tissue motion between two succeeding slices in time direction computed by optical flow methods, we find the most significant motion vectors with respect to their prediction capability for a second 2-D slice out of the first one. By coding the components of these vectors, we are able to reconstruct a high quality dense motion vector field at the decoder using only minimal side-information. We show that our approach can achieve a smoother prediction than block-based motion compensation for such data, reducing storage demands in spatially predictive lossless compression. We also show that such a predictive approach can yield better compression ratios than JPEG 2000 intra coding.
Iterative 3D volume reconstruction is one of the most computeand memory-intensive applications in the fiel d of medical image processing. The iterative reconstruction co nsists of two major compute intensive steps: Forwardand backprojection. Both steps have to be applied repeatedly in each iteration and several iterations are necessary until a reconstr uction result with high image quality is available. As a consequenc e iterative reconstruction techniques are rarely used in practical CT-like systems. To step towards clinical usage it is mandat ory to apply highly parallelized low-cost processing architectures such as the stream processors on current GPUs (Graphics Processi ng Units). In order to achieve high image quality we implemented the forward-projection using a volumetric ray cast method. We have carefully adapted our implementation to two recent GPUprogramming tools, CUDA (NVIDIA Compute Unified Device Architecture) and OpenGL (Open Graphics Language). In terms of execution performance and implementation complexity we compared both tools for the forward-projection step.