Figures
Abstract
The increasing number of demanding consumer image applications has led to increased interest in no-reference objective image quality assessment (IQA) algorithms. In this paper, we propose a new blind blur index for still images based on singular value similarity. The algorithm consists of three steps. First, a re-blurred image is produced by applying a Gaussian blur to the test image. Second, a singular value decomposition is performed on the test image and re-blurred image. Finally, an image blur index is constructed based on singular value similarity. The experimental results obtained on four simulated databases to demonstrate that the proposed algorithm has high correlation with human judgment when assessing blur or noise distortion of images.
Citation: Sang Q-B, Wu X-J, Li C-F, Lu Y (2014) Blind Image Blur Assessment Using Singular Value Similarity and Blur Comparisons. PLoS ONE 9(9): e108073. https://doi.org/10.1371/journal.pone.0108073
Editor: Xi-Nian Zuo, Institute of Psychology, Chinese Academy of Sciences, China
Received: March 14, 2014; Accepted: August 25, 2014; Published: September 23, 2014
Copyright: © 2014 Sang et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The authors confirm that all data underlying the findings are fully available without restriction. All relevant data are within the paper and its Supporting Information files.
Funding: This research is supported in part by the National Natural Science Foundation of China (No. 61170120), the Program for New Century Excellent Talents in University (NCET-12-0881), the 111 Project (B12018), and the Natural Science Foundation of Jiangsu Province (No. BK2011147). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Digital images produced by digital cameras are widely used. The objective of image processing in many applications is the search for an in-focus, noise-free version of an unknown original. It is necessary to assess the quality of images if qualified images are expected to be sorted out and if unqualified ones are dumped automatically. The naked eye is undoubtedly a good classifier, but an objective method saves time and should simplify the task. Objective IQA methods fall into three categories: Full Reference (FR), Reduced Reference (RR) and No Reference (NR) or Blind Reference (BR). FR and RR need all of, or at least part of, the information regarding the reference image. However, in many application occasions, the information regarding the reference image is inaccessible. Hence, the NR method is comparatively more valuable.
In recent years, research into no-reference image blur assessment methods has been notably active. A variety of no-reference blur indexes have been proposed in the literature. For example, in [1], an image sharpness index is proposed that is based on the notion of just noticeable blur (JNB). Rania Hassen et al in [2] propose a new sharpness measure by utilizing local phase coherence (LPC) evaluated in the complex wavelet transform domain. In [3], the authors present a no-reference image blur metric, which utilizes a probabilistic model to estimate the probability of detecting blur at the edges of an image; the information is later pooled by computing the cumulative probability of blur detection (CPBD).
The singular value decomposition (SVD) method has been successfully applied to FR IQA. The existing FR methods based on SVD are primarily divided into two categories. One category uses the singular value to assess image quality. For example, the MSVD algorithm proposed in [4] uses the amount of change of the singular value as the image quality evaluation criteria. The other category uses the left singular vectors and right singular vectors to assess image quality [5]. This paper analyses the relationship between the change of the singular value and the blurred degree, and a new method for image blur index is suggested based on a singular value similarity that does not require the reference image.
Singular Value Similarity
Every grayscale image can be considered as a matrix. Any m×n real matrix A can be decomposed into a product of three matrices, i.e., , where U and V are orthogonal matrices,
, and
, where r is the rank of A. The diagonal entries of Sr are known as the singular values of A, the columns of U are called the left singular vectors of A, and the columns of V are called the right singular vectors of A. This decomposition is known as the Singular Value Decomposition (SVD) of A. The SVD is one of the most useful tools of linear algebra with several applications for image processing, including image de-noising, compression, and watermarking.
In this paper, We imitate the SSIM [8] algorithm and use the similarity of the singular value vectors between source image and the distorted image to represent the quality of distorted image, and define a novel NSVD index for IQA as following:(1)where
and
are the singular value vectors of source Image
and the distorted image
, and r is the number of the singular value.
is a small positive constant to increase the stability of NSVD (such a consideration was also included in SSIM [8]). Formula (1) is a commonly used measure to define the similarity of two positive real numbers [8] and its result ranges within (0, 1].
To explain our propsed NSVD index, we arbitrarily selected a source image and five blurred versions of it from the LIVE2 database [7], as shown in Figure 1, wherethe degree of blur is sorted in ascending order from Image a to Image e. Figure 1 consists of blurred images with R, G, and B components that were filtered using a circularly symmetric 2-D Gaussian kernel of standard deviationβ. The values of β are given in Figure 1. The greater the value of standard deviation β, the greater the blurred degree.
We calculate the values of the NSVD of Figure 1 using the formula (1) given in Table 1, and the values of standard deviationβare also listed in Table 1. A scatter plot of β versus NSVD are given in the Figure 2. The greater the value of standard deviation β, the greater the blurred degree. From Figure2, it can be observed that β and NSVD have an approximate inverse proportion relationship, and NSVD can be used as an FR IQA index to measure blurred degree of images.
Gaussian Blur
A Gaussian blur (also known as Gaussian smoothing) has the effect of reducing an image's high-frequency components and is widely used to reduce the detail of an image to produce a blurred image or a de-noising image.
In this paper, we consider to use the difference between blurred image and reblurred image to represent image quality, so the NSVD index between blurred image and reblurred image is used. Several re-blurred images are produced with different standard deviations σ by using the Gaussian blur function in Matlab, as shown in Figure 3. We regard each of these re-blurred images as a ‘reference image’ (similar to ‘Source Image s’ in Figure 1), and calculate the values of NSVD for the blurred images in Figure 1. The plots of β versus NSVD are be shown as Figure 4. It can be observed that when the values of σ are greater than 3.5, β and NSVD have an approximate direct proportion relationship, and NSVD between blurred image and reblurred image reflect the blurred degree of image.
Constructing the No-Reference Blur Inex
Figure 5 exhibits a flowchart of the proposed no-reference blur assessment algorithm, and the steps are as follows.
- First, a re-blurred image is produced by applying a Gaussian blur to a test image with a window size of 11×11 and a standard deviation σ set to 5.
- Singular vectors S1 and S2 are gained by applying Singular Value Decompositions to the test image and re-blurred image.
- A blurred image quality index is calculated using the formula (1).
Experimental Results and Analysis
A. Databases and Metrics for Comparison
Performance of the proposed blur index was evaluated on four blur image databases (CSIQ [6], LIVE2 [7], TID2008 [9], and IVC [10]). The characteristics of these four databases are summarized in Table 2.
Two commonly used performance metrics were employed to evaluate the competing IQA metrics. The first is the Spearman rank-order correlation coefficient (SROCC), which measures the prediction monotonicity of an IQA metric. This metric operates on the ranked data points and ignores the relative distances between data points. The second metric is the Pearson linear correlation coefficient (CC) between MOS and the objective scores after nonlinear regression. For the nonlinear regression, we used the following mapping function:(2)where x is the score obtained from the objective metric, and βk with k = 1,2,3,4,5 are parameters. The fitting, i.e., determination of parameters in [11], is done by the nonlinear regression over dataset.
B. Tests on the LIVE2 Database
According to the analysis in section 2, formula (1) can be used as an FR IQA method. We tested the formula on the LIVE2 database, which consists of 29 different reference images and 779 distorted images from five distortion categories—JPEG2000 (JP2K), JPEG (JPEG), White Noise (WN), Gaussian Blur (Blur) and Fast fading noise (FF)—along with the associated DMOS, which represent human judgments of image quality; and we then made a comparison using two classical FR IQA metrics, SSIM [8] and PSNR. From Table 3, it can be seen that the index NSVD correlate well with human DMOS. On the Blur, JP2K, and JPEG distortion categories, the NSVD index delivers a better performance than SSIM and PSNR. However, in the FF and WN categories, its results are somewhat inferior to those of SSIM.
C. Test on Four Databases
We compared our blur index with three current top no-reference blur indices [1]–[3] on the four simulated blur databases. The experimental results are shown in Table 4, which demonstrates the advantage of our proposed algorithm. Furthermore, our proposed index has the best performance on distortion types of noise compared to the other blur indices.
Figures 6 (a)-(d) display the scatter plots of the NSVD objective scores versus DMOS (MOS) on the four blur databases. Each data point represents one test image. The curves shown in Figure 6 were obtained by a nonlinear fitting according to [11]. From Figure 6, one can see that the NSVD index is consistent with human subjective judgments of quality in these distortions.
Conclusions
In this work, we presented a novel no-reference image blur index based on the singular value similarity. The efficiency of the new algorithm is validated on four simulated blur databases. This algorithm can accurately assess images that have blurring or noise. In addition, the proposed index NSVD can also be observed as an FR IQA index.
Author Contributions
Conceived and designed the experiments: QBS XJW. Performed the experiments: QBS YL. Analyzed the data: CFL. Contributed reagents/materials/analysis tools: QBS XJW. Wrote the paper: QBS XJW CFL.
References
- 1. Ferzli R, Karam LJ (2009) A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB). IEEE Trans. Image Process 18(4): 717–728.
- 2.
Hassen R, Wang Z, Salama M (2010) No-reference image sharpness assessment based on local phase coherence measurement. Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing, Dallas, TX, USA, 2434–2437.
- 3. Narvekar ND, Karam LJ (2011) A no-reference image blur metric based on the cumulative probability of blur detection (CPBD). IEEE Trans. Image Process 20(9): 2678–2683.
- 4. Aleksandr S, Alexander G, Ahmet ME (2006) An SVD-Based Grayscale Image Quality Measure for Local and Global Assessment. IEEE Trans. Image Process 15(2): 422–429.
- 5.
Manish N, Lin W (2010) Objective image quality assessment with singular value decomposition. Fifth International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM).
- 6. Larson EC, Chandler DM (2010) Most apparent distortion: full-reference image quality assessment and the role of strategy. Journal of Electronic Imaging 19(1): 011006–1-011006-21 Available: http://vision.okstate.edu/csiq. Accessed 17 August 2014..
- 7.
Sheikh HR, Wang Z, Cormack L, Bovik AC (2005) LIVE Image Quality Assessment Database, Release 2. Available: http://live.ece.utexas.edu/research/quality. Accessed 17 August 2014.
- 8. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: From error visibility to structural similarity. IEEE Trans.. Image Process 13(4) 600–612.
- 9. Ponomarenko N, Lukin V, Zelensky A, Egiazarian K, Carli M, et al. (2009) TID2008 – A Database for Evaluation of Full-Reference Visual Quality Assessment Metrics. Adv. Mod. Radioelectron 10: 30–45.
- 10.
Ninassi A, Callet PL, Autrusseau F (2006) Pseudo no reference image quality metric using perceptual data hiding. Proc. SPIE Human Vision and Electronic Imaging XI, San Jose, CA, USA.
- 11. Ciancio A, Da Costa AL, Da Silva EA, Said A, Samadani R, et al. (2011) No-reference blur assessment of digital pictures based on multi-feature classifiers. IEEE Trans. Image Process 20(1): 64–75.