Abstract
We present an algorithm for automatically detecting and visualizing small non-local variations between repeating structures in a single image. Our method allows to automatically correct these variations, thus producing an 'idealized' version of the image in which the resemblance between recurring structures is stronger. Alternatively, it can be used to magnify these variations, thus producing an exaggerated image which highlights the various variations that are difficult to spot in the input image. We formulate the estimation of deviations from perfect recurrence as a general optimization problem, and demonstrate it in the particular cases of geometric deformations and color variations.
- Barnes, C., Shechtman, E., Goldman, D. B., and Finkelstein, A. 2010. The generalized patchmatch correspondence algorithm. In ECCV. Springer, 29--43. Google ScholarDigital Library
- Barnsley, M. F., and Sloan, A. D., 1990. Methods and apparatus for image compression by iterated function system. US Patent 4,941,193.Google Scholar
- Boiman, O., and Irani, M. 2007. Detecting irregularities in images and in video. International Journal of Computer Vision 74, 1, 17--31. Google ScholarDigital Library
- Brox, T., Bruhn, A., Papenberg, N., and Weickert, J. 2004. High accuracy optical flow estimation based on a theory for warping. In ECCV. Springer, 25--36.Google Scholar
- Buades, A., Coll, B., and Morel, J.-M. 2005. A non-local algorithm for image denoising. In CVPR, vol. 2, IEEE, 60--65. Google ScholarDigital Library
- Clerc, M., and Mallat, S. 2002. The texture gradient equation for recovering shape from texture. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 4, 536--549. Google ScholarDigital Library
- Criminisi, A., Pérez, P., and Toyama, K. 2004. Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on Image Processing 13, 9, 1200--1212. Google ScholarDigital Library
- Dabov, K., Foi, A., Katkovnik, V., and Egiazarian, K. 2007. Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Transactions on Image Processing 16, 8, 2080--2095. Google ScholarDigital Library
- Danielyan, A., Katkovnik, V., and Egiazarian, K. 2012. Bm3d frames and variational image deblurring. IEEE Transactions on Image Processing 21, 4, 1715--1728. Google ScholarDigital Library
- Dissemination of it for the promotion of materials science (doitpoms). http://www.doitpoms.ac.uk/.Google Scholar
- Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, ACM, 341--346. Google ScholarDigital Library
- Eisenacher, C., Lefebvre, S., and Stamminger, M. 2008. Texture synthesis from photographs. In Computer Graphics Forum, vol. 27, Wiley Online Library, 419--428.Google Scholar
- Freedman, G., and Fattal, R. 2011. Image and video upscaling from local self-examples. ACM Transactions on Graphics (TOG) 30, 2, 12. Google ScholarDigital Library
- Glasner, D., Bagon, S., and Irani, M. 2009. Superresolution from a single image. In ICCV, IEEE, 349--356.Google Scholar
- Goferman, S., Zelnik-Manor, L., and Tal, A. 2012. Context-aware saliency detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 10, 1915--1926. Google ScholarDigital Library
- Hays, J., Leordeanu, M., Efros, A. A., and Liu, Y. 2006. Discovering texture regularity as a higher-order correspondence problem. In Europian Conference on Computer Vision (ECCV). Springer, 522--535. Google ScholarDigital Library
- Jojic, N., Frey, B. J., and Kannan, A. 2003. Epitomic analysis of appearance and shape. In ICCV, IEEE, 34--41. Google ScholarDigital Library
- Kim, V. G., Lipman, Y., and Funkhouser, T. A. 2012. Symmetry-guided texture synthesis and manipulation. ACM Transactions on Graphics (TOG) 31, 3, 22. Google ScholarDigital Library
- Lebrun, M., Colom, M., and Morel, J. 2014. The noise clinic: A universal blind denoising algorithm. In ICIP, IEEE, 2674--2678.Google Scholar
- Liu, Y., Lin, W.-C., and Hays, J. 2004. Near-regular texture analysis and manipulation. In ACM Transactions on Graphics (TOG), vol. 23, ACM, 368--376. Google ScholarDigital Library
- Liu, C., Torralba, A., Freeman, W. T., Durand, F., and Adelson, E. H. 2005. Motion magnification. ACM Transactions on Graphics (TOG) 24, 3, 519--526. Google ScholarDigital Library
- Liu, X., Jiang, L., Wong, T.-T., and Fu, C.-W. 2012. Statistical invariance for texture synthesis. IEEE Transactions on Visualization and Computer Graphics 18, 11, 1836--1848. Google ScholarDigital Library
- Liu, C. 2009. Beyond pixels: Exploring new representations and applications for motion analysis. PhD thesis, Citeseer. Google ScholarDigital Library
- Malik, J., and Rosenholtz, R. 1997. Computing local surface orientation and shape from texture for curved surfaces. International Journal of Computer Vision 23, 2, 149--168. Google ScholarDigital Library
- Michaeli, T., and Irani, M. 2013. Nonparametric blind superresolution. In ICCV, IEEE, 945--952. Google ScholarDigital Library
- Michaeli, T., and Irani, M. 2014. Blind deblurring using internal patch recurrence. In ECCV.Google Scholar
- Mishne, G., and Cohen, I. 2013. Multiscale anomaly detection using diffusion maps. IEEE Journal of Selected Topics in Signal Processing 7, 1, 111--123.Google ScholarCross Ref
- Park, M., Brocklehurst, K., Collins, R. T., and Liu, Y. 2009. Deformed lattice detection in real-world images using mean-shift belief propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 10, 1804--1816. Google ScholarDigital Library
- Seo, H. J., and Milanfar, P. 2009. Static and space-time visual saliency detection by self-resemblance. Journal of vision 9, 12, 15.Google ScholarCross Ref
- Shankar, N., and Zhong, Z. 2005. Defect detection on semi-conductor wafer surfaces. Microelectronic Engineering 77, 3, 337--346. Google ScholarDigital Library
- Simakov, D., Caspi, Y., Shechtman, E., and Irani, M. 2008. Summarizing visual data using bidirectional similarity. In CVPR, IEEE.Google Scholar
- Wadhwa, N., Rubinstein, M., Durand, F., and Freeman, W. T. 2013. Phase-based video motion processing. ACM Trans. Graph.. Google ScholarDigital Library
- Wadhwa, N., Dekel, T., Wei, D., Durand, F., and Freeman, W. T. 2015. Deviation magnification: Revealing geometric deviation in a single image. In SIGGRAPH Asia. Google ScholarDigital Library
- Wu, H., Rubinstein, M., Shih, E., Guttag, J. V., Durand, F., and Freeman, W. T. 2012. Eulerian video magnification for revealing subtle changes in the world. ACM Trans. Graph.. Google ScholarDigital Library
- Zontak, M., and Cohen, I. 2010. Defect detection in patterned wafers using anisotropic kernels. Machine Vision and Applications 21, 2, 129--141. Google ScholarDigital Library
Index Terms
- Revealing and modifying non-local variations in a single image
Recommendations
Internal statistics of a single natural image
CVPR '11: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern RecognitionStatistics of 'natural images' provides useful priors for solving under-constrained problems in Computer Vision. Such statistics is usually obtained from large collections of natural images. We claim that the substantial internal data redundancy within ...
Single Image Dehazing via Image Generating
Image and Video TechnologyAbstractOutdoor images taken in bad weather conditions often suffer from poor visibility. However, single image haze removal is an ill-posed problem, because the number of the equations is smaller than the number of unknowns. In this paper, a deep ...
Local albedo-insensitive single image dehazing
In this paper, we present a new algorithm to remove haze from a single image. The proposed algorithm extracts transmission iteratively under the assumption that large-scale chromaticity variations are due to transmission while small-scale luminance ...
Comments