Skip Abstract Section
Abstract
Artworks need to be constantly monitored to check their state of conservation and to quickly spot the eventual presence of alterations or damages. Preventive conservation is the set of practices employed to reach this goal. Unfortunately, this results generally in a cumbersome process involving multiple analytical techniques. Consequently, methods able to provide a quick preliminary examination of the artworks (e.g., optical monitoring) seem very promising to streamline preventive conservation procedures. We are especially interested in the study of historical wood musical instruments, a kind of artwork particularly subject to mechanical wear since they are both held in museums and also occasionally played in concerts. Our primary goal is to detect possible altered regions on the surface of the instruments early and thus provide the experts some precise indications on where to apply more in-depth examinations to check for potential damages. In this work, we propose an optical monitoring method based on the a-contrario probabilistic framework. Tests were conducted on the “Violins UVIFL imagery” dataset, a collection of UV-induced fluorescence image sequences of artificially altered wood samples and violins. Obtained results showed the robustness of the proposed method and its capability to properly detect altered regions while rejecting noise.
- [1] . 2003. Classification of painting cracks for content-based analysis. In Proceedings of SPIE 5011, Machine Vision Applications in Industrial Inspection XI, Vol. 5011. SPIE, 149–161.Google Scholar
Cross Ref
- [2] . 2006. k-Means++: The Advantages of Careful Seeding.
Technical Report . Stanford University, Stanford, CA.Google Scholar - [3] . 2011. A survey of specularity removal methods. Computer Graphics Forum 30 (2011), 2208–2230.Google Scholar
- [4] . 2005. Spectroscopic techniques in Cultural Heritage conservation: A survey. Applied Spectroscopy Reviews 40, 3 (2005), 187–228.
DOI: Google ScholarCross Ref - [5] . 2005. Preventive conservation research and practice at the British Museum. Journal of the American Institute for Conservation 44, 3 (2005), 159–173.
DOI: Google ScholarCross Ref - [6] . 2010. Stradivari Varnish: Scientific Analysis of His Finishing Technique on Selected Instruments. Serving Audio.Google Scholar
- [7] . 2016. Handbook of Materials for String Musical Instruments. Springer.Google ScholarCross Ref
- [8] . 2007. Decay regions segmentation from color images of ancient monuments using fast marching method. Journal of Cultural Heritage 8, 2 (2007), 170–175.
DOI: Google ScholarCross Ref - [9] . 2016. Cultural Heritage sites in danger—Towards automatic damage detection from space. Remote Sensing 8, 9 (
Sept. 2016), 781.DOI: Google ScholarCross Ref - [10] . 2013. Crack detection and inpainting for virtual restoration of paintings: The case of the Ghent Altarpiece. Signal Processing 93, 3 (2013), 605–619. Google ScholarDigital Library
- [11] European Standard. 2011. CSN EN 16242 2011: Conservation of Cultural Heritage - Procedures and Instruments for Measuring Humidity in the Air and Moisture Exchanges Between Air and Cultural Property.European Standard.Google Scholar
- [12] . 2015. Hyperspectral crack detection in paintings. In Proceedings of the 2015 Colour and Visual Computing Symposium (CVCS’15). 1–6.
DOI: Google ScholarCross Ref - [13] . 2000. Meaningful alignments. International Journal of Computer Vision 40, 1 (2000), 7–23.Google ScholarDigital Library
- [14] . 2003. A grouping principle and four applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 4 (2003), 508–513.Google ScholarDigital Library
- [15] . 2004. Gestalt theory and computer vision. In Seeing, Thinking and Knowing. Springer, 71–101.Google Scholar
- [16] . 2007. From Gestalt Theory to Image Analysis: A Probabilistic Approach. Vol. 34. Springer Science & Business Media.Google ScholarDigital Library
- [17] . 2017. Automatic analysis of UV-induced fluorescence imagery of historical violins. Journal on Computing and Cultural Heritage 10, 2 (2017), Article 12, 13 pages.
DOI: Google ScholarDigital Library - [18] . 2016. Automatic identification of varnish wear on historical instruments: The case of Antonio Stradivari violins. Journal of Cultural Heritage 22 (2016), 968–973. Google ScholarCross Ref
- [19] . 2019. Segmentation of multi-temporal UV-induced fluorescence images of historical violins. In New Trends in Image Analysis and Processing—ICIAP 2019. Lecture Notes in Computer Science, Vol. 11808. Springer, 81–91.Google Scholar
- [20] . 2018. Innovative monitoring plan for the preventive conservation of historical musical instruments. Studies in Conservation 63, Suppl. 1 (2018), 351–354.
DOI: Google ScholarCross Ref - [21] . 2021. Reflection FTIR spectroscopy for the study of historical bowed string instruments: Invasive and non-invasive approaches. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy 245 (2021), 118926.
DOI: Google ScholarCross Ref - [22] . 2020. Machine learning for Cultural Heritage: A survey. Pattern Recognition Letters 133 (2020), 102–108.
DOI: Google ScholarCross Ref - [23] . 2011. A Helmholtz principle approach to parameter free change detection and coherent motion using exchangeable random variables. SIAM Journal on Imaging Sciences 4, 1 (2011), 243–276.Google ScholarDigital Library
- [24] . 2003. Surface analysis of stone materials integrating spatial data and computer vision techniques. Journal of Cultural Heritage 4, 2 (2003), 117–125. Google ScholarCross Ref
- [25] . 2005. A probabilistic interpretation of precision, recall and F-score, with implication for evaluation. In Proceedings of the European Conference on Information Retrieval. 345–359.Google ScholarDigital Library
- [26] . 2014. 3D remote colorimetry and watershed segmentation techniques for fresco and artwork decay monitoring and preservation. Journal of Archaeological Science 46 (2014), 182–190. Google ScholarCross Ref
- [27] . 2013. Mixture contrast limited adaptive histogram equalization for underwater image enhancement. In Proceedings of the 2013 International Conference on Computer Applications Technology (ICCAT’13). 1–5.
DOI: Google ScholarCross Ref - [28] . 2018. A non-invasive stratigraphic study by reflection FT-IR spectroscopy and UV-induced fluorescence technique: The case of historical violins. Microchemical Journal 138 (2018), 273–281.
DOI: Google ScholarCross Ref - [29] . 2004. Non-Destructive Micro Analysis of Cultural Heritage Materials. Vol. 42. Elsevier.Google Scholar
- [30] . 2020. Deep learning for change detection in remote sensing images: Comprehensive review and meta-analysis. IEEE Access 8 (2020), 126385–126400.Google ScholarCross Ref
- [31] . 2016. Impact of ASHRAE’s museum climate classes on energy consumption and indoor climate fluctuations: Full-scale measurements in museum Hermitage Amsterdam. Energy and Buildings 130 (2016), 286–294.
DOI: Google ScholarCross Ref - [32] . 2020. Siamese neural networks for continuous disease severity evaluation and change detection in medical imaging. NPJ Digital Medicine 3, 1 (2020), 1–9.Google Scholar
- [33] . 2003. Detection of major changes in satellite images. In Proceedings of the 2003 International Conference on Image Processing, Vol. 1. IEEE, Los Alamitos, CA.Google ScholarCross Ref
- [34] . 2019. A contrario comparison of local descriptors for change detection in very high spatial resolution satellite images of urban areas. IEEE Transactions on Geoscience and Remote Sensing 57, 6 (2019), 3904–3918.Google ScholarCross Ref
- [35] . 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2 (2004), 91–110.Google ScholarDigital Library
- [36] . 2001. The development of the CIE 2000 colour-difference formula: CIEDE2000. Color Research & Application 26, 5 (2001), 340–350.Google ScholarCross Ref
- [37] . 2021. An empirical review of deep learning frameworks for change detection: Model design, experimental frameworks, challenges and research needs. IEEE Transactions on Intelligent Transportation Systems 23 (2021), 6101–6122.Google Scholar
- [38] . 2012. An integrated and automated segmentation approach to deteriorated regions recognition on 3D reality-based models of Cultural Heritage artifacts. Journal of Cultural Heritage 13, 4 (2012), 371–378.
DOI: Google ScholarCross Ref - [39] . 1988. Mixture Models: Inference and Applications to Clustering. Vol. 38. M. Dekker, New York, NY.Google Scholar
- [40] . 2011. Modern hierarchical, agglomerative clustering algorithms. arXiv preprint arXiv:1109.2378 (2011).Google Scholar
- [41] . 2016. Vulnerability index: A new approach for preventive conservation of monuments. International Journal of Architectural Heritage 10, 8 (2016), 1078–1100.
DOI: Google ScholarCross Ref - [42] . 1990. Contrast-limited adaptive histogram equalization: Speed and effectiveness. In Proceedings of the 1st Conference on Visualization in Biomedical Computing. IEEE, Los Alamitos, CA, 337–338.Google ScholarCross Ref
- [43] . 2015. Digital image processing of the Ghent Altarpiece: Supporting the painting’s study and conservation treatment. IEEE Signal Processing Magazine 32, 4 (2015), 112–122.
DOI: Google ScholarCross Ref - [44] . 2021. GBK-means clustering algorithm: An improvement to the K-means algorithm based on the bargaining game. Knowledge-Based Systems 213 (2021), 106672.Google ScholarDigital Library
- [45] . 2019. Detecting alterations in historical violins with optical monitoring. In Proceedings of the 14th International Conference on Quality Control by Artificial Vision (QCAV’19). Article 1117210, 8 pages.
DOI: Google ScholarCross Ref - [46] . 2021. Analysis of multi-temporal image series for the preventive conservation of varnished wooden surfaces. In Proceedings of the 16th International Symposium on Visual Computing.Google ScholarDigital Library
- [47] . 2021. One step clustering based on a-contrario framework for detection of alterations in historical violins. In Proceedings of the 25th International Conference on Pattern Recognition (ICPR’20). 9348–9355.Google ScholarCross Ref
- [48] . 2022. A-contrario framework for detection of alterations in varnished surfaces. Journal of Visual Communication and Image Representation 83 (2022), 103357.Google ScholarDigital Library
- [49] . 2010. An a-contrario approach for subpixel change detection in satellite imagery. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 11 (2010), 1977–1993.Google ScholarDigital Library
- [50] . 2007. An a contrario approach for change detection in 3D multimodal images: Application to multiple sclerosis in MRI. In Proceedings of the 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, Los Alamitos, CA, 2069–2072.Google ScholarCross Ref
- [51] . 2019. The case of Antonio Stradivari 1718 ex-San Lorenzo violin: History, restorations and conservation perspectives. Journal of Archaeological Science: Reports 23 (2019), 443–450.
DOI: Google ScholarCross Ref - [52] . 2018. The elemental composition of Stradivari’s musical instruments: New results through non-invasive EDXRF analysis. X-Ray Spectrometry 47, 2 (2018), 159–170. Google ScholarCross Ref
- [53] . 2021. Identifying spatiotemporal patterns in land use and cover samples from satellite image time series. Remote Sensing 13, 5 (2021), 974.Google ScholarCross Ref
- [54] . 1998. Risk Preparedness: A Management Manual for World Cultural Heritage. ICCROM.Google Scholar
- [55] . 2007. Analytical Techniques in Materials Conservation. John Wiley & Sons.Google ScholarCross Ref
- [56] . 2017. Robotic platform for deep change detection for rail safety and security. In Proceedings of the 2017 European Conference on Mobile Robots (ECMR’17). IEEE, Los Alamitos, CA, 1–6.Google ScholarCross Ref
- [57] . 1968. Contributions to the London Conference on Museum Climatology, 18-23 September 1967. International Institute for Conservation of Historic and Artistic Works.Google Scholar
- [58] . 2000. MLESAC: A new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding 78, 1 (2000), 138–156.Google ScholarDigital Library
- [59] . 2018. ChangeNet: A deep learning architecture for visual change detection. In Proceedings of the European Conference on Computer Vision Workshops (ECCV’18 Workshops).Google Scholar
- [60] . 2021. QFabric: Multi-task change detection dataset. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 1052–1061.Google ScholarCross Ref
- [61] . 2017. Clustering by local gravitation. IEEE Transactions on Cybernetics 48, 5 (2017), 1383–1396.Google ScholarCross Ref
- [62] . 2012. Preventive conservation: A key method to ensure Cultural Heritage’s authenticity and integrity in preservation process. E-conservation Magazine 6, 24 (2012), 165–176.Google Scholar
- [63] . 2018. Seeing deeply and bidirectionally: A deep learning approach for single image reflection removal. In Proceedings of the European Conference on Computer Vision (ECCV’18). 654–669.Google ScholarDigital Library
- [64] . 2016. Satellite image time series clustering via affinity propagation. In Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS’16). 2419–2422.
DOI: Google ScholarCross Ref - [65] . 2014. Constructing robust affinity graphs for spectral clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1450–1457.Google ScholarDigital Library
- [66] . 2017. Change detection using landsat time series: A review of frequencies, preprocessing, algorithms, and applications. ISPRS Journal of Photogrammetry and Remote Sensing 130 (2017), 370–384.Google ScholarCross Ref
Index Terms
- Multi-Temporal Image Analysis for Preventive Conservation of Historical Musical Instruments
Recommendations
An Effective Feature Calculation For Analysis & Classification of Indian Musical Instruments Using Timbre Measurement
ICCCT '15: Proceedings of the Sixth International Conference on Computer and Communication Technology 2015Musical instrument recognition is significant field in the research of computer music which is related to the modelling of sounds. Analysing & synthesing the structure of musical note is of importance both for modelling music signals and their automatic ...
Networked Wearable Musical Instruments Will Bring A New Musical Culture
ISWC '01: Proceedings of the 5th IEEE International Symposium on Wearable ComputersMany people enjoy music daily, but in a very passive way. To more actively enjoy music, some novel musical instruments are necessary. As a candidate for a novel musical instrument, we propose a networked wearable musical instrument. This paper describes ...
Comments