Abstract
The cultural heritage of a city is of great importance for the maintenance and enhancement of its history. Users can use innovative technologies such as Computer Vision to emphasize the city’s treasures attractively and playfully. In Belém, Pará, azulejo is a meaningful cultural heritage case, which goes back to its foundation. The image recognition can facilitate and speed up the search for an azulejo and its historical information since, although cataloged, its visual appearance identifies it better than a name, which implies that the image-based search is much more natural than a text-based search. In this way, this work presents a prototype that uses Convolutional Neural Networks (CNN) to classify the azulejos from Belém by an image-based search. CNN’s training used two image datasets. The first contains images that show azulejos and other environmental elements (for instance, walls, doors, streets, and people). The second dataset contains images that show only azulejos, and in both datasets, they only have one type of azulejo per image. The trained model consists of twelve different types of azulejos, representing the recognizable classes. Thus, after training, the tflite (Tensorflow Lite) model is generated with azulejos classes to be used in the mobile device image classification task. Finally, we developed an application in which the user takes a photo, and the system sends it to the classification module that contains the trained CNN model. After the image classification process, the module returns the five classes’ values with the best accuracy and historical details about the azulejos.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Alcântara, D.M.E.S., Brito, S.R.S., Sanjad, T.A.B.C.: Azulejaria em Belém do Pará: Inventário - Arquitetura civil e religiosa - Século XVIII ao XX. Biblioteca Aloísio Magalhães IPHAN, Bras’ilia, DF (2016)
Marino Alfonso, J.L., Poblete Piedrabuena, M.Á., Beato Bergua, S., Herrera Arenas, D.: Geotourism Itineraries and Augmented Reality in the Geomorphosites of the Arribes del Duero Natural Park (Zamora Sector, Spain). Geoheritage 13(1), 1–17 (2021). https://doi.org/10.1007/s12371-021-00539-x
Arruda, T.C., Sanjad, T.A.B.C.: Ornamentos de platibanda em edificações de belém entre os séculos XIX e XX: inventário e conservação. Anais do Museu Paulista: História e Cultura Material 25(3), 341–388 (2017). https://doi.org/10.1590/1982-02672017v25n0310
Awang, K.W., Hassan, W.M.W., Zahari, M.S.M.: Tourism development: a geographical perspective. Asian Soc. Sci. 5(5) (2009). https://doi.org/10.5539/ass.v5n5p67
Bergstra, J., Bengio, Y.: Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13(2), 281–305 (2012)
Bishop, C.M.: Pattern Recognition and Machine Learning, 5th edn. Information Science and Statistics. Springer, Heidelberg (2006)
Bonhage, A., Eltaher, M., Raab, T., Breuß, M., Raab, A., Schneider, A.: A modified mask region-based convolutional neural network approach for the automated detection of archaeological sites on high-resolution light detection and ranging-derived digital elevation models in the north German lowland. Archaeological Prospection, February 2021). https://doi.org/10.1002/arp.1806
Cauchi, M., Scerri, D.: Enriching tourist UX via a location based AR treasure hunt game. In: 2019 IEEE 9th International Conference on Consumer Electronics (ICCE-Berlin). IEEE, September 2019. https://doi.org/10.1109/icce-berlin47944.2019.8966141
Conde, M.B.: Nuevas tecnologías y difusión del turismo cultural: descubriendo a goya con realidad aumentada. ROTUR. Revista de Ocio y Turismo 14(1), 81–93 (2020). https://doi.org/10.17979/rotur.2020.14.1.5945
Demir, O.F., Karaarslan, E.: Augmented reality application for smart tourism: GökovAR. In: 2018 6th International Istanbul Smart Grids and Cities Congress and Fair (ICSG). IEEE, April 2018. https://doi.org/10.1109/sgcf.2018.8408965
Fukada, H., Kasai, K., Ohtsu, S.: A field experiment of system to provide tourism information using image recognition type AR technology. In: Lecture Notes in Electrical Engineering, pp. 381–387. Springer International Publishing, November 2014. https://doi.org/10.1007/978-3-319-06764-3_47
Godewithana, N., Jayasena, K., Nagarawaththa, C., Croos, P., Harshanath, B., Alosius, J.: Historical places & monuments identification system. In: 2020 IEEE Region 10 Conference (TENCON). IEEE, November 2020. https://doi.org/10.1109/tencon50793.2020.9293882
Godoy, R.C., Cavalheiro, B.O., de Oliveira Castanho, C.L., da Silva, E.F., Spies, E.H., Alves, V.M.: Turismo e realidade aumentada: Desenvolvimento de um aplicativo para a cidade de santiago/rs. Anais da X edição do Encontro Anual de Tecnologia da Informação - EATI. 9(1), 110–117 (2019). http://anais.eati.info:8080/index.php/2019/article/view/20/17
Han, S., Ren, F., Du, Q., Gui, D.: Extracting representative images of tourist attractions from Flickr by combining an improved cluster method and multiple deep learning models. ISPRS Int. J. Geo-Inf. 9(2), 81 (2020). https://doi.org/10.3390/ijgi9020081
He, Z., Wu, L., Li, X.R.: When art meets tech: the role of augmented reality in enhancing museum experiences and purchase intentions. Tourism Manage. 68, 127–139 (2018). https://doi.org/10.1016/j.tourman.2018.03.003
Hoang, V.D., Tran, D.P., Nhu, N.G., Pham, T.A., Pham, V.H.: Deep feature extraction for panoramic image stitching. In: Intelligent Information and Database Systems, pp. 141–151. Springer International Publishing (2020). https://doi.org/10.1007/978-3-030-42058-1_12
Huang, T.L.: Restorative experiences and online tourists’ willingness to pay a price premium in an augmented reality environment. J. Retail. Consum. Serv. 58, 102256 (2021). https://doi.org/10.1016/j.jretconser.2020.102256
Kounavis, C.D., Kasimati, A.E., Zamani, E.D.: Enhancing the tourism experience through mobile augmented reality: Challenges and prospects. Int. J. Eng. Bus. Manage. 4, 10 (2012). https://doi.org/10.5772/51644
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Kysela, J., Štorková, P.: Using augmented reality as a medium for teaching history and tourism. Procedia - Soc. Behav. Sci. 174, 926–931 (2015). https://doi.org/10.1016/j.sbspro.2015.01.713
Lambers, K., van der Vaart, W.V., Bourgeois, Q.: Integrating remote sensing, machine learning, and citizen science in Dutch archaeological prospection. Remote Sens. 11(7), 794 (2019). https://doi.org/10.3390/rs11070794
Lei, Q., Wen, B., Ouyang, Z., Gan, J., Wei, K.: Research on image recognition method of ethnic costume based on VGG. In: Machine Learning for Cyber Security, pp. 312–325. Springer International Publishing (2020). https://doi.org/10.1007/978-3-030-62463-7_29
Llerena, J., Andina, M., Grijalva, J.: Mobile application to promote the Malecón 2000 tourism using augmented reality and geolocation. In: 2018 International Conference on Information Systems and Computer Science (INCISCOS). IEEE, November 2018. https://doi.org/10.1109/inciscos.2018.00038
Martins, M., Malta, C., Costa, V.: Viseu mobile: a location based augmented reality tour guide for mobile devices. Dos Algarves: a Multidisciplinary e-journal 26(1), 8–26 (2015). DOi: https://doi.org/10.18089/damej.2015.26.1.1
Marto, A., Melo, M., Goncalves, A., Bessa, M.: Development and evaluation of an outdoor multisensory AR system for cultural heritage. IEEE Access 9, 16419–16434 (2021). https://doi.org/10.1109/access.2021.3050974
Poux, F., Valembois, Q., Mattes, C., Kobbelt, L., Billen, R.: Initial user-centered design of a virtual reality heritage system: applications for digital tourism. Remote Sens. 12(16), 2583 (2020). https://doi.org/10.3390/rs12162583
Rocha, P.M.A.: A exploração da realidade aumentada pelo jornalismo: a exposição da informação dos média num espaço aumentado. CECS - Centro de Estudos de Comunicação e Sociedade Universidade do MinhoBraga. Portugal. Literacia, Media e Cidadania - Livro de Atas do \(4.^{\circ }\) Congresso, pp. 475–491, November 2017
Santos, C., Junior, P.C., Araújo, T., Neto, N., Meiguins, B.: Recognizing and exploring azulejos on historic buildings facades by combining computer vision and geolocation in mobile augmented reality applications. J. Mob. Multimedia 13 (2017). https://dl.acm.org/doi/abs/10.5555/3177197.3177201
Williams, S., Lew, A.A.: Tourism Geography: Critical Understandings of Place, Space and Experience. Taylor and Francis Ltd. Abingdon (2014)
Trier, Ø.D., Reksten, J.H., Løseth, K.: Automated mapping of cultural heritage in Norway from airborne lidar data using faster r-CNN. Int. J. Appl. Earth Obs. Geoinf. 95, 102241 (2021). https://doi.org/10.1016/j.jag.2020.102241
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Abreu, W.F., Rocha, R.L., Sousa, R.N., Araújo, T.D.O., Meiguins, B.S., Santos, C.G.R. (2021). Classifying Historical Azulejos from Belém, Pará, Using Convolutional Neural Networks. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2021. ICCSA 2021. Lecture Notes in Computer Science(), vol 12950. Springer, Cham. https://doi.org/10.1007/978-3-030-86960-1_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-86960-1_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86959-5
Online ISBN: 978-3-030-86960-1
eBook Packages: Computer ScienceComputer Science (R0)