skip to main content
10.1145/3210499.3210528acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article
Open Access

Apartment Structure Estimation Using Fully Convolutional Networks and Graph Model

Published:06 June 2018Publication History

ABSTRACT

Apartment searching has been a hot demand all over the world. Understanding the apartment structure will significantly contribute to simplifying the searching process. In this project, the fully convolutional networks are applied to generate semantic segmentation for the apartment floor plan images. We then study and optimize an algorithm to extract the graph model from the segmentation, and to extract the maximum common subgraph with which the structure similarity can be measured. We generate the ground truth data by using online annotation tool and experiment on half of the data. Our segmentation prediction results achieve a pixel mean accuracy of $0.89$ for the full-label model, and retrieve quite similar apartment structures by using graph modeling.

References

  1. 2010--2017. National Institute of Informatics, Japan. http://www. nii.ac.jp/dsc/idr/next/homes.html. (2010--2017).Google ScholarGoogle Scholar
  2. 2011--2016. Crowd Works Inc. https://crowdworks.jp/. (2011- 2016).Google ScholarGoogle Scholar
  3. 2017. NEXT Co., Ltd. http://www.homes.co.jp/. (2017).Google ScholarGoogle Scholar
  4. Sheraz Ahmed, Marcus Liwicki, Markus Weber, and Andreas Dengel. 2011. Improved automatic analysis of architectural floor plans. In Proceedings of International Conference on Document Analysis and Recognition (ICDAR). IEEE, 864--869. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Sheraz Ahmed, Marcus Liwicki, Markus Weber, and Andreas Dengel. 2012. Automatic room detection and room labeling from architectural floor plans. In Proceedings of 10th IAPR International Workshop on Document Analysis Systems (DAS). IEEE, 339--343. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Yasuhiro Aoki, Akio Shio, Hiroyuki Arai, and Kazumi Odaka. 1996. A prototype system for interpreting hand-sketched floor plans. In Proceedings of the 13th International Conference on Pattern Recognition, Vol. 3. IEEE, 747--751. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Llu´'s-Pere de las Heras, Sheraz Ahmed, Marcus Liwicki, Ernest Valveny, and Gemma S´anchez. 2014. Statistical segmentation and structural recognition for floor plan interpretation. International Journal on Document Analysis and Recognition (IJDAR) 17, 3 (2014), 221--237. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Philippe Dosch and G´erald Masini. 1999. Reconstruction of the 3d structure of a building from the 2d drawings of its floors. In Proceedings of the Fifth International Conference on Document Analysis and Recognition. IEEE, 487--490. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Yaroslav Ganin and Victor Lempitsky. 2014. N^ 4-fields: Neural network nearest neighbor fields for image transforms. In Asian Conference on Computer Vision. Springer, 536--551.Google ScholarGoogle Scholar
  10. Bharath Hariharan, Pablo Arbel´aez, Ross Girshick, and Jitendra Malik. 2014. Simultaneous detection and segmentation. In European Conference on Computer Vision. Springer, 297--312.Google ScholarGoogle ScholarCross RefCross Ref
  11. Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093 (2014).Google ScholarGoogle Scholar
  12. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097-- 1105. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Jonathan Long, Evan Shelhamer, and Trevor Darrell. 2015. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3431--3440.Google ScholarGoogle ScholarCross RefCross Ref
  14. Tong Lu, Huafei Yang, Ruoyu Yang, and Shijie Cai. 2007. Automatic analysis and integration of architectural drawings. International Journal on Document Analysis and Recognition 9, 1 (2007), 31--47. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. S´ebastien Mac´e, Herv´e Locteau, Ernest Valveny, and Salvatore Tabbone. 2010. A system to detect rooms in architectural floor plan images. In Proceedings of the 9th IAPR International Workshop on Document Analysis Systems. ACM, 167--174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. James J McGregor. 1982. Backtrack search algorithms and the maximal common subgraph problem. Software: Practice and Experience 12, 1 (1982), 23--34.Google ScholarGoogle ScholarCross RefCross Ref
  17. Feng Ning, Damien Delhomme, Yann LeCun, Fabio Piano, L´eon Bottou, and Paolo Emilio Barbano. 2005. Toward automatic phenotyping of developing embryos from videos. IEEE Transactions on Image Processing 14, 9 (2005), 1360--1371. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Siu-hang Or, Kin-Hong Wong, Ying-kin Yu, Michael Ming-yuan Chang, and H Kong. 2005. Highly automatic approach to architectural floorplan image understanding & model generation. Pattern Recognition (2005), 25--32.Google ScholarGoogle Scholar
  19. Bryan C Russell, Antonio Torralba, Kevin P Murphy, and William T Freeman. 2008. LabelMe: a database and web-based tool for image annotation. International Journal of Computer Vision 77, 1--3 (2008), 157--173. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).Google ScholarGoogle Scholar
  21. Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE ConfGoogle ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Apartment Structure Estimation Using Fully Convolutional Networks and Graph Model

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader