Abstract
This paper presents an XML-based web data extraction method. This method translates web page into XML document, analyze XML document by using XPath/XSLT, discover web page data pattern and similarity by using XML clustering algorithm, construct XPath-based data extraction rule template. This method improves the robustness and versatility of web data extraction system. Experiment result shows that the data extraction method has high precision and is adaptive to web pages in different sites and with different structures.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ion, M., Steven, M., Craig, K.: A Hierarchical Wrapper Induction for Semi structured Information Sources. Autonomous Agents and Multi-Agent Systems 4(1-2) (1999)
Jussi, M., Jared, J.: Robust Web Data Extraction with XML Path Expressions. IBM Research Report (2002)
Shoubiao, T., Chao, X., Yuan, J.: Web Data Extraction System Based on Label Library. In: Proceedings of the 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery, vol. 7 (2009)
Wei, L., Xiaofeng, M., Weiyi, M.: ViDE: A Vision-Based Approach for Deep Web Data Extraction. IEEE Transactions on Knowledge and Data Engineering 22(3) (2010)
Arvind, A., Hector, G.-M.: Extracting structured data from web pages. In: Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data (2003)
Jussi, M.: Effective Web Data Extraction with Standard XML Technologies. In: Proceedings of the 10th International Conference on World Wide Web, Hong Kong (2001)
Yuan, W., David, J., De Witt, J., YiCai.: An Effective Change Detection Algorithm for XML Documents. In: Proceedings of the 19th International Conference on Data Engineering (2003)
Pan, Y.: Research on XML Documents Cluster. Information Journal 25(2) (2006)
Python chilkat, http://www.chilkatsoft.com/python.asp
Xu, J., Hou, K.: Autonomous Extract Information from Web Pages. Computer Engineering and Applications 14 (2005)
Ling, L., Calton, P., Wei, H.: XWRAP: An XML Enabled Wrapper Construction System for Web Information Sources. In: Proceedings of the 16th International Conference on Data Engineering, San Diego, California (2000)
Zhao, S., Chen, S., Deng, S.: Design and Implementation of Web Data Integration Wrapper Based on Rule Tree. Computer Technology and Development 16(6) (2006)
Qiang, H., Rui, C., Yanwei, P., Lei, Z.: From One Tree to a Forest: a Unified Solution for Structured Web Data Extraction. In: 34th International ACM SIGIR, pp. 775–784 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jia, R., Xu, S., Peng, C. (2012). XML-Based Web Data Pattern Discovery and Extraction. In: Liu, C., Wang, L., Yang, A. (eds) Information Computing and Applications. ICICA 2012. Communications in Computer and Information Science, vol 307. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34038-3_98
Download citation
DOI: https://doi.org/10.1007/978-3-642-34038-3_98
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34037-6
Online ISBN: 978-3-642-34038-3
eBook Packages: Computer ScienceComputer Science (R0)