Abstract
Service-Oriented Architecture (SOA) is a new paradigm for integrating distributed software, especially e-Business application. It is essential to exchange reliable data between services. In this paper, we propose a methodology for detecting and cleansing dirty data between services, which is different from cleansing static and large data on database systems. We also develop a data cleansing service based on SOA. The service for cleansing interacting data makes it possible to improve the quality of services and to manage data effectively for a variety of SOA-based applications. As an empirical study, we applied this service to clean dirty data between CRM and ERP services and showed that the dirty data rate could be reduced by more than 30%.
This work was partially supported by Grant No.R04-2003-000-10139-0 from the Basic Research Program of the Korea Science & Engineering Foundation.
This work was partially supported by University IT Research Center Project.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Lee, G., Lee, G.C.: Standardization Trend and Development Direction of Web Services. Database Research Journals of KISS 19(1), 80–87 (2003.3)
Papazoglou, M.P., Georgakopoulos, D.: Service-Oriented Computing. Communication of the ACM 46(10), 25–28 (2003)
Johnson, T., Dasu, T.: Data Quality and Data Cleaning. In: Tutorials of 10th SIGKDD (2004)
Dasu, T., Johnson, T., Muthukrishnan, S., Shkapenyuk, V.: Mining Data Structure; Or, How to Build a Data Quality Browser. In: Proceedings of SIGMOD Conf., pp. 240–251 (2002)
Hernandez, M., Stolfo, S.: Real-world data is dirty: data cleansing and the merge/purge problem. Data Mining and Knowledge Discovery 2(1), 9–37 (1998)
Lee, M., Lu, H., Ling, T., Ko, Y.: Cleansing Data for Mining and Warehousing. In: Proceedings of 10th DEXA (1999)
Hernandez, M., Miller, R., Hass, L.: Schema Mappings as Query Discovery. In: Proceedings of Intl. Conf. VLDB (2001)
Breunig, M.M., Kriegel, H.-P., Ng, R., Sander, J.: LOF: Identifying Density-Based Local Outliers. In: Proceedings of SIGMOD Conf. (2000)
Kim, W., Choi, B., Hong, E.-K., Kim, S.-K., Lee, D.: A Taxonomy of Dirty Data. The Data Mining and Knowledge Discovery Journal 7(1), 81–99 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, JW., Moon, E., Choi, B. (2005). Data Cleansing for Service-Oriented Architecture . In: Bauknecht, K., Pröll, B., Werthner, H. (eds) E-Commerce and Web Technologies. EC-Web 2005. Lecture Notes in Computer Science, vol 3590. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11545163_9
Download citation
DOI: https://doi.org/10.1007/11545163_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28467-3
Online ISBN: 978-3-540-31736-4
eBook Packages: Computer ScienceComputer Science (R0)