Skip to main content
SpringerLink
Log in

OMLML: a helpful opinion mining method based on lexicon and machine learning in social networks

  • Original Paper
  • Published:
Social Network Analysis and Mining Aims and scope Submit manuscript

Abstract

Identification of users’ polarities and mining their opinions in various areas, especially social networks, has become one of the popular and useful research fields. Although opinion mining and analyzing methods based on machine learning or lexicon have been useful, high training cost based on time or memory used, lack of enriched and complete lexicons, high dimensions of feature space and ambiguity in positive or negative detection of some sentences in these methods are examples of their downsides. To cope with these problems, in this paper a helpful method based on lexicon and machine learning called OMLML is proposed by using social networks. The main superiority of the proposed method compared to other methods is addressing these challenges simultaneously. According to the proposed method, the polarity of the opinions toward a target word is first determined using a method based on lexicon and textual features of words and sentences. Next, having mapped feature space into a 3-D vector, opinions are analyzed and classified based on a new machine learning method. The results of quantitative and qualitative experiments show that mapping data into a new space decreases training cost and that the performance of the proposed method than is acceptable particularly from the perspective of accuracy, F-measure and runtime.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Akhmedova S, Semenkin E, Stanovov V (2018) Co-operation of biology related algorithms for solving opinion mining problems by using different term weighting schemes. In: Madani K, Peaucelle D, Gusikhin O (eds) Informatics in control, automation and robotics. Springer, Cham, pp 73–90

    Google Scholar 

  • Akter S, Aziz MT (2016) Sentiment analysis on Facebook group using lexicon based approach. In: 3rd international conference on electrical engineering and information communication technology (ICEEICT). IEEE, New York, pp 1–4

  • Al-Ayyoub M, Essa SB, Alsmadi I (2015) Lexicon-based sentiment analysis of Arabic tweets. Int J Soc Netw Min 2(2):101–114

    Google Scholar 

  • Ali F, Kim EK, Kim YG (2015) Type-2 fuzzy ontology-based opinion mining and information extraction: a proposal to automate the hotel reservation system. Appl Intell 42(3):481–500

    Google Scholar 

  • Anjaria M, Guddeti RMR (2014) A novel sentiment analysis of social networks using supervised learning. Soc Netw Anal Min 4(1):181

    Google Scholar 

  • Bhatnagar V, Goyal M, Hussain MA (2018) A novel aspect based framework for tourism sector with improvised aspect and opinion mining algorithm. Int J Rough Sets Data Anal (IJRSDA) 5(2):119–130

    Google Scholar 

  • Bhattacharyya S, Jha S, Tharakunnel K, Westland JC (2011) Data mining for credit card fraud: a comparative study. Decis Support Syst 50(3):602–613

    Google Scholar 

  • Bland JM, Altman DG (2000) The odds ratio. BMJ 320(7247):1468

    Google Scholar 

  • Blitzer J, Dredze M, Pereira F (2007) Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. In: Proceedings of the 45th annual meeting of the association of computational linguistics, pp 440–447

  • Cambria E, Hussain A (2012) Sentic computing: techniques, tools, and applications, vol 2. Springer, Berlin

    Google Scholar 

  • Chen L, Qi L (2011) Social opinion mining for supporting buyers’ complex decision making: exploratory user study and algorithm comparison. Soc Netw Anal Min 1(4):301–320

    Google Scholar 

  • Cho SH, Kang HB (2012) Statistical text analysis and sentiment classification in social media. In: IEEE international conference on systems, man, and cybernetics (SMC). IEEE, New York, pp 1112–1117

  • Cui A, Zhang M, Liu Y, Ma S (2011) Emotion tokens: bridging the gap among multilingual twitter sentiment analysis. In: Asia information retrieval symposium. Springer, Berlin, pp 238–249

  • Ding X, Liu B, Yu PS (2008) A holistic lexicon-based approach to opinion mining. In: Proceedings of the 2008 international conference on web search and data mining. ACM, New York, pp 231–240

  • Dragoni M (2018) Computational advertising in social networks: an opinion mining-based approach. In: Proceedings of the 33rd annual ACM symposium on applied computing. ACM, New York, pp 1798–1804

  • Eisenstein J (2017) Unsupervised learning for lexicon-based classification. In: Proceedings of the 31st AAAI conference on artificial intelligence I, pp 3188–3194

  • Fullér R (1995) Neural fuzzy systems. CiteSeerX, London

    Google Scholar 

  • Grenoble J (2007) Actes de l’atelier deft’07, plate-forme afia 2007. http://deft07.limsi.fr/actes.php

  • Hourali M, Montazer GA (2010) An intelligent approach for constructing domain ontology using Art2 neural network and c-value method. Comput Eng Syst Appl 2:79–88

    Google Scholar 

  • Imani MB, Keyvanpour MR, Azmi R (2013) A novel embedded feature selection method: a comparative study in the application of text categorization. Appl Artif Intell 27(5):408–427

    Google Scholar 

  • Jeong Y, Kim S, Yoon B (2018) An algorithm for supporting decision making in stock investment through opinion mining and machine learning. In: 2018 Portland international conference on management of engineering and technology (PICMET). IEEE, New York, pp 1–10

  • Kaiser C, Bodendorf F (2009) Opinion and relationship mining in online forums. In: IEEE/WIC/ACM international joint conferences on web intelligence and intelligent agent technologies, WI-IAT’09, vol 1. IEEE, New York, pp 128–131

  • Kang M, Ahn J, Lee K (2018) Opinion mining using ensemble text hidden markov models for text classification. Expert Syst Appl 94:218–227

    Google Scholar 

  • Karami A, Bennett LS, He X (2018) Mining public opinion about economic issues: Twitter and the us presidential election. Int J Strateg Decis Sci (IJSDS) 9(1):18–28

    Google Scholar 

  • Karimi Zandian Z, Keyvanpour M (2017) Systematic identification and analysis of different fraud detection approaches based on the strategy ahead. Int J Knowl Based Intell Eng Syst 21(2):123–134

    Google Scholar 

  • Karimi Zandian Z, Keyvanpour M (2018) MEFUASN: a helpful method to extract features using analyzing social network for fraud detection. J AI Data Min 7:213–224

    Google Scholar 

  • Kaur J, Saini JR (2014) Emotion detection and sentiment analysis in text corpus: a differential study with informal and formal writing styles. Int J Comput Appl 101(9):1–9

    Google Scholar 

  • Keyvanpour MR, Karimi Zandian Z, Abdolhosseini Z (2018) A useful framework for identification and analysis of different query expansion approaches based on the candidate expansion terms extraction methods. Int J Inf Sci Manag (IJISM) 16(2):19–42

    Google Scholar 

  • Khan K, Baharudin BB, Khan A et al (2009) Mining opinion from text documents: a survey. In: 3rd IEEE international conference on digital ecosystems and technologies, DEST’09. IEEE, New York, pp 217–222

  • Krishna BV, Pandey AK, Kumar AS (2018) Feature based opinion mining and sentiment analysis using fuzzy logic. In: Gurumoorthy S, Rao BNK, Gao XZ (eds) Cognitive science and artificial intelligence. Springer, Singapore, pp 79–89

    Google Scholar 

  • Kushwaha ML, Rathod MSD (2016) Opinion mining of customer reviews based on their score using machine learning techniques. Analysis 4:5

    Google Scholar 

  • Lee SW, Song YI, Lee JT, Han KS, Rim HC (2012) A new generative opinion retrieval model integrating multiple ranking factors. J Intell Inf Syst 38(2):487–505

    Google Scholar 

  • Li G, Liu F (2014) Sentiment analysis based on clustering: a framework in improving accuracy and recognizing neutral opinions. Appl Intell 40(3):441–452

    Google Scholar 

  • Lima ACE, de Castro LN, Corchado JM (2015) A polarity analysis framework for Twitter messages. Appl Math Comput 270:756–767

    MATH  Google Scholar 

  • Liu P, Joty S, Meng H (2015a) Fine-grained opinion mining with recurrent neural networks and word embeddings. In: Proceedings of the 2015 conference on empirical methods in natural language processing, pp 1433–1443

  • Liu Q, Gao Z, Liu B, Zhang Y (2015b) Automated rule selection for aspect extraction in opinion mining. IJCAI 15:1291–1297

    Google Scholar 

  • Lloret E, Balahur A, Gómez JM, Montoyo A, Palomar M (2012) Towards a unified framework for opinion retrieval, mining and summarization. J Intell Inf Syst 39(3):711–747

    Google Scholar 

  • Mishra BK, Sahoo AK, Misra R (2018) Recommendation for selecting smart village in India through opinion mining using big data analytics. In: Saini A, Nayak A, Vyas R (eds) ICT based innovations. Springer, Singapore, pp 105–112

    Google Scholar 

  • Missen MMS, Boughanem M, Cabanac G (2013) Opinion mining: reviewed from word to document level. Soc Netw Anal Min 3(1):107–125

    Google Scholar 

  • Montejo-Ráez A, Martínez-Cámara E, Martín-Valdivia MT, Urena-Lopez LA (2012) Random walk weighting over sentiwordnet for sentiment polarity detection on Twitter. In: Proceedings of the 3rd workshop in computational approaches to subjectivity and sentiment analysis. Association for Computational Linguistics, New York, pp 3–10

  • Mostafa MM (2018) Mining and mapping halal food consumers: a geo-located Twitter opinion polarity analysis. J Food Prod Mark 24(7):858–879

    Google Scholar 

  • Mudinas A, Zhang D, Levene M (2012) Combining lexicon and learning based approaches for concept-level sentiment analysis. In: Proceedings of the 1st international workshop on issues of sentiment discovery and opinion mining. ACM, New York, p 5

  • Najar D, Mesfar S (2017) Opinion mining and sentiment analysis for arabic on-line texts: application on the political domain. Int J Speech Technol 20(3):575–585

    Google Scholar 

  • Narayan R, Rout JK, Jena SK (2018) Review spam detection using opinion mining. In: Progress in intelligent computing techniques: theory, practice, and applications. Springer, Berlin, pp 273–279

  • Nuortimo K, Härkönen J (2018) Opinion mining approach to study media-image of energy production. Implications to public acceptance and market deployment. Renew Sustain Energy Rev 96:210–217

    Google Scholar 

  • Ortega-Bueno R, Medina-Pagola JE, Muñiz-Cuza CE, Rosso P (2018) Improving attitude words classification for opinion mining using word embedding. In: Iberoamerican congress on pattern recognition. Springer, Berlin, pp 971–982

  • Palanisamy P, Yadav V, Elchuri H (2013) Serendio: simple and practical lexicon based approach to sentiment analysis. In: 2nd joint conference on lexical and computational semantics (*SEM), proceedings of the 7th international workshop on semantic evaluation (SemEval 2013), vol 2, pp 543–548

  • Pang B, Lee L (2004) A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts. In: Proceedings of the 42nd annual meeting on association for computational linguistics. Association for Computational Linguistics, New York, p 271

  • Pang B, Lee L (2005) Exploiting class relationships for sentiment categorization with respect to rating scales. In: ACL, pp 115–124

  • Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 conference on empirical methods in natural language processing. Association for Computational Linguistics, New York, pp 79–86

  • Poecze F, Ebster C, Strauss C (2018) Social media metrics and sentiment analysis to evaluate the effectiveness of social media posts. Proc Comput Sci 130(C):660–666

    Google Scholar 

  • Poria S, Cambria E, Winterstein G, Huang GB (2014) Sentic patterns: dependency-based rules for concept-level sentiment analysis. Knowl Based Syst 69:45–63

    Google Scholar 

  • Poria S, Cambria E, Gelbukh A (2016) Aspect extraction for opinion mining with a deep convolutional neural network. Knowl Based Syst 108:42–49

    Google Scholar 

  • Powers DM (2011) Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation. J Mach Learn Technol 2:37–63

    Google Scholar 

  • Puri M, Du X, Varde AS, de Melo G (2018) Mapping ordinances and tweets using smart city characteristics to aid opinion mining. In: 2018 companion of the international world wide web conference. International World Wide Web Conferences Steering Committee, pp 1721–1728

  • Rahmani A, Chen A, Sarhan A, Jida J, Rifaie M, Alhajj R (2014) Social media analysis and summarization for opinion mining: a business case study. Soc Netw Anal Min 4(1):171

    Google Scholar 

  • Rathan M, Hulipalled VR, Venugopal K, Patnaik L (2018) Consumer insight mining: aspect based Twitter opinion mining of mobile phone reviews. Appl Soft Comput 68:765–773

    Google Scholar 

  • Reddy CS, Raju K (2009) An improved fuzzy approach for COCOMO’s effort estimation using Gaussian membership function. J Softw 4(5):452–459

    Google Scholar 

  • Rozi M, Mukhlash I, Kimura M et al (2018) Opinion mining on book review using CNN-L2-SVM algorithm. J Phys Conf Ser 974:012004

    Google Scholar 

  • Se S, Vinayakumar R, Kumar MA, Soman K (2016) Predicting the sentimental reviews in Tamil movie using machine learning algorithms. Indian J Sci Technol. https://doi.org/10.17485/ijst/2016/v9i45/106482

    Article  Google Scholar 

  • Shandilya SK, Jain S (2009) Automatic opinion extraction from web documents. In: International conference on computer and automation engineering, ICCAE’09. IEEE, New York, pp 351–355

  • Solanki VK, Cuong NHH, Lu ZJ (2019) Opinion mining: using machine learning techniques. In: Agrawal R, Gupta N (eds) Extracting knowledge from opinion mining. IGI Global, New York, pp 66–82

    Google Scholar 

  • Souza E, Santos D, Oliveira G, Silva A, Oliveira AL (2018) Swarm optimization clustering methods for opinion mining. In: Natural computing, pp 1–29 (Online published)

  • Taboada M, Brooke J, Tofiloski M, Voll K, Stede M (2011) Lexicon-based methods for sentiment analysis. Comput Linguist 37(2):267–307

    Google Scholar 

  • Takagi T, Sugeno M (1985) Fuzzy identification of systems and its applications to modeling and control. IEEE Trans Syst Man Cybern 15(1):116–132

    MATH  Google Scholar 

  • Tan SS, Na JC (2017) Mining semantic patterns for sentiment analysis of product reviews. In: International conference on theory and practice of digital libraries. Springer, Berlin, pp 382–393

  • Tan S, Wang Y, Cheng X (2008) Combining learn-based and lexicon-based techniques for sentiment detection without using labeled examples. In: Proceedings of the 31st annual international ACM SIGIR conference on research and development in information retrieval. ACM, New York, pp 743–744

  • Tudoran AA (2018) Why do internet consumers block ads? New evidence from consumer opinion mining and sentiment analysis. Internet Res 29:144–166

    Google Scholar 

  • Xia R, Zong C, Li S (2011) Ensemble of feature sets and classification algorithms for sentiment classification. Inf Sci 181(6):1138–1152

    Google Scholar 

  • Yang K, Cai Y, Huang D, Li J, Zhou Z, Lei X (2017) An effective hybrid model for opinion mining and sentiment analysis. In: IEEE international conference on big data and smart computing (BigComp). IEEE, New York, pp 465–466

  • Yun Y, Hooshyar D, Jo J, Lim H (2018) Developing a hybrid collaborative filtering recommendation system with opinion mining on purchase review. J Inf Sci 44(3):331–344

    Google Scholar 

  • Zainuddin N, Selamat A, Ibrahim R (2018) Hybrid sentiment classification on twitter aspect-based sentiment analysis. Appl Intell 48:1–15

    Google Scholar 

  • Zhang Z, Ye Q, Zhang Z, Li Y (2011) Sentiment classification of internet restaurant reviews written in cantonese. Expert Syst Appl 38(6):7674–7682

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Alzahra University, Tehran, Iran

    Mohammadreza Keyvanpour

  2. Data Mining Lab, Department of Computer Engineering, Alzahra University, Tehran, Iran

    Zahra Karimi Zandian

  3. Department of Computer Engineering, Islamic Azad University, Qazvin Branch, Qazvin, Iran

    Maryam Heidarypanah

Authors
  1. Mohammadreza Keyvanpour
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zahra Karimi Zandian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Maryam Heidarypanah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammadreza Keyvanpour.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations'' (in PDF at the end of the article below the references; in XML as a back matter article note).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Keyvanpour, M., Karimi Zandian, Z. & Heidarypanah, M. OMLML: a helpful opinion mining method based on lexicon and machine learning in social networks. Soc. Netw. Anal. Min. 10, 10 (2020). https://doi.org/10.1007/s13278-019-0622-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13278-019-0622-6

Keywords

Search

Navigation