Skip to main content
SpringerLink
Log in

Multi-class Review Rating Classification using Deep Recurrent Neural Network

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

This paper presents a gated-recurrent-unit (GRU) based recurrent neural network (RNN) architecture titled as DSWE-GRNN for multi-class review rating classification problem. Our model incorporates domain-specific word embeddings and does not depend on the reviewer’s information because we usually don’t have many reviews from the same user to measure the leniency of the user towards a specific sentiment. The RNN based architecture captures the hidden contextual information from the domain-specific word embeddings to effectively and efficiently train the model for review rating classification. In this work, we also demonstrate that downsampling technique for data balancing can be very effective for the model’s performance. We have evaluated our model over two datasets i.e IMDB dataset and the Hotel Reviews dataset. The results demonstrate that our model’s performance (accuracy) is comparable with or even better than the four baseline methods used for sentiment classification in literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Attia M, Samih Y, Elkahky A, Kallmeyer L (2018) Multilingual multi-class sentiment classification using convolutional neural networks. In: chair) NCC, Choukri K, Cieri C, Declerck T, Goggi S, Hasida K, Isahara H, Maegaard B, Mariani J, Mazo H, Moreno A, Odijk J, Piperidis S, Tokunaga T (eds) Proceedings of the eleventh international conference on language resources and evaluation (LREC 2018). European Language Resources Association (ELRA), Miyazaki, Japan

  2. Chen C, Zhang M, Liu Y, Ma S (2018) Neural attentional rating regression with review-level explanations. In: Proceedings of the 2018 World Wide Web conference on world wide web. International World Wide Web Conferences Steering Committee, pp 1583–1592

  3. Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint. arXiv:1406.1078

  4. Chung J, Gulcehre C, Cho K, Bengio Y (2014) Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint. arXiv:1412.3555

  5. Datafiniti (2017) Hotel reviews. Data retrieved from Kaggle. https://www.kaggle.com/datafiniti/hotel-reviews

  6. Dave K, Lawrence S, Pennock DM (2003) Mining the peanut gallery: opinion extraction and semantic classification of product reviews. In: Proceedings of the 12th international conference on World Wide Web. ACM, pp 519–528

  7. Deriu JM, Cieliebak M (2016) Sentiment analysis using convolutional neural networks with multi-task training and distant supervision on italian tweets. In: Fifth evaluation campaign of natural language processing and speech tools for Italian, Napoli, Italy, December 5–7, 2016, Italian Journal of Computational Linguistics

  8. Diao Q, Qiu M, Wu CY, Smola AJ, Jiang J, Wang C (2014) Jointly modeling aspects, ratings and sentiments for movie recommendation (jmars). In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 193–202

  9. dos Santos C, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: Technical Papers, pp 69–78

  10. Fan M, Khademi M (2014) Predicting a business star in yelp from its reviews text alone. arXiv preprint. arXiv:1401.0864

  11. Gao W, Yoshinaga N, Kaji N, Kitsuregawa M (2013) Modeling user leniency and product popularity for sentiment classification. In: Proceedings of the sixth international joint conference on natural language processing. pp 1107–1111

  12. Glorot X, Bordes A, Bengio Y (2011) Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th international conference on machine learning (ICML-11). pp 513–520

  13. Hong C, Yu J, Wan J, Tao D, Wang M (2015) Multimodal deep autoencoder for human pose recovery. IEEE Trans Image Process 24(12):5659–5670

    Google Scholar 

  14. Jiang A, Zubiaga A (2018) Leveraging aspect phrase embeddings for cross-domain review rating prediction. arXiv preprint. arXiv:1811.05689

  15. Jin Z, Li Q, Zeng DD, Zhan Y, Liu R, Wang L, Ma H (2016) Jointly modeling review content and aspect ratings for review rating prediction. In: Proceedings of the 39th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 893–896

  16. Johnson R, Zhang T (2014) Effective use of word order for text categorization with convolutional neural networks. arXiv preprint. arXiv:1412.1058

  17. Johnson R, Zhang T (2015) Semi-supervised convolutional neural networks for text categorization via region embedding. In: Advances in neural information processing systems, pp 919–927

  18. Kim Y (2014) Convolutional neural networks for sentence classification. arXiv preprint. arXiv:1408.5882

  19. Li F, Liu N, Jin H, Zhao K, Yang Q, Zhu X (2011) Incorporating reviewer and product information for review rating prediction. IJCAI 11:1820–1825

    Google Scholar 

  20. Li F, Wang S, Liu S, Zhang M (2014) Suit: a supervised user-item based topic model for sentiment analysis. AAAI 14:1636–1642

    Google Scholar 

  21. Li P, Wang Z, Ren Z, Bing L, Lam W (2017) Neural rating regression with abstractive tips generation for recommendation. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 345–354

  22. Liu B (2015) Sentiment analysis: mining opinions, sentiments, and emotions. Cambridge University Press, Cambridge

    Google Scholar 

  23. McAuley J, Leskovec J (2013) Hidden factors and hidden topics: understanding rating dimensions with review text. In: Proceedings of the 7th ACM conference on recommender systems. ACM, pp 165–172

  24. Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint. arXiv:1301.3781

  25. Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp 3111–3119

  26. Pang B, Lee L (2005) Seeing stars: exploiting class relationships for sentiment categorization with respect to rating scales. In: Proceedings of the 43rd annual meeting on association for computational linguistics. Association for Computational Linguistics, pp 115–124

  27. Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 conference on empirical methods in natural language processing-Vol 10. Association for Computational Linguistics, pp 79–86

  28. Pennington J, Socher R, Manning C (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). pp 1532–1543

  29. Poria S, Chaturvedi I, Cambria E, Hussain A (2016) Convolutional mkl based multimodal emotion recognition and sentiment analysis. In: 2016 IEEE 16th international conference on data mining (ICDM). IEEE, pp 439–448

  30. Qu L, Ifrim G, Weikum G (2010) The bag-of-opinions method for review rating prediction from sparse text patterns. In: Proceedings of the 23rd international conference on computational linguistics. Association for Computational Linguistics, pp 913–921

  31. Rong X (2014) word2vec parameter learning explained. arXiv preprint. arXiv:1411.2738

  32. Seo S, Huang J, Yang H, Liu Y (2017) Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Proceedings of the eleventh ACM conference on recommender systems. ACM, pp 297–305

  33. Severyn A, Moschitti A (2015) Learning to rank short text pairs with convolutional deep neural networks. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 373–382

  34. Severyn A, Moschitti A (2015) Twitter sentiment analysis with deep convolutional neural networks. In: Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval. ACM, pp 959–962

  35. Sidarenka U (2017) Potts at germeval-2017 task b: document-level polarity detection using hand-crafted svm and deep bidirectional lstm network. Shared task on aspect-based sentiment in social media customer feedback, p 49

  36. Socher R, Perelygin A, Wu J, Chuang J, Manning CD, Ng A, Potts C (2013) Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 conference on empirical methods in natural language processing. pp 1631–1642

  37. Sundermeyer M, Schlüter R, Ney H (2012) Lstm neural networks for language modeling. In: Thirteenth annual conference of the international speech communication association

  38. Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint. arXiv:1503.00075

  39. Tan C, Lee L, Tang J, Jiang L, Zhou M, Li P (2011) User-level sentiment analysis incorporating social networks. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1397–1405

  40. Tang D, Wei F, Qin B, Zhou M, Liu T (2014) Building large-scale twitter-specific sentiment lexicon: a representation learning approach. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: Technical Papers, pp 172–182

  41. Tang D, Qin B, Liu T (2015) Document modeling with gated recurrent neural network for sentiment classification. In: Proceedings of the 2015 conference on empirical methods in natural language processing. pp 1422–1432

  42. Tang D, Qin B, Liu T (2015) Learning semantic representations of users and products for document level sentiment classification. In: Proceedings of the 53rd annual meeting of the Association for Computational Linguistics and the 7th international joint conference on natural language processing (Volume 1: Long Papers), vol 1, pp 1014–1023

  43. Tang D, Qin B, Liu T, Yang Y (2015) User modeling with neural network for review rating prediction. In: IJCAI. pp 1340–1346

  44. Turney PD (2002) Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the 40th annual meeting on association for computational linguistics. Association for Computational Linguistics, pp 417–424

  45. Wang J, Yu LC, Lai KR, Zhang X (2016) Dimensional sentiment analysis using a regional cnn-lstm model. In: Proceedings of the 54th annual meeting of the Association for Computational Linguistics (Volume 2: Short Papers), vol 2, pp 225–230

  46. Wang B, Xiong S, Huang Y, Li X (2018) Review rating prediction based on user context and product context. Appl Sci 8(10):1849

    Google Scholar 

  47. Xu L, Liu K, Zhao J (2014) Joint opinion relation detection using one-class deep neural network. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: Technical Papers, pp 677–687

  48. Yu A, Chang D. Multiclass sentiment prediction using yelp business. https://cs224d.stanford.edu/reports/YuApril.pdf

  49. Yu H, Hatzivassiloglou V (2003) Towards answering opinion questions: separating facts from opinions and identifying the polarity of opinion sentences. In: Proceedings of the 2003 conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 129–136

  50. Yu J, Kuang Z, Zhang B, Zhang W, Lin D, Fan J (2018) Leveraging content sensitiveness and user trustworthiness to recommend fine-grained privacy settings for social image sharing. IEEE Trans Inf Forensics Secur 13(5):1317–1332

    Google Scholar 

  51. Yu Z, Yu J, Xiang C, Fan J, Tao D (2018) Beyond bilinear: generalized multimodal factorized high-order pooling for visual question answering. IEEE Trans Neural Netw Learn Syst 29(12):5947–5959

    Google Scholar 

  52. Zhang W, Yuan Q, Han J, Wang J (2016) Collaborative multi-level embedding learning from reviews for rating prediction. In: IJCAI. pp 2986–2992

  53. Zhang J, Yu J, Tao D (2018) Local deep-feature alignment for unsupervised dimension reduction. IEEE Trans Image Process 27(5):2420–2432

    Google Scholar 

Download references

Acknowledgements

Authors are thankful to their institution (Department of Computer Science at Hafiz Hayat Campus, University of Gujrat, Gujrat, Pakistan) for providing us the platform for conducting the research and analysis.

Author information

Authors and Affiliations

  1. Department of Computer Science, Faculty of Computing and Information Technology, University of Gujrat, Gujrat, Pakistan

    Junaid Hassan & Umar Shoaib

Authors
  1. Junaid Hassan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Umar Shoaib
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Junaid Hassan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hassan, J., Shoaib, U. Multi-class Review Rating Classification using Deep Recurrent Neural Network. Neural Process Lett 51, 1031–1048 (2020). https://doi.org/10.1007/s11063-019-10125-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-019-10125-6

Keywords

Search

Navigation