Browse > Article
http://dx.doi.org/10.22937/IJCSNS.2021.21.11.4

Sentiment Orientation Using Deep Learning Sequential and Bidirectional Models  

Alyamani, Hasan J. (Department of Information Systems, Faculty of Computing and Information Technology in Rabigh (FCITR), King Abdulaziz University)
Publication Information
International Journal of Computer Science & Network Security / v.21, no.11, 2021 , pp. 23-30 More about this Journal
Abstract
Sentiment Analysis has become very important field of research because posting of reviews is becoming a trend. Supervised, unsupervised and semi supervised machine learning methods done lot of work to mine this data. Feature engineering is complex and technical part of machine learning. Deep learning is a new trend, where this laborious work can be done automatically. Many researchers have done many works on Deep learning Convolutional Neural Network (CNN) and Long Shor Term Memory (LSTM) Neural Network. These requires high processing speed and memory. Here author suggested two models simple & bidirectional deep leaning, which can work on text data with normal processing speed. At end both models are compared and found bidirectional model is best, because simple model achieve 50% accuracy and bidirectional deep learning model achieve 99% accuracy on trained data while 78% accuracy on test data. But this is based on 10-epochs and 40-batch size. This accuracy can also be increased by making different attempts on epochs and batch size.
Keywords
Deep Learning; LSTM; CNN; Machine Learning; Supervised and Un-Supervised Learning;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Abbas, K. Ali Memon, and A. Aleem Jamali, "Multinomial Naive Bayes Classification Model for Sentiment Analysis," IJCSNS Int. J. Comput. Sci. Netw. Secur., vol. 19, no. 3, p. 62, 2019, [Online]. Available: http://paper.ijcsns.org/07_book/201903/20190310.pdf.
2 W. Y. and L. H. A. Wang S, Li D, Song X, "A feature selection method based on improved fisher's discriminant ratio for text sentiment classification," Expert Syst. Appl., vol. 38, no. 7, pp. 8696-8702., 2011.   DOI
3 D. Nguyen, K. Vo, D. Pham, M. Nguyen, and T. Quan, "A deep architecture for sentiment analysis of news articles," Adv. Intell. Syst. Comput., vol. 629, pp. 129-140, 2018, doi: 10.1007/978-3-319-61911-8_12.   DOI
4 S. Liao, J. Wang, R. Yu, K. Sato, and Z. Cheng, "CNN for situations understanding based on sentiment analysis of twitter data," Procedia Comput. Sci., vol. 111, pp. 376-381, 2017, doi: 10.1016/j.procs.2017.06.037.   DOI
5 P. Cen, K. Zhang, and D. Zheng, "Sentiment Analysis Using Deep Learning Approach," J. Artif. Intell., vol. 2, no. 1, pp. 17-27, 2020, doi: 10.32604/jai.2020.010132.   DOI
6 "https://www.kaggle.com." .
7 L. C. H. and C. H. Chen LS, "A neural network based approach for sentiment classification in the blogosphere.," J. Informetr., vol. 5, no. 2, pp. 313-322, 2011.   DOI
8 M. Hameed, F. Tahir, and M. A. Shahzad, "Empirical comparison of sentiment analysis techniques for social media," Int. J. Adv. Appl. Sci., vol. 5, no. 4, pp. 115-123, 2018.   DOI
9 B. Pang and L. Lee, "Opinion mining and sentiment analysis," Found. Trends Inf. Retr., vol. 2, no. 1-2, pp. 1-135, 2008, doi: 10.1561/1500000011.   DOI
10 S. Wang, D. Li, Y. Wei, and H. Li, "A Feature Selection Method Based on Fisher 's Discriminant Ratio for Text Sentiment Classification Suge," Springer-Verlag Berlin Heidelb., pp. 88-97, 2009.
11 J. Khairnar and M. Kinikar, "Sentiment Analysis Based Mining and Summarizing Using SVM-MapReduce," Int. J. Comput. Sci. Inf. Technol., vol. 5, no. 3, pp. 4081-4085, 2014.
12 A. See, "Natural Language Processing with Deep Learning: Natural Language Generation," pp. 1-39, 2019.
13 N. C. Dang, M. N. Moreno-Garcia, and F. De la Prieta, "Sentiment analysis based on deep learning: A comparative study," Electron., vol. 9, no. 3, 2020, doi: 10.3390/electronics9030483.   DOI
14 X. Ouyang, P. Zhou, C. H. Li, and L. Liu, "Sentiment analysis using convolutional neural network," Proc. - 15th IEEE Int. Conf. Comput. Inf. Technol. CIT 2015, 14th IEEE Int. Conf. Ubiquitous Comput. Commun. IUCC 2015, 13th IEEE Int. Conf. Dependable, Auton. Se, pp. 2359-2364, 2015, doi: 10.1109/CIT/IUCC/DASC/PICOM.2015.349.   DOI
15 A. Kumar, K. Srinivasan, W. H. Cheng, and A. Y. Zomaya, "Hybrid context enriched deep learning model for fine-grained sentiment analysis in textual and visual semiotic modality social data," Inf. Process. Manag., vol. 57, no. 1, 2020, doi: 10.1016/j.ipm.2019.102141.   DOI
16 N. Archak, A. Ghose, and P. G. Ipeirotis, "Show me the Money ! Deriving the Pricing Power of Product," Proc. 13th ACM SIGKDD Int. Conf. Knowl. Discov. data Min. - KDD '07, pp. 56-65, 2007, doi: 10.1145/1281192.1281202.   DOI
17 Q. Sun, J. Niu, Z. Yao, and H. Yan, "Exploring eWOM in online customer reviews: Sentiment analysis at a fine-grained level," Eng. Appl. Artif. Intell., vol. 81, pp. 68-78, 2019, doi: 10.1016/j.engappai.2019.02.004.   DOI
18 J. Jin, P. Ji, and R. Gu, "Identifying comparative customer requirements from product online reviews for competitor analysis," Eng. Appl. Artif. Intell., vol. 49, pp. 61-73, 2016, doi: 10.1016/j.engappai.2015.12.005.   DOI
19 F. e-M. K. Khan, B.B. Baharudin, A. Khan, "Mining opinion from text documents," Adv. Res. Comput. Commun. Eng., vol. 3, no. 7, pp. 217-222.
20 M. Z. Asghar, A. Khan, S. Ahmad, and F. M. Kundi, "A Review of Feature Extraction in Sentiment Analysis," J. Basic. Appl. Sci. Res, vol. 4, no. 3, pp. 181-186, 2014.
21 A. Esmin and S. Matwin, "Hierarchical Classification Approach to Emotion Recognition in Twitter Hierarchical Classification Approach to Emotion Recognition in Twitter," 2016, no. March, doi: 10.1109/ICMLA.2012.195.
22 M. Ahmad, S. Aftab, M. S. Bashir, N. Hameed, I. Ali, and Z. Nawaz, "SVM optimization for sentiment analysis," Int. J. Adv. Comput. Sci. Appl., vol. 9, no. 4, pp. 393-398, 2018, doi: 10.14569/IJACSA.2018.090455.   DOI
23 H. Du, X. Xu, X. Cheng, D. Wu, Y. Liu, and Z. Yu, "Aspect-Specific Sentimental Word Embedding for Sentiment Analysis of Online Reviews," Proc. 25th Int. Conf. Companion World Wide Web, pp. 29-30, 2016, doi: 10.1145/2872518.2889403.   DOI
24 Y. Chen and J. Xie, "Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix," Manage. Sci., vol. 54, no. 3, pp. 477-491, 2008, doi: 10.1287/mnsc.1070.0810.   DOI
25 B. Liu, "Sentiment Analysis and Opinion Mining," Synth. Lect. Hum. Lang. Technol., vol. 5, no. 1, pp. 1-167, 2012, doi: 10.2200/S00416ED1V01Y201204HLT016.   DOI
26 I. El Alaoui, Y. Gahi, R. Messoussi, Y. Chaabi, A. Todoskoff, and A. Kobi, "A novel adaptable approach for sentiment analysis on big social data," J. Big Data, vol. 5, no. 1, 2018, doi: 10.1186/s40537-018-0120-0.   DOI
27 D. Grabner, M. Zanker, G. Fliedl, and M. Fuchs, "Classification of Customer Reviews based on Sentiment Analysis," Inf. Commun. Technol. Tour. 2012, pp. 460-470, 2012, doi: 10.1007/978-3-7091-1142-0_40.   DOI
28 V. S. D. F. X. Christopher, "Evolving Trends in Conversational Systems with Natural Language Processing," Int. J. Comput. Intell. Informatics, vol. 8, no. 3, pp. 123-129, 2018.
29 K. Dashtipour, M. Gogate, A. Adeel, H. Larijani, and A. Hussain, "Sentiment analysis of persian movie reviews using deep learning," Entropy, vol. 23, no. 5, 2021, doi: 10.3390/e23050596.   DOI
30 Q. Tul et al., "Sentiment Analysis Using Deep Learning Techniques: A Review," Int. J. Adv. Comput. Sci. Appl., vol. 8, no. 6, 2017, doi: 10.14569/ijacsa.2017.080657.   DOI
31 Q. Shen, Z. Wang, and Y. Sun, "Sentiment analysis of movie reviews based on CNN-BLSTM," IFIP Adv. Inf. Commun. Technol., vol. 510, pp. 164-171, 2017, doi: 10.1007/978-3-319-68121-4_17.   DOI