(7PAM2002: Data Science Master’s Project)
This project aims to perform aspect-based sentiment analysis on customer reviews of mobile phones from Flipkart. The primary objective is to classify sentiments and extract insights using advanced AI techniques.
Owned by:
Name: Vullinkala Ratan Srivasthava Reddy
Student ID: 22031426
UNIVERSITY OF HERTFORDSHIRE
Cleaning:
Tokenization:
Text Normalization:
Balancing:
Three models were trained and evaluated for aspect-based sentiment analysis:
These models were trained using different hyperparameter configurations, as detailed below.
LSTM_hparam1 (Default Hyperparameters)
LSTM_hparam2
LSTM_hparam3
BiLSTM_hparam1, BiLSTM_hparam2, BiLSTM_hparam3
These hyperparameters mirror the LSTM model configurations but with bidirectional LSTM layers for enhanced learning of sequence patterns.
Enhanced BiLSTM_hparam1, Enhanced BiLSTM_hparam2, Enhanced BiLSTM_hparam3
Enhanced models include dropout and L2 regularization techniques to prevent overfitting and improve generalization.
| Model | Accuracy (%) | Precision | Recall | F1 Score | ROC-AUC |
|---|---|---|---|---|---|
| LSTM (H_param1) | 91.0 | 0.91 | 0.94 | 0.94 | 0.95 |
| BiLSTM (H_param1) | 89.0 | 0.89 | 0.93 | 0.92 | 0.94 |
| Enhanced BiLSTM (H_param1) | 89.0 | 0.89 | 0.94 | 0.92 | 0.94 |
| LSTM (H_param2) | 91.0 | 0.91 | 0.94 | 0.94 | 0.95 |
| BiLSTM (H_param2) | 89.0 | 0.89 | 0.93 | 0.92 | 0.94 |
| Enhanced BiLSTM (H_param2) | 90.0 | 0.90 | 0.93 | 0.93 | 0.94 |
| LSTM (H_param3) | 91.0 | 0.91 | 0.94 | 0.94 | 0.95 |
| BiLSTM (H_param3) | 89.0 | 0.89 | 0.94 | 0.93 | 0.94 |
| Enhanced BiLSTM (H_param3) | 89.0 | 0.89 | 0.95 | 0.93 | 0.94 |
Table 4.1: Model Performance Comparison
This table summarizes the performance of LSTM, BiLSTM, and Enhanced BiLSTM models across different hyperparameter configurations. LSTM consistently achieved the highest accuracy, precision, recall, and F1 scores, with an overall strong ROC-AUC of 0.95.
The project demonstrated the effective use of advanced AI techniques for aspect-based sentiment analysis on mobile phone reviews. LSTM outperformed other models in terms of overall performance across various metrics. However, Enhanced BiLSTM also showed promising results in terms of recall for the positive class. The findings suggest that LSTM is the best model for sentiment analysis in this case, and it can be further fine-tuned for even better performance. This approach not only aids in understanding customer sentiments but can also be leveraged for making data-driven decisions in the mobile phone e-commerce sector.
15 commits
Jupyter Notebook
100.0%
(7PAM2002: Data Science Master’s Project)
This project aims to perform aspect-based sentiment analysis on customer reviews of mobile phones from Flipkart. The primary objective is to classify sentiments and extract insights using advanced AI techniques.
Owned by:
Name: Vullinkala Ratan Srivasthava Reddy
Student ID: 22031426
UNIVERSITY OF HERTFORDSHIRE
Cleaning:
Tokenization:
Text Normalization:
Balancing:
Three models were trained and evaluated for aspect-based sentiment analysis:
These models were trained using different hyperparameter configurations, as detailed below.
LSTM_hparam1 (Default Hyperparameters)
LSTM_hparam2
LSTM_hparam3
BiLSTM_hparam1, BiLSTM_hparam2, BiLSTM_hparam3
These hyperparameters mirror the LSTM model configurations but with bidirectional LSTM layers for enhanced learning of sequence patterns.
Enhanced BiLSTM_hparam1, Enhanced BiLSTM_hparam2, Enhanced BiLSTM_hparam3
Enhanced models include dropout and L2 regularization techniques to prevent overfitting and improve generalization.
| Model | Accuracy (%) | Precision | Recall | F1 Score | ROC-AUC |
|---|---|---|---|---|---|
| LSTM (H_param1) | 91.0 | 0.91 | 0.94 | 0.94 | 0.95 |
| BiLSTM (H_param1) | 89.0 | 0.89 | 0.93 | 0.92 | 0.94 |
| Enhanced BiLSTM (H_param1) | 89.0 | 0.89 | 0.94 | 0.92 | 0.94 |
| LSTM (H_param2) | 91.0 | 0.91 | 0.94 | 0.94 | 0.95 |
| BiLSTM (H_param2) | 89.0 | 0.89 | 0.93 | 0.92 | 0.94 |
| Enhanced BiLSTM (H_param2) | 90.0 | 0.90 | 0.93 | 0.93 | 0.94 |
| LSTM (H_param3) | 91.0 | 0.91 | 0.94 | 0.94 | 0.95 |
| BiLSTM (H_param3) | 89.0 | 0.89 | 0.94 | 0.93 | 0.94 |
| Enhanced BiLSTM (H_param3) | 89.0 | 0.89 | 0.95 | 0.93 | 0.94 |
Table 4.1: Model Performance Comparison
This table summarizes the performance of LSTM, BiLSTM, and Enhanced BiLSTM models across different hyperparameter configurations. LSTM consistently achieved the highest accuracy, precision, recall, and F1 scores, with an overall strong ROC-AUC of 0.95.
The project demonstrated the effective use of advanced AI techniques for aspect-based sentiment analysis on mobile phone reviews. LSTM outperformed other models in terms of overall performance across various metrics. However, Enhanced BiLSTM also showed promising results in terms of recall for the positive class. The findings suggest that LSTM is the best model for sentiment analysis in this case, and it can be further fine-tuned for even better performance. This approach not only aids in understanding customer sentiments but can also be leveraged for making data-driven decisions in the mobile phone e-commerce sector.
15 commits
Jupyter Notebook
100.0%