Implementation of Diffusion Variational Autoencoder for Stock Price Prediction with the Integration of Historical and Market Sentiment Data

Ardisurya; Mia Rizkinia

doi:10.62146/ijecbe.v2i2.55

Authors

Ardisurya Universitas Indonesia
Mia Rizkinia Universitas Indonesia https://orcid.org/0000-0003-3197-1611

DOI:

https://doi.org/10.62146/ijecbe.v2i2.55

Keywords:

Diffusion Variation Autoencoder, Stock Price Prediction, Indonesia Stock Market, Sentiment Analysis, IndoBERT

Abstract

This study aims to predict stock prices using a Diffusion Variational Autoencoder (D-VAE) model that integrates technical data and market sentiment. Technical data is obtained from historical stock prices and trading volume, while sentiment data is derived from financial news analyzed using the IndoBERT model for sentiment classification. The research findings indicate that the integration of sentiment data in the D-VAE model enhances the accuracy of stock price predictions compared to a model that uses only technical data. Model evaluation is conducted using metrics such as Mean Squared Error (MSE), Mean Absolute Error (MAE), and R-squared (R²). The model with sentiment data integration has an MSE of 2753.204, MAE of 42.751, and R² of 0.94489, which are better than the model without sentiment data integration. This study demonstrates that the use of sentiment analysis can significantly contribute to improving stock price prediction performance using machine learning technology.

Author Biographies

Ardisurya, Universitas Indonesia

Department of Electrical Engineering, Faculty of Engineering, Universitas Indonesia, Depok, Indonesia

Mia Rizkinia, Universitas Indonesia

Department of Electrical Engineering, Faculty of Engineering, Universitas Indonesia, Depok, Indonesia

References

L. Owen and F. Oktariani. “SENN: Stock Ensemble-based Neural Network for Stock Market Prediction using Historical Stock Data and Sentiment Analysis”. In: 2020 International Conference on Data Science and Its Applications (ICoDSA). IEEE, 2020, pp. 1–7.

K. J. L. Koa et al. “Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Prediction”. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. ACM, 2023, pp. 1087–1096.

M. Al Ridhawi and H. Al Osman. “Stock Market Prediction from Sentiment and Financial Stock Data Using Machine Learning”. In: Proceedings of the Canadian Conference on Artificial Intelligence. 2023, pp. 1–6.

I. K. Nti, A. F. Adekoya, and B. A. Weyori. “A systematic review of fundamental and technical analysis of stock market predictions”. In: Artificial Intelligence Review (2020), pp. 3007–3057.

K. Priyanka. “The Study of Fundamental & Technical Analysis”. In: International Journal of Scientific Research in Engineering and Management (IJSREM) 6.5 (2022), pp. 1–20. DOI: 10.55041/IJSREM13093.

S. Zhong and D. B. Hitchcock. “S&P 500 Stock Price Prediction Using Technical, Fundamental and Text Data”. In: arXiv preprint arXiv:2108.10826 (2021), pp. 1–19.

Y. Han et al. “Technical Analysis in the Stock Market: A Review”. In: Journal of Financial Markets 33 (2021), pp. 2326–2377. URL: https://ssrn.com/abstract=3850494.

M. F. Dicle. “Candle charts for financial technical analysis”. In: The Stata Journal 19.1 (2019), pp. 200–209. DOI: 10.1177/1536867X19830918.

P. Oktaba and M. Grzywińska-Rąpca. “Modification of technical analysis indicators and increasing the rate of return on investment”. In: Central European Economic Journal 10.57 (2023), pp. 148–162. DOI: 10.2478/ceej-2023-0009.

A. Ratto et al. “Technical analysis and sentiment embeddings for market trend prediction”. In: Expert Systems with Applications 135 (2019), pp. 60–70. DOI: 10.1016/j.eswa.2019.06.014.

D. P. Kingma and M. Welling. Auto-Encoding Variational Bayes. 2022. arXiv: 1312.6114 [stat.ML].

Chao et al. “Denoising Likelihood Score Matching for Conditional Score-Based Data Generation”. In: International Conference on Learning Representations. 2022, pp. 1–24.

M. Napizahni. dewaweb. https://www.dewaweb.com/blog/nlp-adalah/. [Online]. June 2022.

F. Koto et al. “IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP”. In: Proceedings of the 28th International Conference on Computational Linguistics. 2020, pp. 1–14.