A Comparison of the Effectiveness of Artificial Neural Network Models for Time Series Data Prediction

Authors

  • Umalkher S. Mohamed Computer Science Department, Education Faculty, Sebha University, Ghat, Libya.

DOI:

https://doi.org/10.37375/sjfssu.v3i2.1516

Keywords:

Stock prices, Prediction models, artificial neural network, Time series data.

Abstract

Stock market prediction has become an important area of research. Various methods have been used by researchers to forecast stock market price series. In recent developments, artificial intelligence (AI) methods have become one of the most popular techniques for forecasting financial time series. One of the AI methods that is commonly employed to solve various time series problems is artificial neural network (ANN). This article aims to present a comparative study to evaluate the performance of the three artificial neural network models, namely Back Propagation Neural Network (BPNN), Radial Basis Function Neural Network (RBFNN), and Long Short-Term Memory (LSTM) neural network in a problem of one-day ahead movement prediction of the USD exchange rate. The experiment was performed on the stock price of two companies,  namely Microsoft (MSFT) and Apple Inc. (AAPL). The performance of these models is compared using accuracy metrics, such as Mean Squared Error (MSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), and R Squared (R2) score values. Based on the results obtained, the LSTM forecasting model outperformed alternative models with a high degree of accuracy and was  found to be very efficient in learning time series data.

References

ABADI, M., BARHAM, P., CHEN, J., CHEN, Z., DAVIS, A., DEAN, J., DEVIN, M., GHEMAWAT, S., IRVING, G. & ISARD, M. {TensorFlow}: a system for {Large-Scale} machine learning. 12th USENIX symposium on operating systems design and implementation (OSDI 16), 2016. 265-283.

ADEBIYI, A. A., ADEWUMI, A. O. & AYO, C. K. 2014. Comparison of ARIMA and artificial neural networks models for stock price prediction. Journal of Applied Mathematics, 2014.

AKAIKE, H. 1969. Fitting autoregressive models for prediction. Annals of the institute of Statistical Mathematics, 21, 243-247.

ALFRED, R., OBIT, J. H., AHMAD HIJAZI, M. H. & AG IBRAHIM, A. A. 2015. A performance comparison of statistical and machine learning techniques in learning time series data. Advanced Science Letters, 21, 3037-3041.

BINKOWSKI, M., MARTI, G. & DONNAT, P. Autoregressive convolutional neural networks for asynchronous time series. International Conference on Machine Learning, 2018. PMLR, 580-589.

BOTUNAC, I., PANJKOTA, A. & MATETIC, M. The importance of time series data filtering for predicting the direction of stock market movement using neural networks. Proceedings of the 30th DAAAM International Symposium, 2019. 0886-0891.

CHEN, L., QIAO, Z., WANG, M., WANG, C., DU, R. & STANLEY, H. E. 2018. Which artificial intelligence algorithm better predicts the Chinese stock market? IEEE Access, 6, 48625-48633.

CHEN, T. & CHEN, H. 1995. Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems. IEEE Transactions on Neural Networks, 6, 911-917.

DOSTÁL, P. 2013. Forecasting of time series with fuzzy logic. Nostradamus 2013: Prediction, Modeling and Analysis of Complex Systems. Springer.

GERS, F. A., SCHMIDHUBER, J. & CUMMINS, F. 2000. Learning to forget: Continual prediction with LSTM. Neural computation, 12, 2451-2471.

GRODA, B. & VRBKA, J. Prediction of stock price developments using the Box-Jenkins method. SHS Web of Conferences, 2017. EDP Sciences, 01007.

GURESEN, E., KAYAKUTLU, G. & DAIM, T. U. 2011. Using artificial neural network models in stock market index prediction. Expert Systems with Applications, 38, 10389-10397.

HIRANSHA, M., GOPALAKRISHNAN, E. A., MENON, V. K. & SOMAN, K. 2018. NSE stock market prediction using deep-learning models. Procedia computer science, 132, 1351-1362.

HOCHREITER, S. & SCHMIDHUBER, J. 1997. Long short-term memory. Neural computation, 9, 1735-1780.

KETKAR, N. 2017. Introduction to keras. Deep learning with Python. Springer.

LEE, C.-C., CHUNG, P.-C., TSAI, J.-R. & CHANG, C.-I. 1999. Robust radial basis function neural networks. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 29, 674-685.

LIAO, Y., FANG, S.-C. & NUTTLE, H. L. 2003. Relaxed conditions for radial-basis function networks to be universal approximators. Neural Networks, 16, 1019-1028.

MANSOURI, A., NAZARI, A. & RAMAZANI, M. 2016. A comparison of artificial neural network model and logistics regression in prediction of companies’ bankruptcy (A case study of Tehran stock exchange). International Journal of Advanced Computer Research, 6.

MEHRSAI, A., KARIMI, H.-R., THOBEN, K.-D. & SCHOLZ-REITER, B. 2013. Application of learning pallets for real-time scheduling by the use of radial basis function network. Neurocomputing, 101, 82-93.

MOGHAR, A. & HAMICHE, M. 2020. Stock market prediction using LSTM recurrent neural network. Procedia Computer Science, 170, 1168-1173.

MOKHTARI, S., YEN, K. K. & LIU, J. 2021. Effectiveness of artificial intelligence in stock market prediction based on machine learning. arXiv preprint arXiv:2107.01031.

NABIPOUR, M., NAYYERI, P., JABANI, H., SHAHAB, S. & MOSAVI, A. 2020. Predicting stock market trends using machine learning and deep learning algorithms via continuous and binary data; a comparative analysis. IEEE Access, 8, 150199-150212.

NANDY, S., SARKAR, P. P. & DAS, A. 2012. An improved Gauss-Newtons method based back-propagation algorithm for fast convergence. arXiv preprint arXiv:1206.4329.

NAYAK, A., PAI, M. M. & PAI, R. M. 2016. Prediction models for Indian stock market. Procedia Computer Science, 89, 441-449.

NIKOU, M., MANSOURFAR, G. & BAGHERZADEH, J. 2019. Stock price prediction using DEEP learning algorithm and its comparison with machine learning algorithms. Intelligent Systems in Accounting, Finance and Management, 26, 164-174.

PARK, J. & SANDBERG, I. W. 1991. Universal approximation using radial-basis-function networks. Neural computation, 3, 246-257.

PENDHARKAR, P. C. 2011. A hybrid radial basis function and data envelopment analysis neural network for classification. Computers & Operations Research, 38, 256-266.

QU, Y. & ZHAO, X. Application of LSTM neural network in forecasting foreign exchange price. Journal of Physics: Conference Series, 2019. IOP Publishing, 042036.

RAMESH, V., BASKARAN, P., KRISHNAMOORTHY, A., DAMODARAN, D. & SADASIVAM, P. 2019. Back propagation neural network based big data analytics for a stock market challenge. Communications in Statistics-Theory and Methods, 48, 3622-3642.

ROUNAGHI, M. M. & ZADEH, F. N. 2016. Investigation of market efficiency and financial stability between S&P 500 and London stock exchange: monthly and yearly forecasting of time series stock returns using ARMA model. Physica A: Statistical Mechanics and its Applications, 456, 10-21.

ROUT, M., MAJHI, B. & MOHAPATRA, U. M. Efficient long range prediction of exchange rates using Radial Basis Function Neural Network models. IEEE-International Conference On Advances In Engineering, Science And Management (ICAESM-2012), 2012. IEEE, 530-535.

SHAH, D., ISAH, H. & ZULKERNINE, F. 2019. Stock market analysis: A review and taxonomy of prediction techniques. International Journal of Financial Studies, 7, 26.

SIAMI-NAMINI, S., TAVAKOLI, N. & NAMIN, A. S. A comparison of ARIMA and LSTM in forecasting time series. 2018 17th IEEE international conference on machine learning and applications (ICMLA), 2018. IEEE, 1394-1401.

SONG, Y.-G., ZHOU, Y.-L. & HAN, R.-J. 2018. Neural networks for stock price prediction. arXiv preprint arXiv:1805.11317.

TANG, Z., DE ALMEIDA, C. & FISHWICK, P. A. 1991. Time series forecasting using neural networks vs. Box-Jenkins methodology. Simulation, 57, 303-310.

TIWARI, R., SRIVASTAVA, S. & GERA, R. 2020. Investigation of artificial intelligence techniques in finance and marketing. Procedia Computer Science, 173, 149-157.

VIJH, M., CHANDOLA, D., TIKKIWAL, V. A. & KUMAR, A. 2020. Stock closing price prediction using machine learning techniques. Procedia computer science, 167, 599-606.

WILAMOWSKI, B. M., IPLIKCI, S., KAYNAK, O. & EFE, M. O. An algorithm for fast convergence in training neural networks. IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No. 01CH37222), 2001. Ieee, 1778-1782.

YANG, C.-X. & ZHU, Y.-F. Using genetic algorithms for time series prediction. 2010 Sixth International Conference on Natural Computation, 2010. IEEE, 4405-4409.

YETIS, Y., KAPLAN, H. & JAMSHIDI, M. Stock market prediction by using artificial neural network. 2014 world automation congress (WAC), 2014. IEEE, 718-722.

ZHANG, G. P. 2001. An investigation of neural networks for linear time-series forecasting. Computers & Operations Research, 28, 1183-1202.

Downloads

Published

2023-10-26

How to Cite

Mohamed, U. (2023). A Comparison of the Effectiveness of Artificial Neural Network Models for Time Series Data Prediction. Scientific Journal for Faculty of Science-Sirte University, 3(2), 18–28. https://doi.org/10.37375/sjfssu.v3i2.1516

Issue

Section

COMPUTER SCIENCES