Uni-FinLLM: A Unified Multimodal Large Language Model with Modular Task Heads for Micro-Level Stock Prediction and Macro-Level Systemic Risk Assessment

Authors

  • Gongao Zhang China University of Geosciences, Wuhan, China
  • Haijiang Zeng Walmart Inc., Bentonville, AR , USA
  • Lu Jiang Fordham University, New York, NY, USA

DOI:

https://doi.org/10.66238/fsrma82

Keywords:

Multimodal Large Language Models, Financial Risk Prediction, Systemic Risk, Stock Forecasting, Multimodal Fusion, Unified Financial Intelligence, National Financial Risk Control

Abstract

Financial institutions and national regulatory bodies increasingly require decision-support systems capable of integrating heterogeneous data sources to evaluate risks ranging from micro-level stock fluctuations to macro-level systemic vulnerabilities. However, existing approaches often treat these tasks in isolation, limiting their ability to capture cross-scale financial dependencies. To address this challenge, we propose Uni-FinLLM, a unified multimodal large language model that employs a shared Transformer-based backbone and modular task heads to jointly process textual financial news, numerical market time series, corporate fundamentals, and visual representations of financial dynamics. This architecture enables collaborative modeling of multiple financial layers, supporting applications such as institutional investment decision-making, credit-risk supervision, and national systemic-risk early warning. Through cross-modal attention fusion and multi-task optimization, Uni-FinLLM learns a coherent financial representation space from which micro-, meso-, and macro-level predictions can be derived. We evaluate the model using three complementary datasets covering stock-level forecasting, corporate credit-risk assessment, and macroeconomic stress detection. Experimental evaluations across three major financial tasks confirm the effectiveness of the proposed unified architecture. On the micro-level stock prediction benchmark, Uni-FinLLM raises directional accuracy from 61.7% (Llama-Fin baseline) to 67.4%, while reducing MAPE to 10.9 and improving the hit ratio to 64.3%. For credit-risk prediction, the model boosts accuracy from 79.6% to 84.1% and increases ROC-AUC to 0.892, substantially outperforming traditional machine-learning and financial-language-model baselines. At the macro level, Uni-FinLLM achieves an early-warning accuracy of 82.3% and a crisis-F1 score of 79.8%, exceeding the leading GNN-based macro-risk model by a significant margin. Together, these results validate that a unified multimodal LLM equipped with modular task heads can jointly model micro-scale asset behavior and macro-scale systemic vulnerabilities, offering a practical and scalable decision-support engine for financial institutions and national regulators.

References

[1] Ding X, Zhang Y, Liu T, et al. Deep learning for event-driven stock prediction[C]//Ijcai. 2015, 15: 2327-2333.

[2] Xu Y, Cohen S B. Stock movement prediction from tweets and historical prices[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2018: 1970-1979.

[3] Huang A H, Wang H, Yang Y. FinBERT: A large language model for extracting information from financial text[J]. Contemporary Accounting Research, 2023, 40(2): 806-841.

[4] Xiong K, Ding X, Du L, et al. Heterogeneous graph knowledge enhanced stock market prediction[J]. AI Open, 2021, 2: 168-174.

[5] Rennick I. Temporal-Graph Deep Networks for Stock Market Forecasting and Volatility Analysis[J]. Practical Advances in Artificial Intelligence and Computing, 2025, 1(2).

[6] Xu, Shuming, Lu Jiang, and Boping Gu. "Design and Validation of a Smart Neuromorphic System Architecture for Algorithmic Trading." Proceedings of the 2nd International Symposium on Integrated Circuit Design and Integrated Systems. 2025.

[7] Tobias A, Brunnermeier M K. CoVaR[J]. The American Economic Review, 2016, 106(7): 1705.

[8] Allen F, Carletti E. Systemic risk and macroprudential regulation[M]//Risk and EU law. Edward Elgar Publishing, 2015: 197-219.

[9] Battiston S, Puliga M, Kaushik R, et al. Debtrank: Too central to fail? financial networks, the fed and systemic risk[J]. Scientific reports, 2012, 2(1): 541.

[10] Lin S L, Jin X. Does ESG predict systemic banking crises? A computational economics model of early warning systems with interpretable multi-variable LSTM based on mixture attention[J]. Mathematics, 2023, 11(2): 410.

[11] Liu X Y, Wang G, Yang H, et al. Fingpt: Democratizing internet-scale data for financial large language models[J]. arXiv preprint arXiv:2307.10485, 2023.

[12] Wu S, Irsoy O, Lu S, et al. Bloomberggpt: A large language model for finance[J]. arXiv preprint arXiv:2303.17564, 2023.

[13] Park H, Lee J, Oh H. FinTab-LLaVA: Finance Domain-Specific Table Understanding Multimodal LLM Using FinTMD[C]//Pacific-Asia Conference on Knowledge Discovery and Data Mining. Singapore: Springer Nature Singapore, 2025: 235-246.

[14] Li, Xinyu, Zhenghang Li, and Xinning Lin. "Automated Implementation of Machine Learning-Based Causal Inference in Product Operations Decision Making." Proceedings of the 2nd International Symposium on Integrated Circuit Design and Integrated Systems. 2025.

[15] Luo, Ruihan, Jinlin Hu, and Qingyu Sun. "Group Anomaly Detection and Risk Control of Commodity Sales Volume Data Based on LSTM-VAE Framework." Journal of Computer, Signal, and System Research 2.7 (2025): 48-57.

[16] Jiang, Gaozhe, et al. "Investment advisory robotics 2.0: Leveraging deep neural networks for personalized financial guidance." 2025 International Joint Conference on Neural Networks (IJCNN). IEEE, 2025.

Toor, M. J., Shabbir, S., Rauf, A., Nisar, A., Safdar, S., & Zaib-Un-Nisa. (n.d.). The role of structured-communication-technique in developing pragmatic language capability among ASD-children. https://doi.org/10.63878/cjssr.v3i2.785

Toor, M. J., Mehmood, H., Yasmeen, A., Honey, Q., Waseem, M., & Wasif, M. (n.d.). Exploring the effect of verbal encouraging phrases (VEP) on Chinese language learners’ academic achievement at university level.

Toor, M. J., Arafat, M., Ayoub, M., Ali, M., & Alessi Longa, F. E. (n.d.). From coherent self to fragmented persona: Digital identity fragmentation and academic self-concept among Generation Z, with comparative insights from Generation Alpha. https://doi.org/10.63878/cjssr.v4i2.2318

Katsitadze, N., Kharadze, N., & Pirtskhalaishvili, D. (2025). The impact of social media on students’ effective time management. Baltic Journal of Economic Studies, 11(1), 200–210. https://doi.org/10.30525/2256-0742/2025-11-1-200-210

Toor, M. J., Zafar, S., Omer, F., Sarwar, M., & Hussain, A. K. (n.d.). Teachers’ perspectives on effectiveness of translanguaging in enhancing English language learning at secondary school level.

Downloads

Published

2026-05-25