STQ-Scheduler: A Secure and Throughput-Aware Deep Reinforcement Learning Framework for QoE-Driven Resource Scheduling in Distributed Video Streaming Systems
DOI:
https://doi.org/10.66238/fsrma114Keywords:
Deep Reinforcement Learning, Video Streaming, QoE Optimization, Distributed Training, Edge Computing, Resource Scheduling, Data Cleaning, TransformerAbstract
. With the rapid growth of large-scale video streaming services, cloud gaming, and edge-assisted media delivery, ensuring high Quality of Experience (QoE) under dynamic network conditions and heterogeneous edge infrastructures has become a critical challenge. In practical systems, issues such as burst traffic, cross-edge latency variability, and noisy or unsafe data streams often lead to suboptimal resource utilization and degraded user experience. Meanwhile, conventional rule-based schedulers and static data processing pipelines are unable to jointly address the challenges of efficient model training and adaptive resource allocation. To tackle these problems, this paper proposes STQ-Scheduler, a secure and throughput-aware deep reinforcement learning framework that integrates high-throughput data processing, Transformer-based QoE prediction, and Proximal Policy Optimization (PPO)-based resource scheduling. The framework incorporates real-time data cleaning, anomaly filtering, and online feature transformation to ensure data quality and prevent data processing from becoming a bottleneck in distributed training. Furthermore, a multi-objective reward function is designed to jointly optimize QoE, latency, throughput, and system cost, enabling adaptive scheduling decisions across distributed edge nodes. Experimental results demonstrate that STQ-Scheduler significantly outperforms baseline methods in distributed video streaming environments. Specifically, it reduces average latency from 215 ms to 162 ms and improves throughput from 910 req/s to 1075 req/s under normal workloads. Under burst conditions, it maintains over 1020 req/s while reducing SLA violation rates from 10.5% to 3.9%, confirming its robustness and effectiveness in QoE-driven resource scheduling.
References
[1] Mao, Hongzi, Ravi Netravali, and Mohammad Alizadeh. "Neural adaptive video streaming with pensieve." Proceedings of the conference of the ACM special interest group on data communication. 2017.
[2] Yin, Xiaoqi, Vyas Sekar, and Bruno Sinopoli. "Toward a principled framework to design dynamic adaptive streaming algorithms over HTTP." Proceedings of the 13th ACM Workshop on Hot Topics in Networks. 2014.
[3] Mao, Hongzi, et al. "Resource management with deep reinforcement learning." Proceedings of the 15th ACM workshop on hot topics in networks. 2016.
[4] Krishnan, S. Shunmuga, and Ramesh K. Sitaraman. "Video stream quality impacts viewer behavior: inferring causality using quasi-experimental designs." IEEE/ACM Transactions on Networking 21.6 (2013): 2001-2014.
[5] Abadi, Martín, et al. "{TensorFlow}: a system for {Large-Scale} machine learning." 12th USENIX symposium on operating systems design and implementation (OSDI 16). 2016.
[6] Paszke, Adam, et al. "Pytorch: An imperative style, high-performance deep learning library." Advances in neural information processing systems 32 (2019).
[7] Zaharia, Matei, et al. "Apache spark: a unified engine for big data processing." Communications of the ACM 59.11 (2016): 56-65.
[8] Goyal, Priya, et al. "Accurate, large minibatch sgd: Training imagenet in 1 hour." arXiv preprint arXiv:1706.02677 (2017).
[9] Narayanan, Deepak, et al. "PipeDream: Generalized pipeline parallelism for DNN training." Proceedings of the 27th ACM symposium on operating systems principles. 2019.
[10] Liu, Fei Tony, Kai Ming Ting, and Zhi-Hua Zhou. "Isolation forest." 2008 eighth ieee international conference on data mining. IEEE, 2008.
[11] Mirhoseini, Azalia, et al. "Device placement optimization with reinforcement learning." International conference on machine learning. PMLR, 2017.
[12] Song, Wen, et al. "Flexible job-shop scheduling via graph neural network and deep reinforcement learning." IEEE Transactions on Industrial Informatics 19.2 (2022): 1600-1610.
[13] Li, Tianran, Hanwu Li, and Yutong Zhou. "E-commerce Sentiment Analysis Using Fine-tuned LLaMA3 Models: A QLoRA-based Approach." Journal of Technology Innovation and Engineering 1.4 (2025).
[14] Yao, Yilin, Wenchao Zhang, and Mengtong Li. "Cloud-Edge Federated Incremental Learning Framework for PMSM Efficiency Optimization with Lightweight CNN-LSTM Models and OTA Differential Deployment." Journal of Computer Science and Frontier Technologies 3.1 (2026): 98-111.
[15] Zhong, Zhen, Shini Yang, and Liesheng Wei. "Privacy-enhanced federated learning via asynchronous aggregation and local differential perturbation." Third International Conference on Big Data, Computational Intelligence, and Applications (BDCIA 2025). Vol. 14128. SPIE, 2026.
[16] Li, YingHan, and TaoYu Zhu. "Dental-DPMNet: A Latent Disease Progression Modeling Network for Predicting Pulpitis and Periapical Disease Evolution Using Longitudinal Dental Imaging and Clinical Indicators." Journal of Computer Science and Frontier Technologies 3.2 (2026): 118-131.
[17] Gao, Ziyang, Yuanliang Qu, and Yi Han. "Cross-Lingual Sponsored Search via Dual-Encoder and Graph Neural Networks for Context-Aware Query Translation in Advertising Platforms." arXiv preprint arXiv:2510.22957 (2025).
[18] Xu, Chengde, Chongye Wang, and Zeyu Li. "H2-LBM: A Hierarchical Hybrid Deep Reinforcement Learning Framework for L7 Load Balancing and Global Traffic Scheduling in Multi-Cloud LLM Serving." Fundamental Scientific Reports in Multidisciplinary Areas 2.02 (2026): 97-108.
[19] Yao, Hanqing, Jixiang Ding, and Zifan Wang. "CloudPayGuard: Hardware-Aware Real-Time Fraud Detection for Cloud-Native Credit Systems with OoO CPU Microarchitecture Optimization." Journal of Computer Science and Frontier Technologies 3.2 (2026): 154-166.
[20] Zhong, Ziwen, and Yuheng Huang. "CRE-CNN-LSTM-XAI: An Explainable Deep Learning Framework for Risk Assessment of Real Estate Collateralized Financial Products." Journal of Computer Science and Frontier Technologies 3.1 (2026): 127-140.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Yi-Chun Chang, Minwei Jiang

This work is licensed under a Creative Commons Attribution 4.0 International License.
License Terms (Recommended – CC BY 4.0)
All articles published in Fundamental Scientific Reports in Multidisciplinary Areas are licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author(s) and source are properly cited. Users are allowed to copy, redistribute, remix, transform, and build upon the material for any purpose, including commercial use, as long as appropriate credit is given.
Authors retain copyright of their work while granting the journal the right of first publication. The journal provides immediate open access to its content on the principle that making research freely available supports a greater global exchange of knowledge.
For more information about this license, visit:
https://creativecommons.org/licenses/by/4.0/