STQ-Scheduler: A Secure and Throughput-Aware Deep Reinforcement Learning Framework for QoE-Driven Resource Scheduling in Distributed Video Streaming Systems

Authors

  • Yi-Chun Chang University of California, Berkeley, Berkeley, CA, USA
  • Minwei Jiang Cornell University, Ithaca, NY, USA

DOI:

https://doi.org/10.66238/fsrma114

Keywords:

Deep Reinforcement Learning, Video Streaming, QoE Optimization, Distributed Training, Edge Computing, Resource Scheduling, Data Cleaning, Transformer

Abstract

. With the rapid growth of large-scale video streaming services, cloud gaming, and edge-assisted media delivery, ensuring high Quality of Experience (QoE) under dynamic network conditions and heterogeneous edge infrastructures has become a critical challenge. In practical systems, issues such as burst traffic, cross-edge latency variability, and noisy or unsafe data streams often lead to suboptimal resource utilization and degraded user experience. Meanwhile, conventional rule-based schedulers and static data processing pipelines are unable to jointly address the challenges of efficient model training and adaptive resource allocation. To tackle these problems, this paper proposes STQ-Scheduler, a secure and throughput-aware deep reinforcement learning framework that integrates high-throughput data processing, Transformer-based QoE prediction, and Proximal Policy Optimization (PPO)-based resource scheduling. The framework incorporates real-time data cleaning, anomaly filtering, and online feature transformation to ensure data quality and prevent data processing from becoming a bottleneck in distributed training. Furthermore, a multi-objective reward function is designed to jointly optimize QoE, latency, throughput, and system cost, enabling adaptive scheduling decisions across distributed edge nodes. Experimental results demonstrate that STQ-Scheduler significantly outperforms baseline methods in distributed video streaming environments. Specifically, it reduces average latency from 215 ms to 162 ms and improves throughput from 910 req/s to 1075 req/s under normal workloads. Under burst conditions, it maintains over 1020 req/s while reducing SLA violation rates from 10.5% to 3.9%, confirming its robustness and effectiveness in QoE-driven resource scheduling.

References

[1] Mao, Hongzi, Ravi Netravali, and Mohammad Alizadeh. "Neural adaptive video streaming with pensieve." Proceedings of the conference of the ACM special interest group on data communication. 2017.

[2] Yin, Xiaoqi, Vyas Sekar, and Bruno Sinopoli. "Toward a principled framework to design dynamic adaptive streaming algorithms over HTTP." Proceedings of the 13th ACM Workshop on Hot Topics in Networks. 2014.

[3] Mao, Hongzi, et al. "Resource management with deep reinforcement learning." Proceedings of the 15th ACM workshop on hot topics in networks. 2016.

[4] Krishnan, S. Shunmuga, and Ramesh K. Sitaraman. "Video stream quality impacts viewer behavior: inferring causality using quasi-experimental designs." IEEE/ACM Transactions on Networking 21.6 (2013): 2001-2014.

[5] Abadi, Martín, et al. "{TensorFlow}: a system for {Large-Scale} machine learning." 12th USENIX symposium on operating systems design and implementation (OSDI 16). 2016.

[6] Paszke, Adam, et al. "Pytorch: An imperative style, high-performance deep learning library." Advances in neural information processing systems 32 (2019).

[7] Zaharia, Matei, et al. "Apache spark: a unified engine for big data processing." Communications of the ACM 59.11 (2016): 56-65.

[8] Goyal, Priya, et al. "Accurate, large minibatch sgd: Training imagenet in 1 hour." arXiv preprint arXiv:1706.02677 (2017).

[9] Narayanan, Deepak, et al. "PipeDream: Generalized pipeline parallelism for DNN training." Proceedings of the 27th ACM symposium on operating systems principles. 2019.

[10] Liu, Fei Tony, Kai Ming Ting, and Zhi-Hua Zhou. "Isolation forest." 2008 eighth ieee international conference on data mining. IEEE, 2008.

[11] Mirhoseini, Azalia, et al. "Device placement optimization with reinforcement learning." International conference on machine learning. PMLR, 2017.

[12] Song, Wen, et al. "Flexible job-shop scheduling via graph neural network and deep reinforcement learning." IEEE Transactions on Industrial Informatics 19.2 (2022): 1600-1610.

[13] Li, Tianran, Hanwu Li, and Yutong Zhou. "E-commerce Sentiment Analysis Using Fine-tuned LLaMA3 Models: A QLoRA-based Approach." Journal of Technology Innovation and Engineering 1.4 (2025).

[14] Yao, Yilin, Wenchao Zhang, and Mengtong Li. "Cloud-Edge Federated Incremental Learning Framework for PMSM Efficiency Optimization with Lightweight CNN-LSTM Models and OTA Differential Deployment." Journal of Computer Science and Frontier Technologies 3.1 (2026): 98-111.

[15] Zhong, Zhen, Shini Yang, and Liesheng Wei. "Privacy-enhanced federated learning via asynchronous aggregation and local differential perturbation." Third International Conference on Big Data, Computational Intelligence, and Applications (BDCIA 2025). Vol. 14128. SPIE, 2026.

[16] Li, YingHan, and TaoYu Zhu. "Dental-DPMNet: A Latent Disease Progression Modeling Network for Predicting Pulpitis and Periapical Disease Evolution Using Longitudinal Dental Imaging and Clinical Indicators." Journal of Computer Science and Frontier Technologies 3.2 (2026): 118-131.

[17] Gao, Ziyang, Yuanliang Qu, and Yi Han. "Cross-Lingual Sponsored Search via Dual-Encoder and Graph Neural Networks for Context-Aware Query Translation in Advertising Platforms." arXiv preprint arXiv:2510.22957 (2025).

[18] Xu, Chengde, Chongye Wang, and Zeyu Li. "H2-LBM: A Hierarchical Hybrid Deep Reinforcement Learning Framework for L7 Load Balancing and Global Traffic Scheduling in Multi-Cloud LLM Serving." Fundamental Scientific Reports in Multidisciplinary Areas 2.02 (2026): 97-108.

[19] Yao, Hanqing, Jixiang Ding, and Zifan Wang. "CloudPayGuard: Hardware-Aware Real-Time Fraud Detection for Cloud-Native Credit Systems with OoO CPU Microarchitecture Optimization." Journal of Computer Science and Frontier Technologies 3.2 (2026): 154-166.

[20] Zhong, Ziwen, and Yuheng Huang. "CRE-CNN-LSTM-XAI: An Explainable Deep Learning Framework for Risk Assessment of Real Estate Collateralized Financial Products." Journal of Computer Science and Frontier Technologies 3.1 (2026): 127-140.

Downloads

Published

2026-07-30