The Time-Sensitive Networking Scheduling Algorithm Based on Q-learning

[1] Messenger J L, Time-Sensitive Networking: An Introduction [J]. IEEE Communications Standards Magazine, 2018, 2(2): 2933. DOI:10.1109/MCOMSTD. 2018.1700047. Messenger J L Time-Sensitive Networking: An Introduction [J] . IEEE Communications Standards Magazine , 2018 , 2 ( 2 ): 2933 . DOI: 10.1109/MCOMSTD.2018.1700047 . Open DOISearch in Google Scholar

[2] Farzaneh M H, Kugele S, Knoll A. A graphical modeling tool supporting automated schedule synthesis for time-sensitive networking [C]. In: 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), 2017: 1–8. Farzaneh M H Kugele S Knoll A. A graphical modeling tool supporting automated schedule synthesis for time-sensitive networking [C] . In: 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) , 2017 : 1 – 8 . Search in Google Scholar

[3] Oliver R S, Craciunas S S, Steiner W. IEEE 802.1Qbv Gate Control List Synthesis using Array Theory Encoding [C]//IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS). IEEE, 2018. DOI:10.1109/RTAS.2018.00008. Oliver R S Craciunas S S Steiner W. IEEE 802.1Qbv Gate Control List Synthesis using Array Theory Encoding [C]//IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS) . IEEE , 2018 . DOI: 10.1109/RTAS.2018.00008 . Open DOISearch in Google Scholar

[4] Pahlevan M, Obermaisser R. Genetic Algorithm for Scheduling Time-Triggered Traffic in Time-Sensitive Networks[C]//2018 IEEE 23rd International Conference on Emerging Technologies and Factory Automation. IEEE, 2018. DOI:10.1109/ETFA.2018.8502515. Pahlevan M Obermaisser R. Genetic Algorithm for Scheduling Time-Triggered Traffic in Time-Sensitive Networks[C] // 2018 IEEE 23rd International Conference on Emerging Technologies and Factory Automation . IEEE , 2018 . DOI: 10.1109/ETFA.2018.8502515 . Open DOISearch in Google Scholar

[5] Gavrilut V, Pop P. Scheduling in time sensitive networks (TSN) for mixed-criticality industrial applications [C]//14 Th IEEE International Workshop on Factory Communication Systems. IEEE, 2018:1–4. DOI:10.1109/WFCS.2018.8402374. Gavrilut V Pop P. Scheduling in time sensitive networks (TSN) for mixed-criticality industrial applications [C] // 14 Th IEEE International Workshop on Factory Communication Systems . IEEE , 2018 : 1 – 4 . DOI: 10.1109/WFCS.2018.8402374 . Open DOISearch in Google Scholar

[6] Santos A C T D, Schneider B, Nigam V, TSNSCHED: Automated Schedule Generation for Time Sensitive Networking[C]//2019 Formal Methods in Computer Aided Design (FMCAD). 2019. DOI:10.23919/FMCAD.2019.8894249. Santos A C T D Schneider B Nigam V TSNSCHED: Automated Schedule Generation for Time Sensitive Networking[C] // 2019 Formal Methods in Computer Aided Design (FMCAD) . 2019 . DOI: 10.23919/FMCAD.2019.8894249 . Open DOISearch in Google Scholar

[7] Bello L L, Steiner W. A perspective on IEEE time-sensitive networking for industrial communication and automation systems [J]. Proceedings of the IEEE, 2019, 107(6): 1094–1120. Bello L L Steiner W. A perspective on IEEE time-sensitive networking for industrial communication and automation systems [J] . Proceedings of the IEEE , 2019 , 107 ( 6 ): 1094 – 1120 . Search in Google Scholar

[8] Mai T L, Navet N, Migge J. A hybrid machine learning and schedulability analysis method for the verification of TSN networks [C]. In: 2019 15th IEEE International Workshop on Factory Communication Systems (WFCS), 2019: 1–8. Mai T L Navet N Migge J. A hybrid machine learning and schedulability analysis method for the verification of TSN networks [C] . In: 2019 15th IEEE International Workshop on Factory Communication Systems (WFCS) , 2019 : 1 – 8 . Search in Google Scholar

[9] Zhong C, Jia H, Wan H, et al. DRLS: A Deep Reinforcement Learning Based Scheduler for Time-Triggered Ethernet[C]//2021 International Conference on Computer Communications and Networks (ICCCN). IEEE, 2021: 1–11. Zhong C Jia H Wan H DRLS: A Deep Reinforcement Learning Based Scheduler for Time-Triggered Ethernet[C] // 2021 International Conference on Computer Communications and Networks (ICCCN) . IEEE , 2021 : 1 – 11 . Search in Google Scholar

[10] Jia H, Jiang Y, Zhong C, et al. TTDeep: Time-Triggered Scheduling for Real-Time Ethernet via Deep Reinforcement Learning [C]. In: 2021 IEEE Global Communications Conference (GLOBECOM), 2021: 1–6. Jia H Jiang Y Zhong C TTDeep: Time-Triggered Scheduling for Real-Time Ethernet via Deep Reinforcement Learning [C] . In: 2021 IEEE Global Communications Conference (GLOBECOM) , 2021 : 16 . Search in Google Scholar

[11] Jin X, Xia C, Guan N. Real-time Scheduling of Massive Data in Time Sensitive Networks with a Limited Number of Schedule Entries [J]. IEEE Access, 2020, PP (99): 1–1. DOI:10.1109/ACCESS.2020.2964690. Jin X Xia C Guan N. Real-time Scheduling of Massive Data in Time Sensitive Networks with a Limited Number of Schedule Entries [J] . IEEE Access , 2020 , PP ( 99 ): 1 – 1 . DOI: 10.1109/ACCESS.2020.2964690 . Open DOISearch in Google Scholar

[12] Bujosa D, Ashjaei M, Papadopoulos A V, et al. HERMES: Heuristic multi-queue scheduler for TSN time-triggered traffic with zero reception jitter capabilities [C]. In: Proceedings of the 30th International Conference on Real-Time Networks and Systems, 2022: 70–80. Bujosa D Ashjaei M Papadopoulos A V HERMES: Heuristic multi-queue scheduler for TSN time-triggered traffic with zero reception jitter capabilities [C] . In: Proceedings of the 30th International Conference on Real-Time Networks and Systems , 2022 : 70 – 80 . Search in Google Scholar

[13] Li C, Zhang C, Zheng W. Joint Routing and Scheduling for Dynamic Applications in Multicast Time-Sensitive Networks [C]//IEEE International Conference on Communications Workshops. IEEE, 2021. DOI:10.1109/ICCWorkshops50388.2021.9473540. Li C Zhang C Zheng W. Joint Routing and Scheduling for Dynamic Applications in Multicast Time-Sensitive Networks [C] // IEEE International Conference on Communications Workshops . IEEE , 2021 . DOI: 10.1109/ICCWorkshops50388.2021.9473540 . Open DOISearch in Google Scholar

[14] Nasrallah A, Thyagaturu A S, Alharbi Z, et al. Ultra-low latency (ULL) networks: The IEEE TSN and IETF DetNet standards and related 5G ULL research [J]. IEEE Communications Surveys & Tutorials, 2018, 21(1): 88–145. Nasrallah A Thyagaturu A S Alharbi Z Ultra-low latency (ULL) networks: The IEEE TSN and IETF DetNet standards and related 5G ULL research [J] . IEEE Communications Surveys & Tutorials , 2018 , 21 ( 1 ): 88 – 145 . Search in Google Scholar

[15] Reusch N, Zhao L, Craciunas S S, et al. Window-Based Schedule Synthesis for Industrial IEEE 802.1Qbv TSN Networks [C]// 2020 16th IEEE International Conference on Factory Communication Systems (WFCS). IEEE, 2020. Reusch N Zhao L Craciunas S S Window-Based Schedule Synthesis for Industrial IEEE 802.1Qbv TSN Networks [C] // 2020 16th IEEE International Conference on Factory Communication Systems (WFCS) . IEEE , 2020 . Search in Google Scholar