Energy-efficient Q-learning-based routing in wireless sensor networks

[1] Meena Pundir and Jasminder Sandhu, A systematic Review of Quality of Services in Wireless Sensor Networks using Machine Learning: Recent Trend and Future Vision, Journal of Network and Computer Applications, 188, (2021). DOI: 10.1016/j.jnca.2021.103084. PundirMeena SandhuJasminder A systematic Review of Quality of Services in Wireless Sensor Networks using Machine Learning: Recent Trend and Future Vision Journal of Network and Computer Applications 188 2021 10.1016/j.jnca.2021.103084 Open DOISearch in Google Scholar

[2] Padmalaya Naya, G. K. Swetha, Surbhi Gupta, K. Madhavi, Routing in wireless sensor networks using machine learning techniques: Challenges and opportunities, Measurements, 178, (2021). DOI: 10.1016/j.measurement.2021.108974. NayaPadmalaya SwethaG. K. GuptaSurbhi MadhaviK. Routing in wireless sensor networks using machine learning techniques: Challenges and opportunities Measurements 178 2021 10.1016/j.measurement.2021.108974 Open DOISearch in Google Scholar

[3] Praveen Kumar D, Tarachand Amgoth, Chandra Sekhara Rao Annavarapu, Machine learning algorithms for wireless sensor networks: A survey, Information Fusion (2018). DOI: 10.1016/j.inffus.2018.09.013 Praveen KumarD AmgothTarachand AnnavarapuChandra Sekhara Rao Machine learning algorithms for wireless sensor networks: A survey Information Fusion 2018 10.1016/j.inffus.2018.09.013 Open DOISearch in Google Scholar

[4] Raja Basha, A. A Review on Wireless Sensor Networks: Routing. Wireless Personal Communication 125, 897–937 (2022). DOI: 10.1007/s11277-022-09583-4 Raja BashaA. A Review on Wireless Sensor Networks: Routing Wireless Personal Communication 125 897 937 2022 10.1007/s11277-022-09583-4 Open DOISearch in Google Scholar

[5] Pantazis, N.A.; Nikolidakis, S.A.; Vergados, D.D. Energy-Efficient Routing Protocols in Wireless Sensor Networks: A Survey. IEEE Commun. Surv. Tutor. 2013, 15, 551–591. [CrossRef] PantazisN.A. NikolidakisS.A. VergadosD.D. Energy-Efficient Routing Protocols in Wireless Sensor Networks: A Survey IEEE Commun. Surv. Tutor. 2013 15 551 591 [CrossRef] Search in Google Scholar

[6] Jingjing, Y.; Mengchu, Z.; Zhijun, D. Recent advances in energy-efficient routing protocols for wireless sensor networks: A review. IEEE Access 2016, 4, 5673–5686. JingjingY. MengchuZ. ZhijunD. Recent advances in energy-efficient routing protocols for wireless sensor networks: A review IEEE Access 2016 4 5673 5686 Search in Google Scholar

[7] Mohamed, R.E.; Saleh, A.I.; Abdelrazzak, M.; Samra, A.S. Survey on wireless sensor network applications and energy efficient routing protocols. Wirel. Pers. Commun. 2018, 101, 1019–1055. [CrossRef] MohamedR.E. SalehA.I. AbdelrazzakM. SamraA.S. Survey on wireless sensor network applications and energy efficient routing protocols Wirel. Pers. Commun. 2018 101 1019 1055 [CrossRef] Search in Google Scholar

[8] C. Nakas, D. Kandris, and G. Visvardis, “Energy efficient routing in wireless sensor networks: A comprehensive survey,” Algorithms, vol. 13, no. 3, p. 72, Mar. 2020, doi: 10.3390/a13030072 NakasC. KandrisD. VisvardisG. “Energy efficient routing in wireless sensor networks: A comprehensive survey,” Algorithms 13 3 72 Mar. 2020 10.3390/a13030072 Open DOISearch in Google Scholar

[9] M. Shaq, H. Ashraf, A. Ullah, and S. Tahira, “Systematic literature review on energy efficient routing schemes in WSN: A survey,” Mobile Netw. Appl., vol. 25, no. 3, pp. 882895, Feb. 2020, doi: 10.1007/s11036-020-01523-5. ShaqM. AshrafH. UllahA. TahiraS. “Systematic literature review on energy efficient routing schemes in WSN: A survey,” Mobile Netw. Appl. 25 3 882895 Feb. 2020 10.1007/s11036-020-01523-5 Open DOISearch in Google Scholar

[10] Ehsan Ahvar, Shohreh Ahvar, Gyu Myoung Lee, Noel Crespi, “An Energy-Aware Routing Protocol for Query-Based Applications in Wireless Sensor Networks”, The Scientific World Journal, vol. 2014, Article ID 359897, 9 pages, 2014. DOI: 10.1155/2014/359897 AhvarEhsan AhvarShohreh LeeGyu Myoung CrespiNoel “An Energy-Aware Routing Protocol for Query-Based Applications in Wireless Sensor Networks” The Scientific World Journal 2014 Article ID 359897, 9 pages, 2014 10.1155/2014/359897 Open DOISearch in Google Scholar

[11] Ding, Q.; Zhu, R.; Liu, H.; Ma, M. An Overview of Machine Learning-Based Energy-Efficient Routing Algorithms in Wireless Sensor Networks. Electronics 2021, 10, 1539. DOI: 10.3390/electronics10131539. DingQ. ZhuR. LiuH. MaM. An Overview of Machine Learning-Based Energy-Efficient Routing Algorithms in Wireless Sensor Networks Electronics 2021 10 1539 10.3390/electronics10131539 Open DOISearch in Google Scholar

[12] X. Su, Y. Ren, Z. Cai, Y. Liang and L. Guo, “A Q-Learning-Based Routing Approach for Energy Efficient Information Transmission in Wireless Sensor Network,” in IEEE Transactions on Network and Service Management, vol. 20, no. 2, pp. 1949–1961, June 2023, doi: 10.1109/TNSM.2022.3218017. SuX. RenY. CaiZ. LiangY. GuoL. “A Q-Learning-Based Routing Approach for Energy Efficient Information Transmission in Wireless Sensor Network,” in IEEE Transactions on Network and Service Management 20 2 1949 1961 June 2023 10.1109/TNSM.2022.3218017 Open DOISearch in Google Scholar

[13] S. Z. Jafarzadeh and M. H. Y. Moghaddam, “Design of energy-aware QoS routing protocol in wireless sensor networks using reinforcement learning,” 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 1–5, (2014), 10.1109/CCECE.2014.6900988. JafarzadehS. Z. MoghaddamM. H. Y. “Design of energy-aware QoS routing protocol in wireless sensor networks using reinforcement learning,” 2014 IEEE 27th Canadian Conference on Electrical and Computer Engineering (CCECE) 1 5 2014 10.1109/CCECE.2014.6900988 Open DOISearch in Google Scholar

[14] G. Oddi, A. Pietrabissa, and F. Liberati, “Energy balancing in multihop wireless sensor networks: An approach based on reinforcement learning,” in Proc. NASA/ESA Conf. Adapt. Hardw. Syst. (AHS), 2014, pp. 262–269. OddiG. PietrabissaA. LiberatiF. “Energy balancing in multihop wireless sensor networks: An approach based on reinforcement learning,” in Proc. NASA/ESA Conf. Adapt. Hardw. Syst. (AHS) 2014 262 269 Search in Google Scholar

[15] Kiani F, Amiri E, Zamani M, et al. Efficient intelligent energy routing protocol in wireless sensor networks. Int J Distrib Sens N vol.5, issue 27, (2015), DOI: 10.1155/2015/618072. KianiF AmiriE ZamaniM Efficient intelligent energy routing protocol in wireless sensor networks Int J Distrib Sens N 5 27 2015 10.1155/2015/618072 Open DOISearch in Google Scholar

[16] X. Li, X. Hu, W. Li, and H. Hu, “A multi-agent reinforcement learning routing protocol for underwater optical sensor networks,” in Proc. IEEE Int. Conf. Commun. (ICC), 2019, pp. 1–7. LiX. HuX. LiW. HuH. “A multi-agent reinforcement learning routing protocol for underwater optical sensor networks,” in Proc. IEEE Int. Conf. Commun. (ICC) 2019 1 7 Search in Google Scholar

[17] W. Guo, C. Yan, and T. Lu, “Optimizing the lifetime of wireless sensor networks via reinforcement-learning-based routing,” Int. J. Distrib. Sens. Netw., vol. 15, no. 2, 2019, Art. no. 155014771983354. GuoW. YanC. LuT. “Optimizing the lifetime of wireless sensor networks via reinforcement-learning-based routing,” Int. J. Distrib. Sens. Netw. 15 2 2019 Art. no. 155014771983354. Search in Google Scholar

[18] W. -K. Yun and S. -J. Yoo, “Q-Learning-Based Data-Aggregation-Aware Energy-Efficient Routing Protocol for Wireless Sensor Networks,” in IEEE Access, vol. 9, pp. 10737–10750, 2021, doi: 10.1109/ACCESS.2021.3051360. YunW. -K. YooS. -J. “Q-Learning-Based Data-Aggregation-Aware Energy-Efficient Routing Protocol for Wireless Sensor Networks,” in IEEE Access 9 10737 10750 2021 10.1109/ACCESS.2021.3051360 Open DOISearch in Google Scholar

[19] ViallyKazadi Mutombo, Seungyeon Lee, Jusuk Lee, and Jiman Hong, EER-RL: Energy-Efficient Routing Based on Reinforcement Learning, Mobile Information Systems Volume 2021, DOI: 10.1155/2021/5589145. MutomboViallyKazadi LeeSeungyeon LeeJusuk HongJiman EER-RL: Energy-Efficient Routing Based on Reinforcement Learning Mobile Information Systems 2021 10.1155/2021/5589145 Open DOISearch in Google Scholar

[20] Ranjita Joon, Parul Tomar, Energy Aware Q-learning AODV (EAQ-AODV) routing for cognitive radio sensor networks, Journal of King Saud University - Computer and Information Sciences, Volume 34, Issue 9, 2022, pp. 6989–7000, DOI: 10.1016/j.jksuci.2022.03.021. JoonRanjita TomarParul Energy Aware Q-learning AODV (EAQ-AODV) routing for cognitive radio sensor networks Journal of King Saud University - Computer and Information Sciences 34 9 2022 6989 7000 10.1016/j.jksuci.2022.03.021 Open DOISearch in Google Scholar

[21] X. Su, Y. Ren, Z. Cai, Y. Liang and L. Guo, A Q-Learning-Based Routing Approach for Energy Efficient Information Transmission in Wireless Sensor Network, IEEE Transactions on Network and Service Management, vol. 20, no. 2, pp. 1949–1961, June 2023, doi: 10.1109/TNSM.2022.3218017. SuX. RenY. CaiZ. LiangY. GuoL. A Q-Learning-Based Routing Approach for Energy Efficient Information Transmission in Wireless Sensor Network IEEE Transactions on Network and Service Management 20 2 1949 1961 June 2023 10.1109/TNSM.2022.3218017 Open DOISearch in Google Scholar

[22] Maivizhi, R., Yogesh, P. Q-learning based routing for in-network aggregation in wireless sensor networks. Wireless Networks 27, 2231–2250, 2021. DOI: 10.1007/s11276-021-02564-8. MaivizhiR. YogeshP. Q-learning based routing for in-network aggregation in wireless sensor networks Wireless Networks 27 2231 2250 2021 10.1007/s11276-021-02564-8 Open DOISearch in Google Scholar

[23] W. -K. Yun and S. -J. Yoo, Q-Learning-Based Data-Aggregation-Aware Energy-Efficient Routing Protocol for Wireless Sensor Networks, IEEE Access, vol. 9, pp. 10737–10750, 2021. doi: 10.1109/ACCESS.2021.3051360. YunW. -K. YooS. -J. Q-Learning-Based Data-Aggregation-Aware Energy-Efficient Routing Protocol for Wireless Sensor Networks IEEE Access 9 10737 10750 2021 10.1109/ACCESS.2021.3051360 Open DOISearch in Google Scholar

[24] J. A. Boyan and M. L. Littman, Packet routing in dynamically changing networks: A reinforcement learning approach, in Proc. Neural Inf. Process. Syst. Conf. (NIPS), pp. 671–678, (1994), 10.5555/2987189.2987274 BoyanJ. A. LittmanM. L. Packet routing in dynamically changing networks: A reinforcement learning approach in Proc. Neural Inf. Process. Syst. Conf. (NIPS) 671 678 1994 10.5555/2987189.2987274 Open DOISearch in Google Scholar