A Deep Reinforcement-Learning-Based Relay Selection for Underwater Sensors Network

[1] K. Latif, N. Javaid, I. Ullah, Z. Kaleem, Z. Abbas, and L. D. Nguyen, “DIEER: Delay-intolerant energy-efficient routing with sink mobility in underwater wireless sensor networks,” Sens., vol. 20, no. 12, p. 3467, 2020. Search in Google Scholar

[2] G. Khan, R. Dwivedi, and K. K. Gola, “Comparative analysis of routing algorithms for underwater sensor network,” in Pervasive Computing A Networking Perspective and Future Directions. Springer, 2019, pp. 31–46. Search in Google Scholar

[3] A. Abuarqoub, M. Hammoudeh, B. Adebisi, S. Jabbar, A. Bounceur, and H. Al-Bashar, “Dynamic clustering and management of mobile wireless sensor networks,” Comput. Netw., vol. 117, pp. 62–75, 2017. Search in Google Scholar

[4] Y. Su, R. Fan, and Z. Jin, “ORIT: A transport layer protocol design for underwater DTN sensor networks,” IEEE Access, vol. 7, pp. 69 592–69 603, 2019. Search in Google Scholar

[5] I. Ahmad and K. Chang, “Downlink power allocation strategy for next-generation underwater acoustic communications networks,” Electr., vol. 8, no. 11, p. 1297, 2019. Search in Google Scholar

[6] T. Melodia, H. Kulhandjian, L.-C. Kuo, E. Demirors, S. Basagni, M. Conti, S. Giordano, and I. Stojmenovic, Advances in Underwater Acoustic Networking. Wiley Online Library, 2013. Search in Google Scholar

[7] C. R. Berger, S. Zhou, J. C. Preisig, and P. Willett, “Sparse channel estimation for multicarrier underwater acoustic communication: From subspace methods to compressed sensing,” IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1708–1721, 2009. Search in Google Scholar

[8] M. Stojanovic and J. Preisig, “Underwater acoustic communication channels: Propagation models and statistical characterization,” IEEE Commun. Mag., vol. 47, no. 1, pp. 84–89, 2009. Search in Google Scholar

[9] S. Jabbar, M. Ahmad, K. R. Malik, S. Khalid, J. Chaudhry, and O. Aldabbas, “Designing an energy-aware mechanism for lifetime improvement of wireless sensor networks: A comprehensive study,” Mobile Netw. Appl., vol. 23, no. 3, pp. 432–445, 2018. Search in Google Scholar

[10] S. H. PARK and D. GRACE, “Reinforcement learning based mac protocol (uw-aloha-qm) for mobile underwater acoustic sensor networks,” IEEE Access, pp. 5906–5919, 2020. Search in Google Scholar

[11] R. I. B. S. D. Muruganathan, D. C. F. Ma and A. O. Fapojuwo, “A centralized energy-efficient routing protocol for wireless sensor networks,” IEEE Commun. Mag., vol. 43, no. 3, pp. S8–13, 2005. Search in Google Scholar

[12] B. S. F. Boavida and E. Monteiro, “Vbf: Vector-based forwarding protocol for underwater sensor networks,” Networking Technologies, Services and Protocols, pp. 1216–1221, 2006. Search in Google Scholar

[13] N. Y. H. Yu and J. Liu, “An adaptive routing protocol in underwater sparse acoustic sensor networks,” Ad Hoc Netw, pp. 121–143, 2015. Search in Google Scholar

[14] A. S. N. Nicolaou and D. Maggiorini, “Improving the robustness of location-based routing for underwater sensor networks,” IEEE OCEANS, pp. 1–6, 2007. Search in Google Scholar

[15] R. Coutinho and A. Boukerche, “Hydrocast: Pressure routing for underwater sensor networks,” IEEE Trans. Veh. Technol., vol. 65, no. 1, pp. 333–347, 2016. Search in Google Scholar

[16] N. J. et al, “Cooperative opportunistic pressure based routing for underwater wireless sensor networks,” Sensors, vol. 17, no. 3, p. 629, 2017. Search in Google Scholar

[17] K. Saeed, W. Khalil, S. Ahmed, I. Ahmad, and M. N. K. Khattak, “SEECR: secure energy efficient and cooperative routing protocol for underwater wireless sensor networks,” IEEE Access, vol. 8, pp. 107 419–107 433, 2020. Search in Google Scholar

[18] A. A. A. El-Banna, K. Wu, and B. M. ElHalawany, “Opportunistic cooperative transmission for underwater communication based on the water’s key physical variables,” IEEE Sensors J., vol. 20, no. 5, pp. 2792–2802, 2019. Search in Google Scholar

[19] S. Khadim, F. Riaz, S. Jabbar, S. Khalid, and M. Aloqaily, “A non-cooperative rear-end collision avoidance scheme for non-connected and heterogeneous environment,” Comput. Commun., vol. 150, pp. 828–840, 2020. Search in Google Scholar

[20] H. Tran-Dang and D.-S. Kim, “Channel-aware cooperative routing in underwater acoustic sensor networks,” J. commun. Netw-s, vol. 21, no. 1, pp. 33–44, 2019. Search in Google Scholar

[21] X. L. et al, “Marl-based distributed cache placement for wireless networks,” IEEE Access, vol. 7, pp. 62 606–62 615, 2019. Search in Google Scholar

[22] T. Hu, “Qelar: A machine-learning-based adaptive routing protocol for energy-efficient and lifetime-extended underwater sensor networks,” IEEE Trans. Mobile Computing, vol. 6, no. 6, pp. 796–809, 2010. Search in Google Scholar

[23] T. Hu and Y. Fei, “Murao: A multi-level routing protocol for acoustic optical hybrid underwater wireless sensor networks,” in 9th Annu. IEEE Commun. Soc. Conf. Sensor, 2012, pp. 218–116. Search in Google Scholar

[24] I. Ahmad and K. Chang, “Effective SNR mapping and link adaptation strategy for next-generation underwater acoustic communications networks: a cross-layer approach,” IEEE Access, vol. 7, pp. 44 150–44 164, 2019. Search in Google Scholar

[25] A. Bletsas, A. Khisti, D. P. Reed, and A. Lippman, “A simple cooperative diversity method based on network path selection,” IEEE J. Sel. Areas Commun., vol. 24, no. 3, pp. 659–672, 2006. Search in Google Scholar

[26] G. W. H. Wu and X. Lin, “On the effectiveness of opportunistic routing over wireless mesh networks,” in 6th Int. Conf. Wireless Commun. Netw. Mobile Comput, 2010, pp. 1–4. Search in Google Scholar

[27] H. X. K. Tang, C. Li and J. Zou, “Reinforcement learning-based opportunistic routing for live video streaming over multihop wireless networks,” in IEEE 19th Int . Workshop Multimedia Signal Process, 2017, pp. 1–6. Search in Google Scholar

[28] H. J. X. He and H. Xiao, “Routing selection with reinforcement learning for energy harvesting multi-hop crn,” IEEE Access, vol. 7, pp. 54 435–54 448, 2019. Search in Google Scholar

[29] Z. Z. Ying Zhang and X. Wang, “Reinforcement learning-based opportunistic routing protocol for underwater acoustic sensor networks,” IEEE Transaction on Vehicular Technology, vol. 70, no. 3, pp. 2756–2770, 2021. Search in Google Scholar

[30] R. Narmeen and S. Muhaidat, “Shortest propagation delay-based relay selection for underwater acoustic sensor networks,” IEEE Access, pp. 37 923–37 935, 2021. Search in Google Scholar