Towards Ensuring Software Interoperability Between Deep Learning Frameworks

[1]G. Nguyen, S. Dlugolinsky, M. Bobák, V. Tran,Á. López García, I. Heredia, P. Malík, and L. Hluchý, Machine learning and deep learning frameworks and libraries for large-scale data mining: a survey, Artificial Intelligence Review, 52, 2019, pages 77-124.Search in Google Scholar

[2]S. Pouyanfar, S. Sadiq, Y. Yan, H. Tian, Y. Tao, M.P. Reyes, M.L. Shyu, S.C. Chen, S.S. and Iyengar, A survey on deep learning: Algorithms, techniques, and applications, ACM Computing Surveys (CSUR), 51(5), 2018, pages 1-36.Search in Google Scholar

[3]M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G.S. Corrado, A. Davis, J. Dean, M. Devin, and S. Ghemawat, Tensorflow: Large-scale machine learning on heterogeneous distributed systems, 2016, arXiv:1603.04467.Search in Google Scholar

[4]F. Chollet, Keras: The python deep learning library, 2015, https://github.com/fchollet/keras.Search in Google Scholar

[5]A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, and A. Desmaison, Pytorch: An imperative style, high-performance deep learning library, Advances in neural information processing systems, 32, 2019.Search in Google Scholar

[6]Y. Cheng, D. Wang, P. Zhou, and T. Zhang, A survey of model compression and acceleration for deep neural networks, 2017, arXiv:1710.09282.Search in Google Scholar

[7]T.G. Dietterich, Ensemble learning, In: The handbook of brain theory and neural networks, The MIT Press, 2002, pages 110-125.Search in Google Scholar

[8]J. Gao, P. Li, Z. Chen, and J. Zhang, A survey on deep learning for multimodal data fusion, Neural Computation, 32(5), 2020, pages 829-864.Search in Google Scholar

[9]Facebook and Microsoft, ONNX: Open Neural Network Exchange, 2017, https://github.com/onnx/onnx.Search in Google Scholar

[10]The Khronos Group, Neural Network Exchange Format (NNEF), 2016, https://www.khronos.org/nnef.Search in Google Scholar

[11]Y. Liu, C. Chen, R. Zhang, T. Qin, X. Ji, H. Lin, and M. Yang, Enhancing the interoperability between deep learning frameworks by model conversion, In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2020, pages 1320-1330.Search in Google Scholar

[12]Hahnyuan, Neural network tools: Converter and analyzer, 2017, https://github.com/hahnyuan/nntools.Search in Google Scholar

[13]Gmalivenko, pytorch2keras: Pytorch to keras model convertor, 2019, https://github.com/gmalivenko/pytorch2keras.Search in Google Scholar

[14]Z. Chen, Y. Cao, Y. Liu, H. Wang, T. Xie, and X. Liu, A comprehensive study on challenges in deploying deep learning based software, In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2020, pages 750-762.Search in Google Scholar

[15]M. Openja, A. Nikanjam, A.H. Yahmed, F. Khomh, and Z.M.J. Jiang, An empirical study of challenges in converting deep learning models, In 2022 IEEE International Conference on Software Maintenance and Evolution (ICSME), 2022, pages 13-23.Search in Google Scholar

[16]H. Pham, Software reliability, Springer Science& Business Media, 2000.Search in Google Scholar

[17]J. Schumann, P. Gupta, and S. Nelson, On verification & validation of neural network based controllers, EANN’03, 2003.Search in Google Scholar

[18]Facebook, CAFFE2, 2017, https://caffe2.ai/.Search in Google Scholar

[19]Apache Software Foundation, A flexible and efficient library for Deep Learning, 2017, https://mxnet.apache.org/versions/1.9.1/.Search in Google Scholar

[20]Y. Jia, E. Shelhamer, F. Donahue, S. Karayev, K. Long, R. Girshick, S. Guadarrama, and T. Darrell, Caffe: Convolutional architecture for fast feature embedding, In Proceedings of the 22nd ACM international conference on Multimedia, 2014, pages 675-678.Search in Google Scholar

[21]Woodsgao, pytorch2caffe, 2010, https://github.com/woodsgao/pytorch2caffe.Search in Google Scholar

[22]Darshan, Torch to ONNX conversion going wrong, 2021, https://discuss.pytorch.org/t/torch-to-onnx-conversion-going-wrong/121596.Search in Google Scholar

[23]ys.yusaito, Inference result is different between Pytorch and ONNX model, 2022, https://discuss.pytorch.org/t/inference-result-is-different-between-pytorch-and-onnx-model/147228/1.Search in Google Scholar

[24]J. Schumann, and K. Goseva-Popstojanova, Verification and validation approaches for model-based software engineering, In 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C), 2019, pages 514-518.Search in Google Scholar

[25]L. Roeder, Netron, 2020, https://netron.app/.Search in Google Scholar

[26]T. Fawcett, An introduction to ROC analysis. Pattern recognition letters, 27(8), 2006, pages 861-874.Search in Google Scholar

[27]Y. Jiang, Prediction of monthly mean daily diffuse solar radiation using artificial neural networks and comparison with other empirical models, Energy policy, 36(10), 2008, pages 3833-3837.Search in Google Scholar

[28]S. Zeiml, U. Seiler, K. Altendorfer, and T. Felber-bauer, Simulation evaluation of automated forecast error correction based on mean percentage error, In 2020 Winter Simulation Conference (WSC), 2020, pages 1572-1583.Search in Google Scholar

[29]M. Nejadgholi, and J. Yang, A study of oracle approximations in testing deep learning libraries, In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE), 2019, pages 785-796.Search in Google Scholar

[30]M.V. Shcherbakov, A. Brebels, N.L. Shcherbakova, A.P. Tyukov, T.A. Janovsky, and V.A.E. Kamaev, A survey of forecast error measures, World applied sciences journal, 24(24), 2013, pages 171-176.Search in Google Scholar

[31]H. Li, W. Ma, Y. Lian, and X. Wang, Estimating daily global solar radiation by day of year in China, Applied Energy, 87(10), 2010, pages 3011-3017.Search in Google Scholar

[32]K. Simonyan, and A. Zisserman, Very deep convolutional networks for large-scale image recognition, 2014, arXiv:1409.1556.Search in Google Scholar

[33]L. Deng, The mnist database of handwritten digit images for machine learning research [best of the web], IEEE signal processing magazine, 29(6), 2012, pages 141-142.Search in Google Scholar

[34]A. Krizhevsky, I. Sutskever, and G.E. Hinton, Imagenet classification with deep convolutional neural networks, Communications of the ACM, 60(6), 2017, pages 84-90.Search in Google Scholar

[35]Android Google, Keeping your app responsive, 2017, https://developer.android.com/training/articles/perfanr.html.Search in Google Scholar

[36]G. Kechit, Top 10 deep learning frameworks in 2022 you can’t ignore, 2022, https://www.upgrad.com/blog/top-deep-learning-frameworks.Search in Google Scholar

[37]O.G. Yalçın, Top 5 Deep Learning Frameworks to Watch in 2021 and Why TensorFlow, 2021, https://towardsdatascience.com/top-5-deep-learning-frameworks-to-watch-in-2021-and-whytensorflow-98d8d6667351.Search in Google Scholar