Improving productivity in large scale testing at the compiler level by changing the intermediate language from C++ to Java

[1] R. Abdalkareem, S. Mujahid, E. Shihab, A machine learning approach to improve the detection of ci skip commits, IEEE Transactions on Software Engineering, pp. 1–1, 2020. ⇒140 Search in Google Scholar

[2] B. Amedro, V. Bodnartchouk, D. Caromel, C. Delbe, F. Huet, G. L. Taboada, Current State of Java for HPC, Technical Report RT-0353, INRIA, 2008. [accessed Apr-2020] ⇒141 Search in Google Scholar

[3] ARMOUR, Test generation strategies for large-scale IoT security testing – v1, 2016. [accessed Apr-2020] ⇒135 Search in Google Scholar

[4] A. Avram, IDC Study: How Many Software Developers Are Out There?, 2014. ⇒135 Search in Google Scholar

[5] N. Bartha, Scalability on IT projects, Master’s thesis, 2016. ⇒135 Search in Google Scholar

[6] L. Batyuk, A.-D. Schmidt, H.-G. Schmidt, A. Camtepe, S. Albayrak, Developing and Benchmarking Native Linux Applications on Android, in J.-M. Bonnin, C. Giannelli, T. Magedanz, MobileWireless Middleware, Operating Systems, and Applications, volume 7, pages 381–392, Berlin, Heidelberg, 2009. Springer. ⇒14010.1007/978-3-642-01802-2_28 Search in Google Scholar

[7] R. P. Cook, An OpenMP library for Java, In 2013 Proceedings of IEEE South-eastcon, pp. 1–6, April 2013. ⇒14110.1109/SECON.2013.6567466 Search in Google Scholar

[8] A.De Marco, V. Iancu, I. Asinofsky, COBOL to Java and Newspapers Still Get Delivered, in 2018 IEEE International Conference on Software Maintenance and Evolution (ICSME), pp. 583–586, Sep. 2018. ⇒140, 143, 16610.1109/ICSME.2018.00055 Search in Google Scholar

[9] Ericsson Telecom AB., Source code of titan, version 6.6.0. https://github.com/eclipse/titan.EclipsePlug-ins/releases/tag/6.6.0, 2019. [accessed Apr-2020]. ⇒167 Search in Google Scholar

[10] Ericsson Telecom AB., Programmers’ Technical Reference Guide for the Java side of the TITAN TTCN-3 Toolset, https://github.com/eclipse/titan.core/blob/master/usrguide/java_referenceguide/JavaReferenceGuide.adoc, 2020. [accessed Apr-2020]. ⇒142, 149 Search in Google Scholar

[11] Ericsson Telecom AB., Programmers’ Technical Reference Guide for the TITAN TTCN-3 Toolset, https://github.com/eclipse/titan.core/blob/master/usrguide/referenceguide/ReferenceGuide.adoc, 2020. [accessed Apr-2020]. ⇒142, 149 Search in Google Scholar

[12] ETSI, Methods for Testing and Specification (MTS);The Testing and Test Control Notation version 3; Part 5: TTCN-3 Runtime Interface (TRI), https://www.etsi.org/deliver/etsi_es/201800_201899/20187305/04.08.01_60/es_20187305v040801p.pdf, 2017. [accessed Apr-2020.] ⇒137 Search in Google Scholar

[13] ETSI, 3GPP test suites, http://www.ttcn-3.org/index.php/downloads/publicts/publicts-3gpp, 2020. [accessed Apr-2020]. ⇒135 Search in Google Scholar

[14] ETSI, 5G;5GS; User Equipment (UE) conformance specification; Part 3: Protocol Test Suites, https://www.etsi.org/deliver/etsi_ts/138500_138599/13852303/15.00.00_60/ts_13852303v150000p.pdf, 2020. [accessed Apr-2020]. ⇒135 Search in Google Scholar

[15] ETSI, Intelligent Transport Systems (ITS) Test Suites, http://www.ttcn-3.org/index.php/downloads/publicts/publicts-etsi/65-publicts-its, 2020. [accessed Apr-2020]. ⇒135 Search in Google Scholar

[16] ETSI, Methods for Testing and Specification (MTS);The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language, https://www.etsi.org/deliver/etsi_es/201800_201899/20187301/04.12.01_60/es_20187301v041201p.pdf, 2020, [accessed Oct-2020]. ⇒135, 172 Search in Google Scholar

[17] ETSI, Methods for Testing and Specification (MTS);The Testing and Test Control Notation version 3; Part 6: TTCN-3 Control Interface (TCI), https://www.etsi.org/deliver/etsi_es/201800_201899/20187306/04.12.01_60/es_20187306v041201p.pdf, 2020, [accessed Oct-2020]. ⇒137 Search in Google Scholar

[18] I. I. Farkas, K. Szabados, A. Kovács, Measurement data with configuration, http://compalg.inf.elte.hu/~attila/materials/Measurements_Laptop1.xlsx, http://compalg.inf.elte.hu/ãttila/materials/Measurements_Laptop2.xlsx, 2019. ⇒157 Search in Google Scholar

[19] I. I. Farkas, K. Szabados, A. Kovács, Regression test data, http://compalg.inf.elte.hu/ãttila/materials/RegressionTestSmall_20190724.zip, 2019. ⇒149, 151, 152, 167 Search in Google Scholar

[20] I. I. Farkas, K. Szabados, A. Kovács, An example containing a “Hello World”, some simple types in TTCN-3, and the compiled C/C++ and Java codes, http://compalg.inf.elte.hu/ãttila/materials/Example_package.zip, 2020. ⇒142, 149 Search in Google Scholar

[21] C. A. Furia, R. Feldt, R. Torkar, Bayesian Data Analysis in Empirical Software Engineering Research, IEEE Transactions on Software Engineering, pp. 1–1, 2019. ⇒141, 16610.1109/TSE.2019.2935974 Search in Google Scholar

[22] A. Georges, D.Buytaert, L. Eeckhout, Statistically Rigorous Java Performance Evaluation, Proceedings of the 22Nd Annual ACM SIGPLAN Conference on Object-oriented Programming Systems and Applications, OOPSLA ’07, pp. 57–76, New York, NY, USA, 2007. ACM. ⇒152, 154, 16510.1145/1297027.1297033 Search in Google Scholar

[23] T. A. Ghaleb, D. A. da Costa, Y. Zou, An empirical study of the long duration of continuous integration builds, Empirical Software Engineering, 24(4):2102–2139, Aug 2019. ⇒135, 14010.1007/s10664-019-09695-9 Search in Google Scholar

[24] L. Gherardi, D. Brugali, D. Comotti, A Java vs. C++ Performance Evaluation: A 3D Modeling Benchmark, I. Noda, N. Ando, D. Brugali, J. J. Ku ner, editors, Simulation, Modeling, and Programming for Autonomous Robots, pp. 161–172, Berlin, Heidelberg, 2012. Springer. ⇒14110.1007/978-3-642-34327-8_17 Search in Google Scholar

[25] IoTKETI, oneM2MTester, https://github.com/IoTKETI/oneM2MTester, 2016. Last visited: April, 2020. ⇒135 Search in Google Scholar

[26] J. Nielsen, Response times: The 3 important limits https://www.nngroup.com/articles/response-times-3-important-limits/, 1993. Last visited: October, 2020. ⇒155 Search in Google Scholar

[27] A. Kovács, K. Szabados, Test software quality issues and connections to international standards, Acta Universitatis Sapientiae, Informatica, 5, pp. 77–102, 05 2013. ⇒13510.2478/ausi-2014-0006 Search in Google Scholar

[28] A. Kovács, K. Szabados, Advanced TTCN-3 Test Suite validation with Titan, In Proceedings of the 9th International Conference on Applied Informatics, volume 2, pp. 273–281, 02 2014. ⇒13510.14794/ICAI.9.2014.2.273 Search in Google Scholar

[29] P. Lathan, S. Burke, K. Gallick, A. Coleman, New cpu test methodology 2020: Code compile, updated gaming, transcoding, & more https://www.youtube.com/watch?v=sg9WgwIkhvU, 2020, [accessed May-2020]. ⇒142 Search in Google Scholar

[30] M. Meredith, J. Kruschke, Bayesian Estimation Supersedes the t-Test, https://cran.r-project.org/web/packages/BEST/vignettes/BEST.pdf, 2018, [accessed Apr-2020]. ⇒158 Search in Google Scholar

[31] S. Nanz, C. A. Furia, A Comparative Study of Programming Languages in Rosetta Code, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering, volume 1, pp. 778–788, May 2015. ⇒141, 16610.1109/ICSE.2015.90 Search in Google Scholar

[32] P. Oláh. Improving the semantic analysis in TTCN-3 environment, Master’s thesis, Eötvös Loránd University, Budapest, Hungary, 2016. ⇒150 Search in Google Scholar

[33] K. Reinholtz, Java will be faster than C++, SIGPLAN Not., 35(2):25–28, Feb. 2000. ⇒14010.1145/345105.352548 Search in Google Scholar

[34] A. Ruano, G. Réthy, Developing an Open Source conformance testing environment for ITS communications, UCAAT, 2016. ⇒135 Search in Google Scholar

[35] S. Salmons, M. Arnaud, X. Zeitoun, C. Bouattour, Model-based platform for smart grid interoperability testing using TTCN-3 In UCAAT, 2018. ⇒135 Search in Google Scholar

[36] K. Szabados, Structural Analysis of Large TTCN-3 Projects In M. Núñez, P. Baker, M. G. Merayo, editors, Testing of Software and Communication Systems, pages 241–246, Berlin, Heidelberg, 2009. Springer Berlin Heidelberg. ⇒13510.1007/978-3-642-05031-2_19 Search in Google Scholar

[37] K. Szabados, A. Kovács. Technical debt of standardized test software In 2015 IEEE 7th International Workshop on Managing Technical Debt (MTD), pages 57–60, Bremen, Oct 2015. ⇒13510.1109/MTD.2015.7332626 Search in Google Scholar

[38] K. Szabados, A. Kovács, Internal quality evolution of a large test system–an industrial study In Acta Universitatis Sapientiae, Informatica, 8(2):216–240, 12 2016. ⇒135, 16210.1515/ausi-2016-0010 Search in Google Scholar

[39] K. Szabados, A. Kovács, G. Jenei, D. Góbor, Titanium: Visualization of TTCN-3 system architecture In 2016 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR), pages 7–11, May 2016. ⇒135, 16210.1109/AQTR.2016.7501275 Search in Google Scholar

[40] J. Szabó, T. Csöndes, TITAN, TTCN-3 test execution environment, https://www.hiradastechnika.hu/data/upload/file/2007/2007_1a/HT_0701a-6.pdf, 2007. Last visited: October, 2020. ⇒136, 143 Search in Google Scholar

[41] G. L. Taboada, S. Ramos, R. R. Expósito, J. Touriño, R. Doallo. Java in the High Performance Computing arena: Research, practice and experience, Science of Computer Programming, 78(5):425 – 444, 2013. Special section: Principles and Practice of Programming in Java 2009/2010 & Special section: Self-Organizing Coordination. ⇒141, 16710.1016/j.scico.2011.06.002 Search in Google Scholar

[42] U.S. General Services Administration (GSA) Technology Transformation Service, Interaction Design Basics, https://www.usability.gov/what-and-why/interaction-design.html, 2020. Last visited: October, 2020. ⇒155 Search in Google Scholar

[43] U.S. General Services Administration (GSA). Chapter 4. The class File Format, https://docs.oracle.com/javase/specs/jvms/se7/html/jvms-4.html, 2020. last visited: April, 2020. ⇒149, 165 ⇒152 Search in Google Scholar

[44] U.S. General Services Administration (GSA). Cygwin, 2020. last visited: January, 2020. Search in Google Scholar

[45] U.S. General Services Administration (GSA). Eclipse IoT-Testware, 2020. Last visited: April, 2020. Search in Google Scholar

[46] U.S. General Services Administration (GSA). Titan, 2020. last visited: January, 2020. ⇒135 ⇒152 Search in Google Scholar