<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>Identifying vulnerabilities within source code remains paramount in assuring software quality and security. This study introduces a refined semi-supervised learning methodology that capitalizes on pattern-exploiting training coupled with cloze-style interrogation techniques. The research strategy employed involves the training of a linguistic model on the SARD and Devign datasets, which are replete with vulnerable code fragments. The training procedure entails obscuring specific segments of the code and subsequently prompting the model to ascertain the obfuscated tokens. Empirical analyses underscore the efficacy of our method in pinpointing vulnerabilities in source code, benefiting substantially from patterns discerned within the code fragments. This investigation underscores the potential of integrating pattern-exploiting training and cloze-based queries to enhance the precision of vulnerability detection within source code.</p>
</abstract>

Identifying vulnerabilities within source code remains paramount in assuring software quality and security. This study introduces a refined semi-supervised learning methodology that capitalizes on pattern-exploiting training coupled with cloze-style interrogation techniques. The research strategy employed involves the training of a linguistic model on the SARD and Devign datasets, which are replete with vulnerable code fragments. The training procedure entails obscuring specific segments of the code and subsequently prompting the model to ascertain the obfuscated tokens. Empirical analyses underscore the efficacy of our method in pinpointing vulnerabilities in source code, benefiting substantially from patterns discerned within the code fragments. This investigation underscores the potential of integrating pattern-exploiting training and cloze-based queries to enhance the precision of vulnerability detection within source code.

SecuGuard: Leveraging pattern-exploiting training in language models for advanced software vulnerability detection

International Journal of Mathematics and Computer in Engineering

This work is licensed under the Creative Commons Attribution 4.0 International License.

Identifying vulnerabilities within source code remains paramount in assuring software quality and security. This study introduces a refined semi-supervised...

SecuGuard: Leveraging pattern-exploiting training in language models for advanced software vulnerability detection

Article Category: Original Study

Published Online: Jun 02, 2024

Page range: -

Received: Oct 28, 2023

Accepted: Jan 16, 2024

DOI: https://doi.org/10.2478/ijmce-2025-0005

Keywords
Language models, software vulnerabilities, vulnerability detection, cloze-style questions, pattern-exploiting training, RoBERTa

© 2025 Mahmoud Basharat et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

SecuGuard: Leveraging pattern-exploiting training in language models for advanced software vulnerability detection

Article Category: Original Study

Published Online: Jun 02, 2024

Page range: -

Received: Oct 28, 2023

Accepted: Jan 16, 2024

DOI: https://doi.org/10.2478/ijmce-2025-0005

KeywordsLanguage models, software vulnerabilities, vulnerability detection, cloze-style questions, pattern-exploiting training, RoBERTa

© 2025 Mahmoud Basharat et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Keywords
Language models, software vulnerabilities, vulnerability detection, cloze-style questions, pattern-exploiting training, RoBERTa