<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>The article describes a string recognition approach, engraved in the parsers generated by Tunnel Grammar Studio that use the tunnel parsing algorithm, of how a lexer and a parser can operate on the input during its recognition. Proposed is an addition of the augmented Backus-Naur form syntax that enables the formal language to be expressed with a parser grammar and optionally with an additional lexer grammar. The tokens outputted from the lexer are matched to the phrases in the parser grammar by their name and optionally by their lexeme, case sensitively or insensitively.</p>
</abstract>

The article describes a string recognition approach, engraved in the parsers generated by Tunnel Grammar Studio that use the tunnel parsing algorithm, of how a lexer and a parser can operate on the input during its recognition. Proposed is an addition of the augmented Backus-Naur form syntax that enables the formal language to be expressed with a parser grammar and optionally with an additional lexer grammar. The tokens outputted from the lexer are matched to the phrases in the parser grammar by their name and optionally by their lexeme, case sensitively or insensitively.

Tunnel Parsing with the Token’s Lexeme

University of Plovdiv “Paisii Hilendarski”

Cybernetics and Information Technologies

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

{"article-title":"Tunnel Parsing with the Token\u2019s Lexeme"}

The article describes a string recognition approach, engraved in the parsers generated by Tunnel Grammar Studio that use the tunnel parsing algorithm, of how a...

Tunnel Parsing with the Token’s Lexeme

Online veröffentlicht: 23. Juni 2022

Seitenbereich: 125 - 144

Eingereicht: 17. Jan. 2022

Akzeptiert: 12. Apr. 2022

DOI: https://doi.org/10.2478/cait-2022-0021

Schlüsselwörter
Parsing algorithm, tunnel parsing, lexeme matching, advanced grammar, phrase state machine

© 2022 Nikolay Handzhiyski et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Tunnel Parsing with the Token’s Lexeme

Online veröffentlicht: 23. Juni 2022

Seitenbereich: 125 - 144

Eingereicht: 17. Jan. 2022

Akzeptiert: 12. Apr. 2022

DOI: https://doi.org/10.2478/cait-2022-0021

SchlüsselwörterParsing algorithm, tunnel parsing, lexeme matching, advanced grammar, phrase state machine

© 2022 Nikolay Handzhiyski et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Schlüsselwörter
Parsing algorithm, tunnel parsing, lexeme matching, advanced grammar, phrase state machine