<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>Topic precise crawler is a special purpose web crawler, which downloads appropriate web pages analogous to a particular topic by measuring cosine similarity or semantic similarity score. The cosine based similarity measure displays inaccurate relevance score, if topic term does not directly occur in the web page. The semantic-based similarity measure provides the precise relevance score, even if the synonyms of the given topic occur in the web page. The unavailability of the topic in the ontology produces inaccurate relevance score by the semantic focused crawlers. This paper overcomes these glitches with a hybrid string-matching algorithm by combining the semantic similarity-based measure with the probabilistic similarity-based measure. The experimental results revealed that this algorithm increased the efficiency of the focused web crawlers and achieved better Harvest Rate (HR), Precision (P) and Irrelevance Ratio (IR) than the existing web focused crawlers achieve.</p>
</abstract>

Topic precise crawler is a special purpose web crawler, which downloads appropriate web pages analogous to a particular topic by measuring cosine similarity or semantic similarity score. The cosine based similarity measure displays inaccurate relevance score, if topic term does not directly occur in the web page. The semantic-based similarity measure provides the precise relevance score, even if the synonyms of the given topic occur in the web page. The unavailability of the topic in the ontology produces inaccurate relevance score by the semantic focused crawlers. This paper overcomes these glitches with a hybrid string-matching algorithm by combining the semantic similarity-based measure with the probabilistic similarity-based measure. The experimental results revealed that this algorithm increased the efficiency of the focused web crawlers and achieved better Harvest Rate (HR), Precision (P) and Irrelevance Ratio (IR) than the existing web focused crawlers achieve.

An Enhanced Semantic Focused Web Crawler Based on Hybrid String Matching Algorithm

Department of Information Technology, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology

Cybernetics and Information Technologies

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Topic precise crawler is a special purpose web crawler, which downloads appropriate web pages analogous to a particular topic by measuring cosine similarity or...

An Enhanced Semantic Focused Web Crawler Based on Hybrid String Matching Algorithm

Published Online: Jul 01, 2021

Page range: 105 - 120

Received: Dec 30, 2020

Accepted: Apr 14, 2021

DOI: https://doi.org/10.2478/cait-2021-0022

Keywords
Probabilistic model, hybrid semantic similarity, web focused crawler, string matching

© 2021 K. S. Sakunthala Prabha et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

An Enhanced Semantic Focused Web Crawler Based on Hybrid String Matching Algorithm

Published Online: Jul 01, 2021

Page range: 105 - 120

Received: Dec 30, 2020

Accepted: Apr 14, 2021

DOI: https://doi.org/10.2478/cait-2021-0022

KeywordsProbabilistic model, hybrid semantic similarity, web focused crawler, string matching

© 2021 K. S. Sakunthala Prabha et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Keywords
Probabilistic model, hybrid semantic similarity, web focused crawler, string matching