Open Access

Application Research of Crawler and Data Analysis Based on Python

, , ,  and   
Jul 13, 2020

Cite
Download Cover

Figure 1.

Basic principles of Scrapy frame
Basic principles of Scrapy frame

Figure 2.

Investigation of HTML page structure of steam manufacturers by using viewers
Investigation of HTML page structure of steam manufacturers by using viewers

Figure 3.

List of URLs obtained by selenium and beautiful soup
List of URLs obtained by selenium and beautiful soup

Figure 4.

Executing the start request method selenium pop-up browser to crawl the dynamic page
Executing the start request method selenium pop-up browser to crawl the dynamic page

Figure 5.

Crawled data list
Crawled data list

Figure 6.

Output the publisher platform follower ranking chart
Output the publisher platform follower ranking chart
Language:
English
Publication timeframe:
4 times per year
Journal Subjects:
Computer Sciences, Computer Sciences, other