Essays about: "scrapy"

Found 2 essays containing the word scrapy.

  1. 1. Evaluating tools and techniques for web scraping

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Emil Persson; [2019]
    Keywords : ;

    Abstract : The purpose of this thesis is to evaluate state of the art web scraping tools. To support the process, an evaluation framework to compare web scraping tools is developed and utilised, based on previous work and established software comparison metrics. Twelve tools from different programming languages are initially considered. READ MORE

  2. 2. How to Build a Web Scraper for Social Media

    University essay from Malmö universitet/Fakulteten för teknik och samhälle (TS); Malmö universitet/Fakulteten för teknik och samhälle (TS)

    Author : Oskar Lloyd; Christoffer Nilsson; [2019]
    Keywords : scraping; scraper; scrape; crawling; crawler; crawl; scrapy; selenium; social media; dynamic content; web; anti-scraping; anti-crawling; ajax;

    Abstract : In recent years, the act of scraping websites for information has become increasingly relevant. However, along with this increase in interest, the internet has also grown substantially and advances and improvements to websites over the years have in fact made it more difficult to scrape. READ MORE