Essays about: "Web crawlers"

Found 4 essays containing the words Web crawlers.

  1. 1. The One Spider To Rule Them All : Web Scraping Simplified: Improving Analyst Productivity and Reducing Development Time with A Generalized Spider

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Rikard Johansson; [2023]
    Keywords : Web scraping; Web crawlers; HTML; Scrapy; Optimization; Web data extraction; Webbskrapning; Webbsökrobotar; HTML; Scrapy; Optimering; Webbdataextraktion;

    Abstract : This thesis addresses the process of developing a generalized spider for web scraping, which can be applied to multiple sources, thereby reducing the time and cost involved in creating and maintaining individual spiders for each website or URL. The project aims to improve analyst productivity, reduce development time for developers, and ensure high-quality and accurate data extraction. READ MORE

  3. 2. Collecting and analyzing Tor exit node traffic

    University essay from Blekinge Tekniska Högskola/Fakulteten för datavetenskaper; Blekinge Tekniska Högskola/Institutionen för datavetenskap

    Author : Torbjörn Jonsson; Gustaf Edeby; [2021]
    Keywords : Deep packet inspection; Traffic analysis; Tor network; The Onion router;

    Abstract : Background. With increased Internet usage occurring across the world journalists, dissidents and criminals have moved their operations online, and in turn, governments and law enforcement have increased their surveillance of their country’s networks. READ MORE

  4. 3. Fukushima Daiichi as a heterotopia : Dark tourism in dystopian places

    University essay from Lunds universitet/Centrum för öst- och sydöstasienstudier

    Author : Klas Bergman; [2018]
    Keywords : Fukushima; Heterotopia; Tourism; Dark tourism; Digital and visual methods; Japan; Social Sciences;

    Abstract : This thesis deals with tourism to Fukushima. Specifically, it examines how traditional tourism and dark tourism shape the identity of Fukushima. READ MORE

  5. 4. Anomaly detection on social media using ARIMA models

    University essay from Uppsala universitet/Institutionen för informationsteknologi

    Author : Tim Isbister; [2015]
    Keywords : ;

    Abstract : This thesis explores whether it is possible to capture communication patterns from web-forums and detect anomalous user behaviour. Data from individuals on web-forums can be downloaded using web-crawlers, and tools as LIWC can make the data meaningful. READ MORE