Essays about: "scraper"

Showing result 1 - 5 of 23 essays containing the word scraper.

  1. 1. The One Spider To Rule Them All : Web Scraping Simplified: Improving Analyst Productivity and Reducing Development Time with A Generalized Spider

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Rikard Johansson; [2023]
    Keywords : Web scraping; Web crawlers; HTML; Scrapy; Optimization; Web data extraction; Webbskrapning; Webbsökrobotar; HTML; Scrapy; Optimering; Webbdataextraktion;

    Abstract : This thesis addresses the process of developing a generalized spider for web scraping, which can be applied to multiple sources, thereby reducing the time and cost involved in creating and maintaining individual spiders for each website or URL. The project aims to improve analyst productivity, reduce development time for developers, and ensure high-quality and accurate data extraction. READ MORE

  3. 2. Generic Data Harvester

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : William Asp; Johannes Valck; [2022]
    Keywords : News; Articles; Newspapers; Web crawler; Web site parsing; Optimization; Web robot; Web spider; Web data extraction; HTML; Scrapy; Nyheter; Artiklar; Tidningar; Sökrobot; Analys av hemsida; Optimering; Webbrobot; Webbspindel; Data extrahering hemsidor; HTML; Scrapy;

    Abstract : This report goes through the process of developing a generic article scraper which shall extract relevant information from an arbitrary web article. The extraction is implemented by searching and examining the HTML of the article, by using Python and XPath. READ MORE

  4. 3. The effect of three autogenous bone harvesting methods on bone volume

    University essay from Malmö universitet/Odontologiska fakulteten (OD)

    Author : Charlotte Nicklasson; Alise Austruma; [2022]
    Keywords : autogenous bone; bone block; harvesting; particulated bone; volume; autogent ben; benblock; skördning; partikulerat ben; volym;

    Abstract : ABSTRACT Aim: To evaluate the relation between harvested bone and acquired bone for threedifferent methods used to harvest autogenous bone. Material and method: Bone was harvested from 15 sheep mandibles using threetechniques: bone block, bone scraper, and bone rongeur. Volume change wasdigitally measured with TRIOS 3Shape and 3D Slicer. READ MORE

  5. 4. Data Analysis of Discussions, Regarding Common Vulnerabilities and Exposures, and their Sentiment on Social Media

    University essay from Linköpings universitet/Institutionen för datavetenskap

    Author : Mustafa Rahmati; Danijel Grujicic; [2022]
    Keywords : Social media; Reddit; Twitter; sentiment analysis; computer science; information technology; CVE; information security; CVSS score; Flair; Vader; TextBlob; API; data collection; web scraper; data analysis; natural language processing; NLP; information retrieval;

    Abstract : As common vulnerabilites and exposures are detected, they are also discussed in various social platforms. The problem is that only a few of the posts made about them, are getting enough attention. This leads to an unawareness of potential and critical threats against systems. READ MORE

  6. 5. Automating the extraction of Financial data

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Nicolas Rollino; Rakin Ali; [2022]
    Keywords : Web scraper; Financial data; Textract; AWS; Node.JS; Puppeteer;

    Abstract : It is hard for retail investors and data providing companies to attain financial data of European companies. The work of extracting financial data of European companies is most likely done manually, which is a time-consuming process. This would explain why European companies’ data is supplied slower than American companies. READ MORE