Essays about: "scraping"

Showing result 11 - 15 of 56 essays containing the word scraping.

1. 11. Data mining historical insights for a software keyword from GitHub and Libraries.io; GraphQL

   University essay from Linköpings universitet/Institutionen för datavetenskap

   Author : Gustaf Bodemar; [2022]
   Keywords : Data mining; Web scraping; Historical data analysis; GitHub; Libraries.io; GraphQL; Datautvinning; Webbskrapning; Historisk dataanalys; GitHub; Libraries.io; GraphQL;

   Abstract : This paper explores an approach to extracting historical insights into a software keyword by data mining GitHub and Libraries.io. We test our method using the keyword GraphQL to see what insights we can gain. We managed to plot several timelines of how repositories and software libraries related to our keyword were created over time. READ MORE

3. 12. Digital Twin Performance : Unity as a platform for visualizing interactive digital twins

   University essay from Mittuniversitetet/Institutionen för informationssystem och –teknologi

   Author : Tim Nämerforslund; [2022]
   Keywords : Unity Engine; C#; Data Point; Vertex; Vertices; Mesh; Frames per second; Usability; Digital twin; Simulation.;

   Abstract : The project set out to construct a proof of concept for surface deformation in the Unity Engine using available assets and tools compatible with the Unity Engine, and via the proof of concept investigate which factors in a mesh deformation simulation that affects performance in terms of frames per second, memory usage and usability the most. This while looking into suitable data structures in the Unity Engine for handling expected data in a physics simulation of a surface deformation, such that of mining or scraping a cave wall. READ MORE

4. 13. Scraping bot detection using machine learning

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Hamta Dezfoli; Joseph Newman; [2022]
   Keywords : Artificial agents; Bot detection; Machine learning; Data analysis; HTTP requests; ReCaptcha; Artificiella agenter; Detektering av bottar; Maskininlärning; Dataanalys; HTTP förfrågningar; ReCaptcha;

   Abstract : Illegitimate acquisition and use of data is a problematic issue faced by many organizations operating web servers on the internet today. Despite frameworks of rules to prevent ”scraping bots” from carrying out this action, they have developed advanced methods to continue taking data. READ MORE

5. 14. The Dynamics of Rent Gap Formation in Copenhagen : An empirical look into international investments in the rental market

   University essay from Malmö universitet/Institutionen för Urbana Studier (US)

   Author : Martin Bonde-Hansen; [2021]
   Keywords : rent gap theory; gentrification; housing; urban economics; web scraping; GIS; big data; Blackstone;

   Abstract : .... READ MORE

6. 15. End user interface for collecting and evaluating company data : Real-time data collection through web-scraping

   University essay from Högskolan Dalarna/Institutionen för information och teknik

   Author : Vadim Cosman; Kailash Chowdary; [2021]
   Keywords : ;

   Abstract : The demand of open and reliable data, in the Era of Big Data is constantly increasing as thediversity of research and the need of trustworthy data as high-quality data is increasesconsiderably the quality of the findings . However, it is very hard to get reliable data for free witha small effort. READ MORE