Essays about: "Web crawling"

Showing result 1 - 5 of 11 essays containing the words Web crawling.

  1. 1. Evaluating the Viability of Synthetic Pre-training Data for Face Recognition Using a CNN-Based Multiclass Classifier

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Lars Bergström; Dag Hjelm; [2023]
    Keywords : ;

    Abstract : Today, face recognition is becoming increasingly accurate and faster with deep learning methods such as convolutional neural networks (CNNs), and is now widely used in areas such as security and entertainment. Typically, these CNNs are trained using real-face datasets like CASIA-WebFace, which was put together using web-crawling of IMDB. READ MORE

  3. 2. Further Developing Preload Lists for the Tor Network

    University essay from Karlstads universitet/Institutionen för matematik och datavetenskap (from 2013)

    Author : Daniel Bahmiary; [2023]
    Keywords : Tor; DNS; Preload list; Crawling; Tor; DNS; Preload lista; Webbkrypning;

    Abstract : A recently proposed defense for the anonymity network Tor uses preload lists of domains to determine what should be cached in the Domain Name System (DNS) caches of Tor relays. The defense protects against attacks that infer what is cached in Tor relays. READ MORE

  4. 3. Improving the Chatbot Experience : With a Content-based Recommender System

    University essay from Mittuniversitetet/Institutionen för informationssystem och –teknologi

    Author : Angelica Gardner; [2019]
    Keywords : Chatbot; Recommender system; Web crawling; Bag-of-words; Graph database; GraphQL;

    Abstract : Chatbots are computer programs with the capability to lead a conversation with a human user. When a chatbot is unable to match a user’s utterance to any predefined answer, it will use a fallback intent; a generic response that does not contribute to the conversation in any meaningful way. READ MORE

  5. 4. How to Build a Web Scraper for Social Media

    University essay from Malmö universitet/Fakulteten för teknik och samhälle (TS)

    Author : Oskar Lloyd; Christoffer Nilsson; [2019]
    Keywords : scraping; scraper; scrape; crawling; crawler; crawl; scrapy; selenium; social media; dynamic content; web; anti-scraping; anti-crawling; ajax;

    Abstract : In recent years, the act of scraping websites for information has become increasingly relevant. However, along with this increase in interest, the internet has also grown substantially and advances and improvements to websites over the years have in fact made it more difficult to scrape. READ MORE

  6. 5. A Framework for Fashion Data Gathering, Hierarchical-Annotation and Analysis for Social Media and Online Shop : TOOLKIT FOR DETAILED STYLE ANNOTATIONS FOR ENHANCED FASHION RECOMMENDATION

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Ummul Wara; [2018]
    Keywords : Web-scraper; image-annotation; instagram; zalando; data pre-processing framework; customized-crawler; online-shopping website; deep fashionrecommendation;

    Abstract : Due to the transformation of different recommendation system from contentbased to hybrid cross-domain-based, there is an urge to prepare a socialnetwork dataset which will provide sufficient data as well as detail-level annotation from a predefined hierarchical clothing category and attribute based vocabulary by considering user interactions. However, existing fashionbased datasets lack either in hierarchical-category based representation or user interactions of social network. READ MORE