Essays about: "Shidi Zhou"

Found 2 essays containing the words Shidi Zhou.

1. 1. Auto-Tuning Apache Spark Parameters for Processing Large Datasets

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Shidi Zhou; [2023]
   Keywords : Apache Spark; Cloud Environment; Spark Configuration Parameter; Resource Utilization; Ridge Regression; Elastic Net; Random Forest; Deep Neural Network; Bayesian Optimization; Particle Swarm Optimization.; Apache Spark; Molnmiljö; Apache Spark konfigurationsparameter; Resursutnyttjande; Ridge-regression; Elastisk nät; Slumpskog; Djupt neuralt nätverk; Bayesiansk optimering; Partikelsvärmsoptimering.;

   Abstract : Apache Spark is a popular open-source distributed processing framework that enables efficient processing of large amounts of data. Apache Spark has a large number of configuration parameters that are strongly related to performance. Selecting an optimal configuration for Apache Spark application deployed in a cloud environment is a complex task. READ MORE

3. 2. A Web Scraper For Forums : Navigation and text extraction methods

   University essay from KTH/Skolan för informations- och kommunikationsteknik (ICT)

   Author : Michael Palma; Shidi Zhou; [2017]
   Keywords : Data mining; Web Scraper; Java; Web forums; Text-extraction; Link Duplicates; Data mining; Web Scraper; Java; Web forums; Text-extraction; Link Duplicates;

   Abstract : Web forums are a popular way of exchanging information and discussing various topics. These websites usually have a special structure, divided into boards, threads and posts. Although the structure might be consistent across forums, the layout of each forum is different. READ MORE