Essays about: "hadoop"

Showing result 1 - 5 of 71 essays containing the word hadoop.

  1. 1. Sequential Anomaly Detection for Log Data Using Deep Learning

    University essay from Göteborgs universitet/Institutionen för matematiska vetenskaper

    Author : Lina Hammargren; Wei Wu; [2021-06-14]
    Keywords : anomaly detection; recurrent neural network; long short-term memory; semi-supervised learning; seq2seq; transformer; unsupervised learning; log analysis;

    Abstract : Abstract Software development with continuous integration changes needs frequent testing for assessment. Analyzing the test output manually is time-consuming and automating this process could be beneficial to an organization. READ MORE

  3. 2. Hadoop scalability evaluation for machine learning algorithms on physical machines : Parallel machine learning on computing clusters

    University essay from Högskolan i Skövde/Institutionen för informationsteknologi

    Author : Jens Roderus; Simon Larson; Eric Pihl; [2021]
    Keywords : Parallel machine learning; cluster computing; Hadoop; performance analysis;

    Abstract : The amount of available data has allowed the field of machine learning to flourish. But with growing data set sizes comes an increase in algorithm execution times. READ MORE

  4. 3. Automating Log Analysis

    University essay from Blekinge Tekniska Högskola/Institutionen för datavetenskap

    Author : Sri Sai Manoj Kommineni; Akhila Dindi; [2021]
    Keywords : Anomaly detection; Log analysis; Unsupervised learning;

    Abstract : Background: With the advent of the information age, there are many large numbers of services rising which run on several clusters of computers.  Maintaining such large complex systems is a very difficult task. Developers use one tool which is common for almost all software systems, they are the console logs. READ MORE

  5. 4. Evaluating the use of Machine Learning for Fault Detection using Log File Analysis

    University essay from Mittuniversitetet/Institutionen för informationssystem och –teknologi

    Author : Rosen Nikolaev Tenov; [2021]
    Keywords : Machine learning; fault detection; log file; artificial neural network; Maskininlärning; feldetektering; loggfil; artificiellt neuralt nätverk;

    Abstract : Under de senaste åren fick maskininlärning mer och mer popularitet i samhället. Den implementeras i stor utsträckning inom många datavetenskapliga områden, t.ex. igenkänning av tal, video, objekt, sentimentanalys osv. READ MORE

  6. 5. Spark on Kubernetes using HopsFS as a backing store : Measuring performance of Spark with HopsFS for storing and retrieving shuffle files while running on Kubernetes

    University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

    Author : Shivam Saini; [2020]
    Keywords : Spark; Kubernetes; HopsFS; Data processing; Distributed and Parallel processing;

    Abstract : Data is a raw list of facts and details, such as numbers, words, measurements or observations that is not useful for us all by itself. Data processing is a technique that helps to process the data in order to get useful information out of it. Today, the world produces huge amounts of data that can not be processed using traditional methods. READ MORE