Essays about: "Kafka"

Showing result 11 - 15 of 27 essays containing the word Kafka.

1. 11. A COMPARISON OF DATA INGESTION PLATFORMS IN REAL-TIME STREAM PROCESSING PIPELINES

   University essay from Mälardalens högskola/Akademin för innovation, design och teknik

   Author : Sebastian Tallberg; [2020]
   Keywords : stream processing; data ingestion; Redis Streams; Apache Kafka; Apache Pulsar; performance benchmark; real-time streaming;

   Abstract : In recent years there has been an increasing demand for real-time streaming applications that handle large volumes of data with low latency. Examples of such applications include real-time monitoring and analytics, electronic trading, advertising, fraud detection, and more. READ MORE

3. 12. Aggregating and utilizing sensor data

   University essay from Lunds universitet/Industriell elektroteknik och automation

   Author : Maximillian Vilensten; Oskar Hermansson; [2020]
   Keywords : IoT; Data lake; Axis; Message broker; Cloud; Microsoft Azure; AWS; IBM cloud; Apache Kafka; Apache Pulsar; Technology and Engineering;

   Abstract : The world of data is changing fast, while data always have been present in the world of computer science the importance of data has in the last couple of years grown, and it does not seem to be slowing down. The data usage is steadily increasing and the amount of data is growing, as well as the ever expanding amount of devices that produce data, especially in fields such at IoT and cloud computing. READ MORE

4. 13. Implementation and Evaluation of a DataPipeline for Industrial IoT Using ApacheNiFi

   University essay from Karlstads universitet

   Author : Lina Vilhelmsson; Pontus Sjöberg; [2020]
   Keywords : Data pipelining; Apache NiFi; IIoT; Industrial IoT;

   Abstract : In the last few years, the popularity of Industrial IoT has grown a lot, and it is expected to have an impact of over 14 trillion USD on the global economy by 2030. One application of Industrial IoT is using data pipelining tools to move raw data from industry machines to data storage, where the data can be processed by analytical instruments to help optimize the industrial operations. READ MORE

5. 14. Performance evaluation of message-oriented middleware

   University essay from KTH/Hälsoinformatik och logistik

   Author : Erik Nilsson; Victor Pregén; [2020]
   Keywords : Message-oriented middleware; Kafka; RabbitMQ; Nats; Nats Streaming; Throughput; Latency; Meddelandeorienterad mellanprogramvara; Kafka; RabbitMQ; Nats; Nats Streaming; Genomströmning; Latens;

   Abstract : Message-oriented middleware (MOM) is a middleware used for communication between applications. There are many different MOM technologies available today, each offering different performance (throughput and latency). The performance of MOMs depends on both message size and message guarantee settings used. READ MORE

6. 15. Hudi on Hops : Incremental Processing and Fast Data Ingestion for Hops

   University essay from KTH/Skolan för elektroteknik och datavetenskap (EECS)

   Author : Netsanet Gebretsadkan Kidane; [2019]
   Keywords : Hudi; Hadoop; Hops; Upsert; SQL; Spark; Kafka; Hudi; Hadoop; Hops; Upsert; SQL; Spark; Kafka;

   Abstract : In the era of big data, data is flooding from numerous data sources and many companies have been utilizing different types of tools to load and process data from various sources in a data lake. The major challenges where different companies are facing these days are how to update data into an existing dataset without having to read the entire dataset and overwriting it to accommodate the changes which have a negative impact on the performance. READ MORE