Downloads: 5 | Views: 165 | Weekly Hits: ⮙2 | Monthly Hits: ⮙5
Informative Article | Data & Knowledge Engineering | India | Volume 12 Issue 11, November 2023 | Popularity: 5.1 / 10
Harnessing the Quantum Flux: Architecting and Implementing Real - Time Data Streaming Pipelines with Apache Kafka, Apache Flink, and Cloud - Native Solutions
Abhijit Joshi
Abstract: The rapid evolution of data technologies has ushered in an era where real - time data streaming is pivotal for modern enterprises. This paper delves into the architectures and technologies that enable real - time data streaming, focusing on Apache Kafka, Apache Flink, and cloud - native solutions. It explores various use cases, including real - time analytics, monitoring, and decision - making. By providing insights into best practices for designing and implementing robust real - time data streaming pipelines, this paper aims to equip data engineers with the knowledge needed to harness the power of real - time data for enhanced business outcomes.
Keywords: Real - Time Data Streaming, Apache Kafka, Apache Flink, Cloud - Native Solutions, Real - Time Analytics, Data Pipelines, Monitoring, Decision - Making, Data Architecture, Stream Processing
Edition: Volume 12 Issue 11, November 2023
Pages: 2196 - 2206
DOI: https://www.doi.org/10.21275/SR24627194249
Make Sure to Disable the Pop-Up Blocker of Web Browser
Similar Articles
Downloads: 6 | Weekly Hits: ⮙2 | Monthly Hits: ⮙3
Informative Article, Data & Knowledge Engineering, India, Volume 12 Issue 2, February 2023
Pages: 1730 - 1736Adopting Low - Code Platforms for Data Pipeline Development in Cloud Environments
Chandrakanth Lekkala
Downloads: 7 | Weekly Hits: ⮙2 | Monthly Hits: ⮙2
Informative Article, Data & Knowledge Engineering, India, Volume 12 Issue 4, April 2023
Pages: 1901 - 1904Optimizing Cloud Data Architectures through Predictive Modeling
Joseph Aaron Tsapa
Downloads: 7 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Informative Article, Data & Knowledge Engineering, India, Volume 12 Issue 5, May 2023
Pages: 2667 - 2674Leveraging Reinforcement Learning for Autonomous Data Pipeline Optimization and Management
Chandrakanth Lekkala
Downloads: 10 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Informative Article, Data & Knowledge Engineering, India, Volume 12 Issue 5, May 2023
Pages: 2664 - 2666Empowering AI with Efficient Data Pipelines: A Python Library for Seamless Elasticsearch to BigQuery Integration
Preyaa Atri
Downloads: 16 | Weekly Hits: ⮙1 | Monthly Hits: ⮙2
Informative Article, Data & Knowledge Engineering, India, Volume 7 Issue 11, November 2018
Pages: 1988 - 1991Design and Implementation of High-Throughput Data Streams using Apache Kafka for Real-Time Data Pipelines
Preyaa Atri