International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Call for Papers | Fully Refereed | Open Access | Double Blind Peer Reviewed

ISSN: 2319-7064

Downloads: 0 | Views: 89

Informative Article | Information Technology | India | Volume 10 Issue 5, May 2021 | Rating: 4.7 / 10

Implementing Cloud-Native Technologies for Big Data Processing: A Case Study with Kubernetes and Airflow

Chandrakanth Lekkala [4]

Abstract: This paper presents a case study on the architecture design and implementation details of cloud-native technologies for big data processing. Cloud-native technologies, such as Kubernetes and Airflow, are modern solutions intricately connected as essential components within IT infrastructures. They are designed specifically for processing and managing data in cloud environments. These technologies leverage the scalability and flexibility of cloud computing to enable efficient and reliable data storage, analysis, and retrieval., focusing on Apache Airflow and Kubernetes. Acting as a container orchestrator, Kubernetes efficiently manages a vast number of containers, eliminating the necessity to explicitly outline the configuration for executing specific tasks. Meanwhile, Airflow is the orchestration layer for managing data processing workflows within the Kubernetes environments. The findings of this paper underscore the potential of Kubernetes and Airflow in enabling seamless orchestration and management of big data workflows in cloud environments.

Keywords: Cloud-native, Apache Airflow, Kubernetes, Big Data Processing, Orchestration Stability, Efficiency

Edition: Volume 10 Issue 5, May 2021,

Pages: 1335 - 1340

How to Download this Article?

Type Your Valid Email Address below to Receive the Article PDF Link

Verification Code will appear in 2 Seconds ... Wait