Downloads: 1 | Views: 46 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Analysis Study Research Paper | Data & Knowledge Engineering | United States of America | Volume 14 Issue 4, April 2025 | Popularity: 4.4 / 10
Data Orchestration: Modernizing Legacy Data Orchestration with Cloud Composer
Gautami Nadkarni
Abstract: This paper discusses the migration of data orchestration workflows from a legacy tool like Autosys to a modern, cloud - based solution, Google Cloud Composer. It explores the transition from traditional job scheduling to Directed Acyclic Graph (DAG) - based workflows using Apache Airflow, culminating in the deployment and management of these workflows in Cloud Composer. The benefits and challenges of this migration are examined, highlighting the advantages of scalability, flexibility, and cloud integration offered by Cloud Composer.
Keywords: Data Orchestration, Autosys, Apache Airflow, Cloud Composer, DAG, Migration, Cloud Computing, open source
Edition: Volume 14 Issue 4, April 2025
Pages: 156 - 157
DOI: https://www.doi.org/10.21275/SR25401101851
Please Disable the Pop-Up Blocker of Web Browser
Verification Code will appear in 2 Seconds ... Wait