Downloads: 3 | Views: 123 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Informative Article | Science and Technology | India | Volume 9 Issue 6, June 2020 | Rating: 4.7 / 10
Designing a Resilient Parallel Distributed Task Infrastructure for Large-Scale Data Processing
Mahidhar Mullapudi [11] | Mahesh Babu Munjala [2] | Chinmay Kulkarni
Abstract: This technical paper introduces a sophisticated Parallel Distributed Task Infrastructure (PDTI) meticulously crafted to address the escalating demands of large-scale data processing[1][2] and transformation systems. PDTI orchestrates parallel tasks across distributed nodes, strategically optimizing latency, throughput, and processing power. The infrastructure's core components include a parent task overseeing task distribution, progress tracking, and error management across child tasks, with a paramount focus on resilience and fault tolerance. This paper expounds upon the architectural intricacies and contractual guidelines of PDTI, presenting a holistic solution to efficiently navigate the challenges inherent in processing extensive datasets within distributed computing environments[3][4][5][6].
Keywords: Parallel Distributed Task, Scalable data processing, Resilient Computing, Task Synchronization
Edition: Volume 9 Issue 6, June 2020,
Pages: 1925 - 1929