Downloads: 2 | Views: 241 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1
Informative Article | Engineering Science | India | Volume 9 Issue 10, October 2020 | Popularity: 4.6 / 10
Low Latency Data Lookups in Real - Time Data Engineering Pipelines
Girish Ganachari
Abstract: Healthcare, finance, and the Internet of Things need real - time data engineering pipelines with low - latency data lookups for processing and decision - making. Incremental ETL pipeline scheduling, FPGA - based hardware acceleration, and on - GPU thread - data remapping minimise latency in this research. It covers low - latency data pipeline applications, benefits, drawbacks, and prospects. It improves flexibility, productivity, and decision - making. To improve real - time data pipelines, the research proposes resource management, hardware - software interaction, and data consistency.
Keywords: Low - latency, Real - time data, Data engineering pipelines, FPGA acceleration, Incremental ETL, On - GPU processing, Data consistency
Edition: Volume 9 Issue 10, October 2020
Pages: 1815 - 1819
DOI: https://www.doi.org/10.21275/SR24801075034
Please Disable the Pop-Up Blocker of Web Browser
Verification Code will appear in 2 Seconds ... Wait