Low Latency Data Lookups in Real - Time Data Engineering Pipelines
International Journal of Science and Research (IJSR)

International Journal of Science and Research (IJSR)
Call for Papers | Fully Refereed | Open Access | Double Blind Peer Reviewed

ISSN: 2319-7064


Downloads: 2 | Views: 241 | Weekly Hits: ⮙1 | Monthly Hits: ⮙1

Informative Article | Engineering Science | India | Volume 9 Issue 10, October 2020 | Popularity: 4.6 / 10


     

Low Latency Data Lookups in Real - Time Data Engineering Pipelines

Girish Ganachari


Abstract: Healthcare, finance, and the Internet of Things need real - time data engineering pipelines with low - latency data lookups for processing and decision - making. Incremental ETL pipeline scheduling, FPGA - based hardware acceleration, and on - GPU thread - data remapping minimise latency in this research. It covers low - latency data pipeline applications, benefits, drawbacks, and prospects. It improves flexibility, productivity, and decision - making. To improve real - time data pipelines, the research proposes resource management, hardware - software interaction, and data consistency.


Keywords: Low - latency, Real - time data, Data engineering pipelines, FPGA acceleration, Incremental ETL, On - GPU processing, Data consistency


Edition: Volume 9 Issue 10, October 2020


Pages: 1815 - 1819


DOI: https://www.doi.org/10.21275/SR24801075034


Please Disable the Pop-Up Blocker of Web Browser

Verification Code will appear in 2 Seconds ... Wait



Text copied to Clipboard!
Girish Ganachari, "Low Latency Data Lookups in Real - Time Data Engineering Pipelines", International Journal of Science and Research (IJSR), Volume 9 Issue 10, October 2020, pp. 1815-1819, https://www.ijsr.net/getabstract.php?paperid=SR24801075034, DOI: https://www.doi.org/10.21275/SR24801075034

Top