Lightning CEP - Joining on High Velocity Stream

Vikas Kale, Kishor Shedge

Abstract: With Internet of Things number of users and devices connected to internet is growing exponentially. Stream processing and CEP systems are designed to support class of applications which requires fast and timely analysis of high volume data streams. Complex event processing, or CEP, is event/stream processing that combines data from multiple sources to infer events or patterns that suggest more complicated circumstances. In this paper we describe how we implemented join operation on high velocity streams for Lightning- High Performance & Low Latency Complex Event Processor. We will discuss how inverted index and other methods can help in improving performance of system.

Keywords: CEP, Complex Event Processing, Stream Processing