Stream data processing

Process unbounded data continuously.


  • Filtering reduce data volume
  • Enrich, might have timestamp etc… might join data with external api to enrich for more info.
  • Aggregate data, e.g. takes an average of a minute, rather than fetch every second.
  • Event detection, only store when a pattern occurs