[AWS] Kinesis Data Analytics

“Kinesis Data Analytics” analyzes streaming data and gains actionable insights in real-time.

Features

Kinesis Data Stream or Kinesis Firehose do not process and analyze data in itself. With Kinesis Data Analytics, you can provide the SQL command against the input stream, and the result is passed to the destination in real-time.

  • It is simple and easy to add data analytics to the data pipeline.
  • It is a fully managed, real-time serverless service.

For SQL Applications (legacy)

  • Running SQL queries on streaming data and providing insight on your data.
    • Creating metrics, dashboard, notification, and alarms
  • Source
    • Kinesis Data Streams
    • Kinesis Firehose
  • Sinks
    • Lambda or Applications via Kinesis Data Streams
    • S3, Redshift via Kinesis Firehose
  • Use Cases
    • Click System Analysis
    • Sending real-time alarms when certain metrics reach the predefined threshold

For Apache Flink

  • Renamed as “AWS Managed Service for Apache Flink”
  • Use Flink to process and analyze streaming data
    • Java, Scala or SQL

Machine Learning

  • SQL Function: RANDOM_CUT_FOREST
    • Used for anomaly detection
  • HOTSPOTS
Unknown's avatar

Published by Pyongwon Lee

IT (Cloud, Web) Development, Philosophy, Economics.

Leave a Comment