Scriptorium

[AWS] Kinesis Data Streams

Kinesis Data Streams (KDS) collects and processes a large amount of incoming data from an unlimited number of producers.

AWS S3 is a main Object storage service and can be integrated with many other AWS Services. Also, S3 has many features that you need to be familiar with in order to utilize the full functionality of S3.

[AWS] Kinesis

Kinesis is a fully managed, scalable, and resilient streaming service. It is designed to ingest a large amount of data in real-time from many producers – such as video, audio, application logs, website clickstreams, and IoT telemetry data -.

[AWS] S3 Security and Encryption

You can control S3 access in 3 ways:

Bucket Policies apply across the bucket.
Object Permissions apply to individual files.
IAM (Identity) policies apply to users and groups

[Kubernetes] Jobs & CronJobs

A Job creates one or more pods and will continue to retry execution of the Pods until a specified number of them successfully terminate. As pods successfully complete, the Job tracks the successful completions. When the specified number of successful completions is reached, the job is complete.