In this lab, we will learn how to use AWS Glue to create a data pipeline.
Overview
- S3
- Source data
- Glue
- Create crawler to retrieve the metadata
- Create a table
- Athena
- Query the data through the Glue table
Ideas through Technologies
In this lab, we will learn how to use AWS Glue to create a data pipeline.
Overview
S3 bucket can be configured to host a website with static contents (Html, CSS, and JavaScript + media files).
AWS S3 is a main Object and File storage service and can be integrated with many other AWS Services. Also, S3 has many features you need to be familiar with in order to utilize the full functionality of S3.
Continue reading “[AWS] S3 Features”You can control S3 access can be done in 3 ways:
S3 Storage Classes (Storage Tier) – cost, durability, and availability – can be changed manually or using lifecycle policies.
Link: https://aws.amazon.com/s3/storage-classes/
AWS S3 (Simple Storage Service) is a global object storage platform that can be used to store and retrieve any amount of data.
Continue reading “[AWS] S3 Architecture”