Airflow AWS S3 Sensor Operator: Airflow Tutorial P12

Описание

Airflow AWS S3 Sensor Operator: Airflow Tutorial P12

#Airflow #AirflowTutorial #Coder2j

========== VIDEO CONTENT ? ==========
Today I am going to show you how to sensor files in AWS S3 Bucket. By watching this video, you will know:
? How to set up local S3 service
? How to sense file in S3 bucket

Video Request: https://forms.gle/UMp4GA3krcSMMWzy9

========== L I N K S ? ==========
Airflow Documentation ? https://bit.ly/3wbTqv4

========== T I M E S T A M P ⏰ ==========
00:00 - What is Sensor Operator
00:52 - What is MinIO
01:20 - Setup MinIO in Docker container
02:36 - Create bucket and upload file
04:36 - Create Airflow Dag
06:13 - Check Amazon provider package doc
08:04 - Setup S3 sensor task
11:02 - S3 Sensor in practice

========== Connect with me ? ==========
Twitter ? https://twitter.com/Coder2j
Website ? https://coder2j.com
GitHub ? https://github.com/coder2j