How to repartition AWS S3 (Datalake) from string date column to year, month| Athena CTAS

Описание

How to repartition AWS S3 (Datalake) from string date column to year, month| Athena CTAS

SQL code Snippets
https://pastebin.com/h2ha6uju

select date_format(cast( date_parse('2022-08-09','%Y-%m-%d') as date), '%m') as year


Using CTAS and INSERT INTO for ETL and data analysis | partition
Code and Labs: https://docs.aws.amazon.com/athena/latest/ug/ctas-insert-into-etl.html


How can I set the number or size of files when I run a CTAS query in Athena?
https://www.youtube.com/watch?v=lcwpWYcuSiU&feature=youtu.be

How do I add Partition to the already existing table in athena to speed up and improve performance?
https://www.youtube.com/watch?v=KVkWZcz-YMw&t=1s

How to Monitor Athena Usage to Understand Your Operations, and Control Security and Costs with Code
https://www.youtube.com/watch?v=zKaYydk1SMc&feature=youtu.be

How we got 50X faster Speed for querying Data Lake using Athena Query & saved Thousands of dollars | Case Study
https://www.linkedin.com/pulse/how-we-got-50x-faster-speed-querying-data-lake-using-athena-shah/


How to Flatten Complex JSON into Separate Folders for Athena Query |Glue Job | Glue Notebook
https://youtu.be/47zL8cP6ZUI

Finding PII Data in Datalake &creating Reports & Dashboard with AWS Macie and Athena & Quick Sight
https://youtu.be/C1FFkYJRntE

Reading Simple Article assisted us in doubling or tripling the speed of Athena queries.
https://youtu.be/4S8NwsG4LFQ

Setting up and using AWS Athena federated queries| Query DynamoDB with SQL Via Athena Tutorial
https://youtu.be/3hkkb7FRboo

------ Connect With Me --------
Website : https://soumilshah.herokuapp.com
Github : https://github.com/soumilshah1995
Linkedin : https://www.linkedin.com/in/shah-soumil/
Blog : https://soumilshah1995.blogspot.com/
Youtube : https://www.youtube.com/channel/UC_eOodxvwS_H7x2uLQa-svw?view_as=subscriber

-------------------------------------