ECS/EKS container services , docker, airflow, snowflake database

ECS/EKS container services

A container is a standard unit of software that packages up code and all its dependencies so the application runs quickly and reliably from one computing environment to another.

Docker is a software platform for building applications based on containers — small and lightweight execution environments that make shared use of the operating system kernel but otherwise run in isolation from one another. While containers as a concept have been around for some time, Docker, an open source project launched in 2013, helped popularize the technology, and has helped drive the trend towards containerization and microservices in software development that has come to be known as cloud-native development.

Docker is a software platform that allows you to build, test, and deploy applications quickly. Docker packages software into standardized units called containers that have everything the software needs to run including libraries, system tools, code, and runtime. Using Docker, you can quickly deploy and scale applications into any environment and know your code will run.

containers amazon offers

https://aws.amazon.com/containers/services/

I used EMR before

https://aws.amazon.com/emr/


a tutorial for docker

https://www.youtube.com/watch?v=K6WER0oI-qs



airflow: Airflow is a platform to programmatically author, schedule and monitor workflows.

a short summary

https://blog.insightdatascience.com/airflow-101-start-automating-your-batch-workflows-with-ease-8e7d35387f94


https://airflow.apache.org/project.html

how to install

https://airflow.apache.org/installation.html

video tutorial

https://www.youtube.com/watch?v=AHMm1wfGuHE






snowflake database: cloud based data warehouse

https://docs.snowflake.net/manuals/user-guide/getting-started-tutorial.html