ECS/EKS container services
A container is a standard unit of software that packages up code and all its dependencies so the application runs quickly and reliably from one computing environment to another.
Docker is a software platform for building applications based on containers — small and lightweight execution environments that make shared use of the operating system kernel but otherwise run in isolation from one another. While containers as a concept have been around for some time, Docker, an open source project launched in 2013, helped popularize the technology, and has helped drive the trend towards containerization and microservices in software development that has come to be known as cloud-native development.
Docker is a software platform that allows you to build, test, and deploy applications quickly. Docker packages software into standardized units called containers that have everything the software needs to run including libraries, system tools, code, and runtime. Using Docker, you can quickly deploy and scale applications into any environment and know your code will run.
containers amazon offers
https://aws.amazon.com/containers/services/
I used EMR before
https://aws.amazon.com/emr/
a tutorial for docker
https://www.youtube.com/watch?v=K6WER0oI-qs
airflow: Airflow is a platform to programmatically author, schedule and monitor workflows.
a short summary
https://blog.insightdatascience.com/airflow-101-start-automating-your-batch-workflows-with-ease-8e7d35387f94
https://airflow.apache.org/project.html
how to install
https://airflow.apache.org/installation.html
video tutorial
https://www.youtube.com/watch?v=AHMm1wfGuHE
snowflake database: cloud based data warehouse
https://docs.snowflake.net/manuals/user-guide/getting-started-tutorial.html
No comments:
Post a Comment