andkret /Cookbook

The Data Engineering Cookbook

★ 15,550⑂ 2,766👁 549⑃ 102● 141▤ 0
PythonApache-2.0Created 2019-03-10learndataengineering.com/
+2
Daily
15,550
stars
2,766
forks
549
watchers
102
prs
141
issues
0
releases

README

What is this Book?   
  How to Contribute   
  YouTube   
	Twitter   
  Amazon Shop




 If You Like This Book & Need More Help
Check out my Data Engineering Academy at LearnDataEngineering.com trusted by almost 2,000 students!

Visit learndataengineering.com: Click Here

- Learn Data Engineering with our online Academy
- Perfect for becoming a Data Engineer or add Data Engineering to your skillset
- Proven process based on years of experience and hundreds of hours of personal coaching
- Over 30 prepared courses on the most important techniques, fundamental tools and platforms plus our
- Associate Data Engineer Certification
- Academy Discord server with over 1,000 members



 Support This Book For Free!
- Amazon: Click Here buy whatever you like from Amazon using this link (Also check out my complete podcast gear and books)



 Here's what's new:
Find the change log with all recent updates here: SEE UPDATES

 Building a Portfolio Project?
Use my project README template to document it like a professional would: Get the template

 Contents:
- Introduction
- Basic Engineering Skills
- Advanced Engineering Skills
- Free Hands On Courses / Tutorials‚
- Case Studies
- Best Practices Cloud Platforms
- 130+ Data Sources for Portfolio Projects
- Project README Template
- 1001 Interview Questions
- Recommended Books, Courses, and Podcasts
- Updates


- How To Contribute
- Support What You Like
- Important Links

 Full Table Of Contents:
  Introduction
- What is this Cookbook
- Data Engineers
- My Data Science Platform Blueprint
  - Connect
  - Buffer
  - Processing Framework
  - Store
  - Visualize
- Who Companies Need
- How to Learn Data Engineering
	- Andreas on the Super Data Science Podcast
	- Building Blocks to Learn Data Engineering
  - Roadmap for Beginners
	- Roadmap for Data  Analysts
	- Roadmap for Data Scientists
	- Roadmap for Software Engineers
- Data Engineers Skills Matrix
- How to Become a Senior Data Engineer

 Basic Engineering Skills
- Learn To Code
- Get Familiar With Git
- Agile Development
  - Why is agile so important?
  - Agile rules I learned over the years
  - Agile Frameworks
    - Scrum
    - OKR
- Software Engineering Culture
- Learn how a Computer Works
- Data Network Transmission
- Security and Privacy
  - SSL Public and Private Key Certificates
  - JSON Web Tokens
  - GDPR regulations
- Linux
  - OS Basics
  - Shell scripting
  - Cron Jobs
  - Packet Management
- Docker
  - What is Docker and How it Works
    -  Don't Mess Up Your System
    - Preconfigured Images
    - Take it With You
    - Kubernetes Container Deployment
    - How to Create Start and Stop a Container
    - Docker Micro Services
    - Kubernetes
    - Why and How To Do Docker Container Orchestration
    - Userful Docker Commands
- The Cloud
  - IaaS vs PaaS vs SaaS
  - AWS Azure IBM Google IBM
  - Cloud vs On-Premises
  - Security
  - Hybrid Clouds
- Security Zone Design
  - How to secure a multi

Top issues

Snapshot: 2026-11-16T09:23:14Z · Data license Apache-2.0 · JSON