What are the basics you should cover when you build an ETL pipeline?
🎬In this episode I am showing you how an ETL process would look like. We are going to load the data from Task 8 and load it into our local PostgreSQL database.
✨If you are new here:
This is a public and weekly online Python Class which you can attend as well. All you have to do is to join our Discord server if you are interested! Links down below :)
==== CLASS STARTS AT 4:30 ====
⏱ Timestamps
0:00 Intro & Agenda
1:00 Recap - How to start web scraping using DEV TOOLS
4:30 Example how my ETL pipeline would look like
9:30 What is a logger?
17:00 Test the database connection
27:25 How to create a database table based on your data
42:00 How to extract the .json data and load into PostgreSQL
========================
If you want to learn how to become a programmer and build automated software, this video is for you. Feel free to drop them in the comments or join our socials!
========================
🙋♂️Community Discord:
[ Ссылка ]
[ Ссылка ]
blog.theselfdev.com
pomo.theselfdev.com
📲 Instagram:
[ Ссылка ]
📩 Connect with me:
Instagram - [ Ссылка ]
Twitch - [ Ссылка ]
Twitter - [ Ссылка ]
BGM: [ Ссылка ]
Subscriber: 1174
#dataengineering #pythontutorial #dataanalysis
📚The FASTEST way to become a Data Engineer:
[ Ссылка ]
📚Knowing this about DATA will shock you:
[ Ссылка ]
📚FREE Python Programming Class:
[ Ссылка ]
![](https://i.ytimg.com/vi/HVnzn9TOwlA/maxresdefault.jpg)