![[L4-DE] Data Engineering: Specialization](https://www.knime.com/sites/default/files/public/2024-07/l4-de-data-engineering-specialization.png)
In this course, you will learn how to develop and orchestrate ETL and ELT data pipelines with KNIME Analytics Platform following best practices and data governance principles. Besides, you will learn data anonymization techniques and tools to process big data on-premise and on cloud.
In the first session of this course, you will focus on the data extraction part of an ETL pipeline, recap common data sources, and learn best practices for secure, governed, and efficient data access. In the second session, you will focus on data transformation and loading parts of an ETL pipeline and will be introduced to data anonymization techniques. In the third session, you will learn how to build an ELT pipeline and learn how to handle big data with the Apache Spark integration, on-premise and on cloud. Finally, in the fourth session, you will learn how to orchestrate data pipelines, and dive deeper into data governance topics and learn how to monitor data quality, ensure data security, and enable observability.
This is an instructor-led course consisting of four, 75-minute online sessions run by one of our KNIME data scientists. Each session has an exercise for you to complete at home and together, we will go through the solution at the start of the following session. The course concludes with a 15 to 30 minute wrap up session.
- Session 1: ETL vs ELT, ETL: extraction
- Session 2: ETL: transformation and loading, data anonymization
- Session 3: ELT, big data, Hadoop, Spark, cloud
- Session 4: Data pipelines orchestration, data governance
- Session 5: Q&A
FAQ
You should already know how to build workflows, access databases and files, use flow variables and components in KNIME Analytics Platform. We recommend taking at least L1-AP and L2-DE courses before attending this course. Additionally, we recommend the L3-DE course if the topic of productionization is relevant to you.
You first need to create an account on the KNIME Learning Store. After you log on to the KNIME Learning Store, clicking on the “Register now” button will take you to the course web page.
You can join the course using the Zoom links found in your LearnUpon course page. Please note that each Zoom link is specific to a particular session. Make sure you have a stable internet connection!
Sure! The sessions will be recorded and you’ll have access to each one for one month from the time the session is over.
Absolutely - fire away!
Your own laptop, ideally pre-installed with the latest version of KNIME Analytics Platform and required extensions (details will follow in the reminder email).
Check out our Self-paced courses, KNIME Books, Cheat Sheets, KNIME Forum, and KNIME Hub.