KNIME logo
Contact usDownload

[L3-DE] Productionizing Data Pipelines

September 23 - 27, 2024 | Online Course
Online Course
L3-DE: Data Engineering hero
Stacked TrianglesPanel BG

You’ve developed a data pipeline using KNIME Analytics Platform. Now, how to automate it, ensuring that your data is regularly updated and readily available to your end users?

In this course, you will learn procedures and best practices to prepare, test, and deploy transparent, robust, and efficient data pipelines manually and automatically on KNIME Business Hub. You will work on a use case of creating a data pipeline to manage restaurant orders data.

In the first session of this course, you will learn how to build a modular data pipeline and how to prepare and test its modules (a data transformation workflow) before deployment. In the second session, you will be introduced to KNIME Business Hub features and will learn how to schedule and trigger a data pipeline. In the third session, you will learn how to automate the validation and deployment processes with the Continuous Deployment for Data Science (CDDS) extension. Finally, in the fourth session, you will be introduced to data governance principles and learn best practices to productionize data pipelines. 

This is an instructor-led course consisting of four, 75-minutes online sessions run by our KNIME data scientists. Each session has an exercise for you to complete at home and together, we will go through the solution at the start of the following session. The course concludes with a 15 to 30-minute wrap up session.

  • Session 1: Preparing a data pipeline for deployment
  • Session 2: Introduction to KNIME Business Hub
  • Session 3: Validation and deployment automation
  • Session 4: Best practices to productionize data pipelines
  • Session 5: Optional follow-up Q&A (15-30min)

FAQ

You first need to create an account on the KNIME Learning Store. After you log on to the KNIME Learning Store, clicking on the “Register now” button will take you to the course web page.

You should already know how to build workflows using KNIME Analytics Platform. This course doesn’t provide an introduction to KNIME Analytics Platform - it focuses on more advanced concepts of automating and building workflows.

You can join the course using the Zoom links found in your LearnUpon course page. Please note that each Zoom link is specific to a particular session. Make sure you have a stable internet connection!

Sure! The sessions will be recorded and you’ll have access to each one for one month from the time the session is over.

Absolutely - fire away!

Your own laptop, ideally pre-installed with the latest version of KNIME Analytics Platform and required extensions (details will follow in the reminder email).

Download the latest free, open source version of KNIME Analytics Platform here: knime.com/download

You will be granted temporary access to KNIME Business Hub during this course to work on exercises. The credential to access KNIME Business Hub will be given to you on the first day of the course. You do not need to use your organization’s KNIME Business Hub for this course.