Intermediate Python for Data Engineers (English)

The "Intermediate Python for Data Engineers" training is aimed at Data Engineers, Data Analysts and Data Scientists who want to be able to process data effectively. In terms of cloud use, we focus on Azure, but the ways of working are not Azure-specific: participants who work more on-premises, in private clouds or on other public clouds (e.g. AWS, GCP or Oracle Cloud) also benefit greatly from this training.

After the course you will be able to write Python scripts to access and process data from various sources. The focus here is on loading, storing and transferring more complex resources, APIs and file formats.

Do you want to learn more about the (substantive) transformation and analysis of data? Then take a look at our training Python Fundamentals for Data Engineers

We will work with many hands-on assignments in Python over the course of two days. At the end of the course you will have achieved the following learning objectives:

• Being able to handle complex(er) files, such as nested JSON files, XML and Parquet
• Understand how filesystems differ in Windows and Linux environments
• Can copy and move files
• Knowing when to do things in Python or better within a shell environment
• Pickle to store Python objects such as trained ML models or processed Data Frames on a data lake or disk.
• Able to read and write to an Azure Data Lake using the Azure modules
• Being able to unlock APIs and knowing smart ways to do this on a larger scale
• Apply logging to monitor progress in a structured way during the execution of your program code and to link up with existing logging solutions.