Skip to content

Data Engineering and Pipeline Fundamentals

Reliable analytics and reporting depend on well built data pipelines, yet many African organisations still move data through fragile manual steps. This course introduces the core practices of data engineering, from ingestion to transformation and delivery. Participants build repeatable pipelines that feed dashboards and analytics with clean, timely data.

What you will be able to do

  • Describe the components of a modern data pipeline and how they fit together.
  • Ingest data from operational systems, files and external sources.
  • Apply transformation and cleaning steps to prepare data for analysis.
  • Design pipelines that run reliably on a schedule with error handling.
  • Manage storage choices between structured and semi structured data.
  • Document and monitor pipelines so downstream users can trust the output.

Course outline

  1. 01The Modern Data Pipeline
  2. 02Data Ingestion Approaches
  3. 03Transformation and Cleaning
  4. 04Scheduling and Orchestration
  5. 05Storage and Data Layout
  6. 06Error Handling and Reliability
  7. 07Monitoring and Documentation
  8. 08Delivering Data to Consumers

Who should attend

Data analysts, business intelligence developers, IT staff and technically minded professionals moving into data engineering roles.

Dates, venues and fees

DatesVenueDaysFeeCalendar
17 to 19 Aug 2026Pretoria3R13,000
24 to 26 Aug 2026Cape Town3R13,000
7 to 9 Sep 2026Online3US$900
14 to 16 Sep 2026Mozambique3US$1,500
21 to 23 Sep 2026Cairo3US$1,500
28 to 30 Sep 2026Accra3US$1,500
5 to 7 Oct 2026Lusaka3US$1,500
12 to 14 Oct 2026Kigali3US$1,500
19 to 21 Oct 2026Nairobi3US$1,500
26 to 28 Oct 2026Durban3R13,000
2 to 4 Nov 2026Johannesburg3R13,000
16 to 18 Nov 2026Mauritius3US$1,500
23 to 25 Nov 2026Dubai3US$1,500
30 Nov to 2 Dec 2026Lagos3US$1,500
7 to 9 Dec 2026Harare3US$1,500
14 to 16 Dec 2026Kampala3US$1,500
21 to 23 Dec 2026Dar es Salaam3US$1,500

Fees are per delegate. South African venues are priced in rand; other locations and online in US dollars. Fees exclude 15% VAT where applicable. Group bookings of three or more delegates from the same organisation qualify for a reduced rate; contact us for a quotation.

Related courses in Data, Digital and Cyber Security

Data, Digital and Cyber Security

Cyber Security Fundamentals for Business Teams

Most breaches begin with an ordinary employee making a reasonable decision on incomplete information. Cyber security is translated into...

Next session
31 Aug to 2 Sep 2026
Venue
Harare
3 day programme
FromUS$900
Data, Digital and Cyber SecurityNew

Artificial Intelligence for Business Managers

Artificial intelligence has moved from novelty to something managers are expected to have an opinion on. Non technical leaders get a...

Next session
31 Aug to 2 Sep 2026
Venue
Mauritius
3 day programme
FromUS$900
Data, Digital and Cyber Security

Data Analytics and Dashboard Reporting for Decision Makers

Organisations collect far more data than they use well. Delegates clean and structure operational data, build dashboards that answer a...

Next session
31 Aug to 4 Sep 2026
Venue
Durban
5 day programme
FromUS$900
See all Data, Digital and Cyber Security courses