StreamSets in IBM watsonx.data integration | Practical AI training | Applied Academy

Courses/Data Engineering

NOK 3,990Intermediate · IBM watsonx.data integration · IBM StreamSets · Python · Apache Kafka

StreamSets in IBM watsonx.data integration

Build, run and automate real-time StreamSets flows in IBM watsonx.data integration, from the canvas to the Python SDK and CI.

How do you want to learn?

Duration: One day, 6 hours live
Where: Classroom in Oslo or remote
Lab setup: IBM trial and a prepared engine host
Certificate: Score 75 % or more on the final assessment

The case · ShopNow

ShopNow sees late deliveries and rising returns only in the next morning's batch report.

Orders and returnsPostgreSQL shop database

ShipmentsCarrier REST API

You buildStreaming flows from the shop database and carrier API to KafkaOrder and return changes stream from PostgreSQL with change data capture, customer emails are masked on the way, and carrier shipments join the same topics.

Late deliveriesVisible while orders are in transit

Customer emailsMasked before they leave the flow

StreamSetsPostgreSQL CDCKafkaPython SDK

Illustrative: ShopNow is the fictional retailer used in the labs.

After this course you can

01Set up a project, a StreamSets environment and a Data Collector engine in watsonx.data integration.
02Build streaming flows that read databases, change data and Kafka topics and survive data drift.
03Transform, mask and route records with processors and the StreamSets expression language.
04Run, monitor and restart jobs from the unified control plane.
05Create, run and promote flows as code with the watsonx.data integration Python SDK.

Steps

The day includes a lunch break and short breaks.

The unified control planeSee how StreamSets fits in watsonx.data integration and how projects, environments, engines, flows and jobs relate.Lab · Create the ShopNow project and a StreamSets environment in your trial account.

Are you ready?

Made forData engineers and integration developers who build or run real-time data flows, including classic StreamSets users moving to watsonx.data integration.

You'll needWorking SQL and a basic idea of databases and data pipelines.Basic Python: running a script and editing variables.Basic command line skills.

Setup checklistInstructor-ledStart the one-month IBM watsonx.data integration trial a few days before the course.Bring a laptop with a browser; the engine host is prepared for you.Install Python 3.10 or later for the SDK labs.

The IBM trial lasts one month. Start it no more than a week before the course day.

Questions

Instructors

Rukhmah Aamir

AI and ML Engineer with experience in content creation and in end-to-end solution design and implementation.

I am an AI engineer who loves solving real data problems. I use AI to find patterns, automate repetitive work and turn messy data into insights teams can trust. I work with data cleaning, data preparation and tech products. In my courses, I focus on practical, hands-on learning.

Saleem Pothiwala

Data engineering, AI engineering, strategy

28+ years in data. Built Kermit Tech to help Nordic and Middle East enterprises turn data into competitive advantage. He helps teams build and use data and AI solutions, with hands-on experience across finance, research, and nonprofit organizations. An IBM StreamSets Black Belt, Saleem teaches through practical examples and guided exercises. His courses help learners turn technical concepts into skills they can use at work.