This tutorial track builds the second pipeline with the name payment-p2. It will dedup on the record key and convert the amount to USD.
The source topic of payment-p2 is clean-log1. This topic has been partitioned based on the record key by the sink processor of the previous pipeline. So in this pipeline, we can perform “dedup by key” with the the correct result.
After dedup by key, the pipeline calls two lookups
- Lookup of currency code using account_id
- Lookup of currency conversion rate using currency code
The pipeline can convert the amount into USD using the currency conversion rate,
This tutorial track also demonstrates how to use Calabash GUI to design lookups.