• Engineering Leadership: Lead engineering delivery across the entire data platform
— NRT-ODS streaming platform, Analytical Warehouse (Microsoft Fabric), AI/ML
layer, and platform security. Drive execution, remove blockers, and ensure
engineering quality across all pillars of the platform roadmap.
• ODS Engineering Delivery: Own the engineering delivery of the streaming-first,
event-driven platform comprising 179 Kafka Streams topologies, Debezium CDC
pipelines, 200+ Avro schemas (Apicurio Registry), OAuth 2.0 security (KeyCloak),
and Kubernetes-based deployment. Drive performance tuning, reliability
improvements, and feature delivery.
• Analytical Warehouse Delivery: Lead the engineering build-out of the Analytical
Warehouse on Microsoft Fabric, including Kafka-to-Fabric Direct Sink,
Delta/Parquet storage on OneLake, semantic layer, and future Apache Iceberg
adoption for time-travel queries and multi-engine access.
• AI & Intelligence Delivery: Drive the engineering delivery of AI capabilities including
Feature Store (Hopsworks/Feast), RAG over ODS documentation and schemas,
NL2SQL for Gold data, and domain-specific ML models. Ensure Flink-powered
feature computation pipelines are delivered to production.
• Platform Security Delivery: Lead engineering efforts for platform security spanning
OAuth 2.0, Conduktor Gateway, TLS, Kafka ACLs, multi-tenant isolation,
confidential compute (Azure Confidential Clean Rooms / Opaque Systems), and
differential privacy (SmartNoise/OpenDP) for cross-client analytics.
• Data Trust & Governance: Drive delivery of data contracts on Gold schemas,
pipeline validation (Great Expectations/Soda), end-to-end data lineage, automated
anomaly detection, and regulatory automation (PII classification, DORA, BCBS 239,
• Client Delivery Engineering: Lead engineering for multiple delivery patterns —
streaming SDK (Vanguard), batch extract (BMO), MirrorMaker 2, WebSocket/SSE
gateway, self-service client portal, and the Wealth-as-a-Service API (REST +
• Cross-Client Analytics: Drive engineering delivery of the three-layer privacy stack
— federated processing (data never leaves client boundary), confidential compute
(hardware-attested enclaves), and differential privacy on all outputs. Lead federated
learning implementation using federated learning frameworks.
• Stream Processing Engineering: Lead the dual-engine strategy — Kafka Streams
for CDC processing and enrichment, Apache Flink for analytical stream processing
(windowed aggregations, complex event patterns, streaming SQL). Drive
performance optimization and operational stability.
• Technology Evaluation & Selection: Lead build-vs-buy decisions across the
platform — data lineage (Atlan vs. Purview vs. custom), observability (Monte Carlo
vs. custom), confidential compute (Opaque Systems vs. Azure Clean Rooms),
developer portal (Backstage vs. custom). Own proof-of-concept delivery and vendor
• Team Leadership: Lead and mentor data engineers, platform engineers, and
specialists across the data platform. Set engineering standards, conduct code and
design reviews, and foster a high-performance engineering culture.
• Stakeholder Management: Work with product owners and executive stakeholders
to translate roadmap priorities into engineering plans, align delivery timelines with
client commitments (Vanguard, BMO, RJ), and communicate progress and risks.
• Engineering Excellence: Establish and enforce engineering standards — CI/CD
practices (GitHub Actions, ArgoCD), testing strategies, observability
(Grafana/Prometheus), incident response, and operational runbooks across all