KRA 1 Data Pipeline Development
• Design, build, test, and maintain data pipelines (ELT) using Databricks, Delta Live Tables, and Databricks Asset Bundles, according to business and technical requirements.
• Manage data workflows and orchestration; ensure accuracy and availability of all ELT processes.
• Design and deliver silver/gold layer data models within the medallion architecture to support downstream reporting.
KRA 2 Platform & Governance
• Implement secure platforms with Unity Catalog - access controls, data lineage, and discovery.
• Apply CI/CD and DevOps practices (GitHub Actions) for deployment, testing, and release management.
• Play a key role in automation, building solutions against architectural best practice.
KRA 3 Solution Delivery & Documentation
• Propose technical designs and develop integrations, including application data connections via APIs.
• Execute data migrations as scoped and directed by the Head of Data & Analytics.
• Maintain clear documentation of pipelines, data models, and technical logic within the engineering layer.
• Provide technical input during requirements scoping sessions with the Head of Data & Analytics.