Key Responsibilities & Accountabilities
Pipeline Monitoring, Observability, and Incident Management
Monitor data integration pipeline health, data freshness, volume trends, and job completion status using observability tools and dashboards. Proactively detect anomalies — such as late-arriving data, row count deviations, schema changes, or silent failures — before they cause downstream impact to the lakehouse or operational applications. Detect, triage, and resolve incidents in a timely manner, coordinating with source system owners and technical teams as needed.
Operational Support and Maintenance
Administer and maintain data integration platform environments (Informatica and related tools), including job scheduling, connector configuration, data refreshes, and platform patching. Manage integration jobs that feed both the data lakehouse and downstream point solutions used across the university. Implement scheduled maintenance activities with minimal disruption to dependent systems, and manage user access and permissions according to security policies.
Performance Analysis and Optimization
Analyze integration pipeline performance metrics, identify bottlenecks, long-running jobs, and resource contention, and implement tuning and optimization measures. Contribute to the evaluation and implementation of the university’s data observability platform, helping define the monitoring strategy, key metrics, SLA thresholds, and alerting rules that will govern pipeline health across the integration landscape.
Documentation and Knowledge Management
Create and maintain comprehensive operational documentation, including runbooks, standard operating procedures, and knowledge base articles. Document system configurations, data pipeline dependencies, and recovery procedures to ensure operational continuity.
Continuous Improvement and Automation
Identify opportunities to automate repetitive operational tasks, improve pipeline reliability, and reduce manual intervention. Develop and implement scripts and workflows to streamline routine integration operations. Contribute to the ongoing evaluation of integration tools (including Fivetran) and the evolution of the university’s data integration practices based on operational experience and emerging best practices.