· Build, monitor, and maintain data ingestion processes and systems that move, store, and transform data across platforms, administering Databricks and our Data Marketplace and Ad Platform.
· Develop, maintain, and optimize complex scripts using Python, PowerShell, or similar languages to automate data collection and monitoring.
· Own the operational state of a defined set of data pipelines — monitoring, incident response, maintenance procedures, and escalation for systems in your scope.
· Own SQL database maintenance (Forecast, current, historical, locations) for data loading and deployment.
· Develop and maintain unit test coverage for Data Ops code bases, ensuring scripts and pipelines behave as expected before deployment.
· Administer GoAnywhere and other managed file transfer platforms.
· Build and manage end-to-end monitoring systems and automated alert mechanisms to optimize the health and performance of data pipelines, ensuring alerts are appropriately calibrated to trigger the right notifications.
· Own incident diagnosis and resolution within established parameters — investigating alerts, identifying root causes, implementing fixes, validating recovery, and documenting resolutions.
· Build and maintain CI/CD pipelines (GitHub Actions, Azure DevOps) to support reliable, repeatable deployments
· Own proactive operational maintenance — executing scheduled maintenance, applying patches and updates, and performing checks that prevent incidents before they occur.
· Create and maintain comprehensive documentation of scripts, automation and monitoring workflows, data pipelines, and deployment procedures.
· Contribute to and improve runbooks based on incidents you’ve worked through that weren’t adequately covered before.
· Collaborate closely with cross-functional teams, providing support for scripting needs and contributing to automation strategy.
· Independently plan and prioritize work to meet deadlines.
· Begin sharing knowledge with peers; engage in informal coaching moments.
· Performs other duties as assigned.