ESSENTIAL DUTIES & RESPONSIBILITIES
· Analyze existing SAS-based systems and re-implement logic in Python, ensuring functional parity while improving maintainability, scalability, and performance.
· Design and develop end-to-end data pipelines to ingest, clean, validate, and transform diverse data formats—including SAS datasets, Parquet, JSON, and SQL—using larger-than-memory processing techniques.
· Profile, optimize, and refactor code to eliminate bottlenecks and improve performance. Implement parallel computing strategies using libraries such as Dask and multiprocessing to efficiently process production-scale workloads.
· Develop Python solutions that interface with PostgreSQL for high-volume data storage, retrieval, and processing.
· Implement automated testing, data validation, and quality assurance processes to ensure the integrity, accuracy, and reliability of critical data assets throughout the data lifecycle.
· Maintain high standards for code quality by producing well-documented, readable, maintainable, and extensible code. Participate in peer reviews and knowledge sharing to promote engineering best practices.
· Collaborate with DSD IT Specialists and other stakeholders to implement efficient, scalable Python solutions that meet functional and technical requirements.
· Partner with DSD stakeholders to validate business and technical requirements, troubleshoot implementation issues, and support the successful modernization of legacy systems.
· Attend branch meetings and communicate technical concepts, project updates, and recommendations clearly and effectively.
· Maintain regular communication with the team as required.
· Maintain regular and punctual attendance.
· Perform other duties as assigned.
SUPERVISORY RESPONSIBILITIES