DepartmentTechnology, Information and Media, Technology, Information and Media
Company size51+ people
First seen2d ago
Last seen2d ago
This role is for one of our clients
About the role
Industry: IT Services and IT Consulting
Seniority level: Mid-Senior level
Requirements
Min Experience: 5+ years
Location: Pune, Bengaluru
JobType: full-time
\n\n
Benefits
₹9,00,000 - ₹18,00,000 a year
We are seeking an experienced Lead Data Engineer to take end-to-end ownership of Enterprise Data Warehouse (EDW) solutions. This role will be responsible for designing, architecting, and optimizing scalable, secure, and high-performance data pipelines using SAP BODS, IBM DataStage, Redwood, SQL, Oracle, and modern data platforms.
The ideal candidate will combine strong hands-on technical expertise with leadership capabilities to drive data engineering best practices and deliver enterprise-grade data solutions aligned with business objectives.
Requirements
Key Responsibilities
1. EDW Architecture & Data Engineering
•
Design and implement scalable data integration and transformation frameworks for the Enterprise Data Warehouse.
•
Architect and optimize ETL/ELT pipelines using SAP BODS and IBM DataStage.
•
Develop and maintain robust data models (Star/Snowflake schemas, SCD implementation).
•
Ensure high availability, reliability, and performance of data pipelines.
•
Implement data governance, security, and compliance standards.
2. ETL Development & Optimization
•
Develop complex data workflows and transformations.
•
Perform performance tuning of ETL jobs and SQL queries.
•
Optimize batch processing and scheduling using Redwood.
•
Implement error handling, logging, and monitoring mechanisms.
•
Manage incremental loads and data reconciliation processes.
3. Database & SQL Development
•
Write and optimize complex SQL queries, stored procedures, and functions.
•
Work extensively with Oracle databases and related technologies.
•
Design and manage indexing strategies and query optimization.
•
Support database performance analysis and tuning.
4. Leadership & Team Management
•
Lead and mentor a team of data engineers.
•
Conduct code reviews and enforce development standards.
•
Drive technical best practices and architecture governance.
•
Collaborate with cross-functional teams including BI, Analytics, and Application teams.
•
Participate in sprint planning, estimation, and technical roadmap discussions.
5. Stakeholder Collaboration
•
Work closely with business stakeholders to gather and translate requirements into technical solutions.
•
Provide technical guidance and solution recommendations.
•
Ensure alignment between enterprise data strategy and business goals.
•
Support production issue resolution and root cause analysis.
Required Skills
Technical Expertise
•
Strong experience with SAP BODS
•
Hands-on experience with IBM DataStage
•
Experience with Redwood scheduling
•
Advanced SQL development
•
Strong expertise in Oracle database
•
Deep understanding of Enterprise Data Warehouse architecture
Data Engineering Concepts
•
Data modeling (Star/Snowflake schema, SCD Types)
•
ETL/ELT best practices
•
Data quality frameworks
•
Performance tuning and optimization
•
Data security and governance standards
Preferred / Good to Have
•
Experience with modern cloud data platforms (Azure, AWS, GCP)
•
Knowledge of Snowflake, Databricks, or Synapse
•
CI/CD implementation for data pipelines
•
Exposure to data cataloging and metadata management tools
•
Experience in Agile/Scrum methodologies
Qualifications
•
Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
•
8+ years of experience in Data Engineering.
•
2+ years of experience in leading technical teams.
Key Competencies
•
Strong architectural and analytical skills
•
Leadership and mentoring capability
•
Excellent communication and stakeholder management
•
Problem-solving mindset
•
Ability to drive enterprise-scale data initiatives