Find jobs
Pricing
Free Resume Checker
Blog
Sign in
Sign up
FIND JOBSPRICINGFREE RESUME CHECKERBLOGSIGN INSIGN UP
Jobs
/Data Engineer jobs
ST
StateStreet

Lead Data Engineer - Assistant Vice President

LocationBangalore, India
Work modehybrid
Typefull-time
SeniorityLead
Experience10+ yrs
DepartmentSSIM Business Architecture
Company size10,000+ people
First seenOct 8, 2026 · 3d ago
Verified live1d ago
At a glanceSummarised by Seekless from the posting.
Must have18
10+ years of overall experience in software engineering, data engineering, or related technology roles
8+ years of hands-on data engineering & DevOps experience
Proven experience designing, developing, and supporting enterprise-scale production data pipelines and platforms
Demonstrated ability to operate as a hands-on technical SME in complex enterprise environments
Strong hands-on experience in Data Engineering
Strong hands-on experience with Databricks
Advanced programming skills in Python and PySpark
Strong experience with AWS cloud-based data engineering
Strong proficiency in SQL
Experience designing and supporting enterprise ETL/ELT and data pipelines
Strong understanding of Apache Spark and distributed data processing
Experience with data lake and lakehouse architecture
Strong understanding of data modeling, data integration, and data quality principles
Experience with CI/CD and modern engineering practices
Experience supporting business-critical production data platforms
Strong troubleshooting, debugging, and root cause analysis skills
Strong communication and stakeholder-management capabilities
Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related technical discipline
Nice to have10
7+ years of relevant experience across Databricks, PySpark/Spark, and cloud-based data engineering preferred
Experience with Snowflake data engineering and integration
Knowledge of Snowflake databases, schemas, warehouses, security, and performance optimization
Experience integrating Databricks/AWS data pipelines with Snowflake
Experience with GoldenGate, AWS DMS, or similar data replication technologies
Knowledge of data governance, lineage, metadata management, and auditing
Experience with data quality and reconciliation frameworks
Exposure to enterprise monitoring and observability solutions
Experience working in financial services or other regulated environments
Master’s degree in a relevant discipline is desirable
Skills
Databricks
Python
PySpark
AWS
SQL
Apache Spark
ETL/ELT
Snowflake
GoldenGate
AWS DMS
Data Governance
Data Lineage
Data Quality
Benefits
Paid volunteer days
Lead Data Engineer – Databricks, Python, PySpark & AWS
Job Summary
We are seeking a Senior Data Engineer / SME to join the SSIM Business Architecture vertical in a hands-on Individual Contributor (IC) role.
The role requires strong expertise in Databricks, Python, PySpark, AWS, and SQL to design, build, and support scalable, production-grade data pipelines and cloud data solutions. Snowflake and enterprise data integration experience are desired.
The successful candidate will demonstrate strong technical ownership, problem-solving skills, and engineering best practices across the data ecosystem.
Role location : Bangalore
•
Business Architecture: The role sits within the SSIM Business Architecture vertical and requires close collaboration with Architecture, Security, engineering, platform, and business technology stakeholders.
•
Hybrid working: The role requires 4 days per week working from the office, in line with the applicable workplace expectations.
•
Working hours: The primary working window will be 12:00 PM to 9:00 PM India time, providing alignment with US stakeholders and teams.
•
Flexibility: Given the enterprise and production nature of the role, the individual must be flexible to work outside standard hours and, where required, over weekends to support critical deliveries, production issues, releases,DR or other business needs.
Key Responsibilities
•
Design, develop, and maintain scalable ETL/ELT, data ingestion, and transformation pipelines.
•
Build and optimize data processing solutions using Python and PySpark.
•
Develop and support production-grade workloads and pipelines on Databricks.
•
Design and implement cloud-native data engineering solutions on AWS.
•
Work with large-scale structured and unstructured datasets.
•
Optimize Spark and Databricks workloads for performance, scalability, reliability, and cost efficiency.
•
Develop reusable data engineering components, frameworks, and engineering patterns.
•
Implement data quality, validation, reconciliation, and monitoring controls.
•
Troubleshoot complex production issues, perform root cause analysis, and implement sustainable fixes.
•
Support CI/CD, testing, deployment, monitoring, and operational reliability.
•
Act as a Data Engineering SME, providing technical guidance, design reviews, and code reviews.
•
Collaborate with architecture, application, cloud, platform, and business teams to deliver enterprise data solutions.
•
Drive automation, standardization, and continuous improvement across the data engineering landscape.
Required Skills
•
Strong hands-on experience in Data Engineering.
•
Strong hands-on experience with Databricks.
•
Advanced programming skills in Python and PySpark.
•
Strong experience with AWS cloud-based data engineering.
•
Strong proficiency in SQL.
•
Experience designing and supporting enterprise ETL/ELT and data pipelines.
•
Strong understanding of Apache Spark and distributed data processing.
•
Experience with data lake and lakehouse architecture.
•
Strong understanding of data modeling, data integration, and data quality principles.
•
Experience with CI/CD and modern engineering practices.
•
Experience supporting business-critical production data platforms.
•
Strong troubleshooting, debugging, and root cause analysis skills.
•
Strong communication and stakeholder-management capabilities.
Desired Skills
•
Experience with Snowflake data engineering and integration.
•
Knowledge of Snowflake databases, schemas, warehouses, security, and performance optimization.
•
Experience integrating Databricks/AWS data pipelines with Snowflake.
•
Experience with GoldenGate, AWS DMS, or similar data replication technologies.
•
Knowledge of data governance, lineage, metadata management, and auditing.
•
Experience with data quality and reconciliation frameworks.
•
Exposure to enterprise monitoring and observability solutions.
•
Experience working in financial services or other regulated environments.
Experience Requirements
•
10+ years of overall experience in software engineering, data engineering, or related technology roles.
•
8+ years of hands-on data engineering & Devops experience.
•
7+ years of relevant experience across Databricks, PySpark/Spark, and cloud-based data engineering preferred.
•
Proven experience designing, developing, and supporting enterprise-scale production data pipelines and platforms.
•
Demonstrated ability to operate as a hands-on technical SME in complex enterprise environments.
Education Requirements
•
Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related technical discipline.
•
Master’s degree in a relevant discipline is desirable.
Technology Stack
Core / Mandatory:Databricks | Python | PySpark | AWS | SQL | Apache Spark | ETL/ELT | Data Pipelines | Data Lake/Lakehouse
Desired:Snowflake | GoldenGate | AWS DMS | Data Governance | Data Lineage | Data Quality | Observability
About State Street
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
Legal
As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at StateStreet.com/careers
Read our CEO Statement
More roles at StateStreet
Application, Infrastructure & Service Management, VPApplication Support Engineer – SWIFT & Mainframe, Assistant Vice PresidentAlternatives - Financial Reporting, OfficerAI Platform and Ops Lead, Assistant Vice PresidentArtificial Intelligence & Machine Learning, AVP
Seekless
Seek less: one search across companies' own career pages, instead of a dozen job boards.
Product
Find jobsCompaniesPricingFree Resume Checker
Company
AboutBlog
Legal
PrivacyTermsCookies
© 2026 SEEKLESS. ALL RIGHTS RESERVED.BUILT WITH CARE