As a Lead Software Engineer, you will design and optimize ETL processes using Python and AWS, collaborate with teams to define data requirements, ensure data quality, and mentor junior engineers while contributing to the development of secure and scalable technology products.
Job Description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
As a Lead Software Engineer at JPMorgan Chase within the AI/ML & Data Platform team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.
Job responsibilities
- Design, develop, and maintain ETL processes (using Python, AWS) to support data integration and data warehousing solutions.
- Collaborate with data architects, data analysts, and business stakeholders to understand data requirements and translate them into technical specifications.
- Optimize and tune ETL processes (using Python, AWS) for performance and scalability.
- Ensure data quality and integrity through rigorous testing and validation procedures.
- Monitor and troubleshoot ETL processes to resolve issues and ensure timely data availability.
- Develop and maintain documentation for ETL processes, data flows, and data models.
- Mentor and provide guidance to junior ETL engineers and data team members..
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 5+ years applied experience
- Practical experience in ETL development using Python and AWS, with a focus on data engineering.
- Proficient in debugging, optimization, and understanding various data formats (CSV, Parquet, ORC) and sources (HDFS, S3, SFTP, Apache Iceberg).
- Expertise in the Software Development Life Cycle and advanced knowledge of agile methodologies, including CI/CD, application resiliency, and security.
- Familiarity with programming languages such as Java or Scala.
- Experience with cloud platforms like AWS, Azure, or GCP and their data services
Preferred qualifications, capabilities, and skills
- Familiar with big data technologies (e.g., Hadoop).
- Preferred experience with Apache Spark and strong SQL skills for relational databases like Oracle, SQL Server, and MySQL.
- Data governance and data security best practices.
- Familiar with real-time data processing and streaming technologies (e.g., Kafka, Flink).
Top Skills
Java
Python
Scala
Similar Jobs at JPMorganChase
Financial Services
The Lead Software Engineer will innovate technology operations at JPMorgan Chase, focusing on design, delivery, and maintenance of secure, scalable software solutions for the Commercial & Investment Bank. Responsibilities include producing production code, analyzing large data sets, optimizing application performance, and contributing to team culture and practices.
Top Skills:
Python
Financial Services
As a Lead Software Engineer, you will design and implement automation testing frameworks using Python and Java, leading automation processes to enhance efficiency, and collaborating with cross-functional teams to ensure effective testing solutions are delivered timely. You will drive your own workload and work in a high-pressure environment dealing with trading applications.
Top Skills:
JavaPython
19 Hours Ago
Financial Services
The role involves supporting the development and implementation of AI and data science strategies to enhance research methodologies and outputs at J.P. Morgan's Global Research Center. Responsibilities include automating workflows, collaborating with analysts, ensuring data integrity, and evaluating new AI technologies.
Top Skills:
AIData Science
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
