Lead Software Engineer - Python Pyspark (Databricks)

Job Description
Join our dynamic team as a software developer, where you will have the opportunity to solve complex problems and contribute to our innovative projects. With us, you can enhance your skills in Python, PySpark, and cloud architecture, while working in an inclusive and respectful team environment. This role offers immense growth potential and a chance to work with cutting-edge technologies.
As a Lead Software Engineer - Python / Spark Big Data at JPMorgan Chase within the Capital Reporting product, you will be executing software solutions, designing, developing, and troubleshooting technical issues. We value diversity, equity, inclusion, and respect in our team culture. This role provides an opportunity to contribute to software engineering communities of practice and events that explore new and emerging technologies. You will have the chance to proactively identify hidden problems and patterns in data and use these insights to promote improvements to coding hygiene and system architecture.
Job responsibilities:

• Participate in all aspects of the software development process including, requirements, designing, coding, unit testing, quality assurance, and deployment.
• Use the right mix of open-source technologies and home-grown distributed commuting frameworks to build software that meets the requirements.
• Contributes to team drive for continual improvement of development process and innovative solutions to meet business needs.
• Ensure adherence to architecture standards, application robustness and security policies.
• Gathers, analyzes, and draws conclusions from large, diverse data sets to identify problems and contribute to decision-making in service of secure, stable application development.
• Use the agile software development methodologies such as SCRUM, for quick turnaround time
• Manage team of software engineers and build high performing/winning team.
• Adds to team culture of diversity, equity, inclusion, and respect.

Required qualifications, capabilities, and skills:

• Formal training or certification on software engineering concepts and 5+ years applied experience
• Hands on development experience in Python or PySpark, cloud or microservices architecture concepts
• Demonstrated knowledge of software applications and technical processes within a cloud or microservices architecture.
• Hands-on practical experience in system design, application development, testing, and operational stability
• Helping to identify opportunities for improvement within the existing applications to increase stability and simplify the platform
• Working with a team of engineers and developers to ensure that the Capital Risk platform is engineered to be standardized, optimized, available, reliable, consistent, accessible and secure to support business and technology needs
• Providing operational excellence through root cause analysis and continuous improvement
• Staying current and informed on emerging technologies and new techniques to refine and improve overall delivery
• Interacting with partners across feature teams to collaborate on reusable services to meet solution requirements

Preferred qualifications, capabilities, and skills:

• Exposure to cloud technologies (Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka)
• Experience with Big Data solutions (e.g. Databricks) or Relational DB.
• Experience in Financial Service Industry is nice to have.