Data Engineer II - Big Data

Description and Requirements
Role Value Proposition:
MetLife is the leading provider of Group Benefits. The Group Disability technology organization is a diverse team of technologists, all working towards the common goal of ensuring the customer is at the center of everything we do. As a Lead data engineer you are responsible for the design, development, implementation and maintenance of solutions supporting Disability & Absence products at MetLife - products that provide income protection and job protection to millions of employees across the United States. You will collaborate closely with the Scrum Lead, Product Owner and ART Leadership. You will have an opportunity to impact every part of the system and iterate over solutions to be the very best you can be to deliver for our customers. You will b e responsible for thought leadership, creative problem solving, and applying your e xpertise in a complex environment. Your responsibilities include writing code, design and development of customer facing solutions using Big Data technologies . Bring in your expertise with deve loping strategic data supply chain for superior customer experience.
Key Responsibilities:

• Hands on development with Spark, Hive, NoSQL, SOLR, & In-memory data processing.

• Develop data architecture and solution designs for classic batch, speed and serving layer.

• Improve / reengineer existing solutions with data speed/latency, quality and ability to derive analytics insight.

• Serve as an escalation point for deployments, and change oversight, enabling highly visible business priorities.

Experience and Education:
Required:

• Advanced knowledge of the principles of computer application including software engineering, system analysis and design, design and analysis of algorithms, digital systems, computer system architecture, data structures, computer networks, database management system, and problem solving and computer programming, among others.

• Core hands on development skills in Bigdata ecosystem i.e. Spark Scala, SOLR, Pig, Hive, Kafka and HBase.

• Experience with real-time data delivery, Kafka, NiFi , and Change-data-capture

• Optimize and tune queries, job flows on Hadoop environments to meet performance requirements.

• Good understanding of release management, CI/CD

• Work with Bigdata developers designing scalable supportable Application development.

• Programming using Shell script/Python to create automation scripts.

• Operate in various development environments (Agile, Waterfall, etc.) while collaborating with key stakeholders.

• Responsible for developing and maintaining the operating runbooks.

• Minimum bachelor's degree in computer science is required, master's degree preferred.

• 7 + years of software design and development experience.

Preferred:

• 2 + years of experience in deploying Hadoop components Hive, Spark, HBase, and SOLR.

• Strong communication skills to lead interactions with business and technology leaders across the global lines of businesses.

• 2 to 4 years of functional experience in Insurance industry

• Cloud experience is plus with Azure, and Google

• Experience working in cross-functional, multi-location teams.

• Excellent analytical and problem-solving skills.

Experience and Education: 7 + years, BS/MS in Comp Science/IS.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid