As a Senior Data Engineer, you'll analyze data integrity, create scalable solutions, mentor peers, and engage in agile development, focusing on backend services using Python and Snowflake.
🌟 Accomplished Tech Visionary:
Elevate your expertise to new heights at 3Pillar, the premier destination for trailblazing senior software engineers like yourself. Picture collaborating with industry leaders, spearheading transformative projects that redefine urban living, establishing new media channels for enterprise companies, or driving innovation in healthcare. Our mission is to revolutionize the tech landscape, and your skills are integral to achieving this ambitious goal.
Your role extends beyond the realm of code composition; you will architect transformative solutions that reshape entire industries. Join us and spearhead the charge toward a tech future that transcends the ordinary. 🔮🌐
Key Responsibilities:
- Primarily responsible for analyzing data integrity challenges including investigating, correcting, and monitoring data to help identify and address key data issues. Must be comfortable remedying data integrity issues and identifying root cause analysis by going through the code.
- Facilitate effective communication with client project stakeholders regarding project status and recommendations.
- Craft client code that is not just efficient, but also performant, testable, scalable, secure, and of the highest quality.
- Actively participate in accurate planning and estimation efforts, utilizing project methods and tools.
- Proficiently gather requirements and organize/present developed features for clients.
- Execute complex activities within the current methodology and quality standards, showcasing success across diverse engagements.
- Promote client success across the team by collaborating with engineers, designers, and managers to understand user pain points, anticipate potential problems, and iterate on solutions that drive client success.
- Engage in agile software development, including daily stand-ups, sprint planning, team retrospectives, and other governance activities.
- Actively participate in the Engineering Practice community, mentoring others through Communities of Practice (CoPs) or on project teams, and supporting the growth of technical capabilities.
- Independently drive project delivery within defined architecture, demonstrating autonomy and accountability in all stages from conceptualization to deployment.
Minimum Qualifications:
- Should have worked as Data Engineer for atleast 5 years
- Must have atleast 3 years of experience in Snowflake Datawarehouse, SnowPipe, Snowpark and related services
- Experience/expertise in the following areas specified below:
- Design and implement scalable backend services and APIs using Python
- Collaborate with cross-functional teams to define and execute on technical requirements
- Optimize system performance and troubleshoot issues
- Stay updated with the latest Python and SQL to drive continuous improvement Must-Have Skills & Tools:
- Languages: SQL, Python
- Skills/Responsibilities: MS SQL Server, Snowflake (data warehouse), Hevo / dbt
- Tools: Jira, Bitbucket, Slack/Teams Good to Have Skills:
- Languages: Javascript
- Skills/Responsibilities: Dynamo DB, AWS Services, Rockset (analytical engine)
- Experience in Agile software development methodologies.
- Expertise in working with SQL and SQL MS Server
- Experience in creating and implementing well-tested, scalable, and performant enterprise-level systems.
- Practice and initiative mentoring other engineers and decision-makers throughout the organization.
- Proficiency in the English language.
Additional Experience Desired:
- Ability to optimize backend performance and troubleshoot issues.
- Familiarity with modern frontend build tools and CI/CD pipelines.
- Excellent problem-solving skills and a proactive attitude towards challenges.
- Strong verbal and written communication skills.
- Professional software engineering experience, working on multi-discipline teams
- Experience in backend development with expertise in node.js
- Proficiency in designing and implementing RESTful APIs and microservices architecture.
- Good knowledge of AWS services like Lambda, API Gateway, DynamoDB/RDS, and S3.
- Experience with containerization using Docker and orchestration with Kubernetes (optional).
- Excellent problem-solving skills and a proactive attitude towards challenges.
- Object-Relational Mappers (ORMs)
- Architectural (Microservices, Serverless etc) and Design (Factory, Singleton, Observer etc) Patterns
- Unit Testing
Top Skills
Bitbucket
Dbt
Hevo
JIRA
Ms Sql Server
Python
Slack
Snowflake
SQL
Teams
Similar Jobs
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The Program Manager will oversee end-to-end program delivery in a hybrid role, managing projects and facilitating Agile ceremonies across teams. They will communicate with stakeholders and ensure adherence to governance processes.
Top Skills:
AsanaJIRAO9SAP
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Responsible for the implementation, support, and optimization of Active Directory and Microsoft Entra ID platforms. Leads incident management and drives automation and Zero Trust principles for enterprise IAM capabilities.
Top Skills:
Active DirectoryCyberarkMicrosoft Entra IdMicrosoft Graph ApiPingPowershellVenafi
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Manage implementation and support of Ping Identity services including PingFederate and PingID MFA, ensuring reliability and security of authentication systems. Oversee project management and deliver operational efficiency through troubleshooting and service improvement.
Top Skills:
C#JavaOauth 2.0Openid ConnectPing DirectoryPingfederatePingid MfaPowershellSAML
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
