3Pillar Global
Senior Data Engineer with Exp in Snowflake & Amazon QuickSight(5+ Years of Exp)
Be an Early Applicant
The Senior Data Engineer will design and optimize ETL/ELT pipelines, manage data integration, perform data validation, and support reporting solutions using various technologies.
At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective Industries. if your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🔮🌐
Key Responsibilities
- Design, develop, and optimize scalable ETL/ELT pipelines for enterprise data platforms
- Build and maintain robust data solutions using Snowflake, Python, and AWS services
- Develop advanced SQL queries using CTEs, window functions, query tuning, and performance optimization techniques
- Work with Snowflake warehouses, tasks, streams, and data pipelines for efficient data processing
- Create and maintain data transformation workflows using dbt (data build tool)
- Develop reporting datasets and support dashboarding solutions using Amazon QuickSight
- Perform data validation, data integrity checks, and root cause analysis to ensure data accuracy and reliability
- Integrate and manage data across platforms including DynamoDB, S3, AWS Glue, Lambda, and Rockset
- Collaborate with cross-functional teams including analytics, product, and clinical stakeholders to support reporting requirements
- Monitor pipeline performance and troubleshoot production data issues
Required Skills
- Strong experience in SQL including:
- CTEs
- Window Functions
- Query Optimization
- Performance Tuning
- Hands-on experience with Snowflake:
- Warehouses
- Streams
- Tasks
- Data Loading and Optimization
- Experience in Python for data processing and pipeline development
- Experience with AWS services:
- AWS Glue
- Lambda
- S3
- Good knowledge of dbt (Data Build Tool)
- Experience in creating dashboards and reports using Amazon QuickSight
- Knowledge of Rockset analytical engine
- Experience with DynamoDB and NoSQL databases
- Basic to intermediate knowledge of JavaScript
Regards
Rajan Paul(Linkedin Profile)
3Pillar Global
Similar Jobs
AdTech
As a Data Engineer, you will design, develop, and maintain data integration solutions, optimize ETL/ELT pipelines, and support data workflows for analytics and reporting.
Top Skills:
Azure Data FactoryAzure DatabricksMicrosoft FabricPysparkPythonSpark SqlSQLT-Sql
Retail • Software
The Senior Data Engineer - II will design data pipelines, optimize ETL workflows, manage databases, and support Power BI reporting for business decisions.
Top Skills:
AWSBigQueryGCPMySQLPostgresPower BIPythonSnowflakeSQL
Software
As a Data Engineer, you will build scalable ETL/ELT pipelines, optimize data structures, and develop impactful Power BI solutions for stakeholders.
Top Skills:
DatabricksDaxLinuxPandasPower BIPower Query (M)PysparkPythonSparkSQL
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
