We are looking for a Data Engineer with skills in Python, SQL, and Azure technologies to develop Big Data applications. Responsibilities include working with Spark and Docker to handle large scale data processing and analytics.
This is a remote position.
- Must have - Python, SQL, Spark, Databricks, Azure Data Factory, Azure Synapse, Docker
- Good to have - Knowledge of Teradata, Airflow, AWS, GC
- experience in developing Big Data applications
- Experience in large-scale Big Data & Analytics applications
- Hands on experience in using technologies like Spark, Scala,
- Experience in Azure & Docker are added advantage.
- Strong problem-solving skills, data structures and algorithms
- Experience with distributed systems handling large amounts of data.
Requirements
- Immediate Joiner
- Remote location
- Data Engineer with 2 to 6 Yrs of experience
Similar Jobs
Information Technology • Database • Consulting
Design, build, and maintain scalable cloud-based ETL/ELT data pipelines (Python, PySpark, SQL, Snowflake) supporting P&C insurance pricing, rating, underwriting, and actuarial analytics. Collaborate with actuaries, data scientists, analysts, and cloud engineers to deliver reusable data frameworks, batch/incremental ingestion, data quality, and transformations for GLM and predictive models.
Top Skills:
AWSDatabricksEltETLPysparkPythonSnowflakeSQL
Information Technology • Database • Consulting
Lead and deliver end-to-end AWS data engineering solutions: design, build, and optimize data pipelines, lakes, and warehouses; implement serverless and streaming architectures; mentor engineers; ensure quality, scalability, cost-efficiency, and CI/CD for enterprise data platforms.
Top Skills:
Api GatewayAthenaAuroraAws CloudformationDynamoDBEmrGlueIamKafkaKinesisKmsLambdaPythonRdsRedshiftS3Secrets ManagerShell ScriptingSparkSQLSqsStep Functions
Artificial Intelligence • eCommerce • Software
Design, build, and maintain scalable batch and streaming ETL/ELT pipelines, production data services (REST/gRPC), and cloud-based data infrastructure. Implement CDC and time-travel data architectures, ensure data quality with tests and CI/CD, optimize data models for OLTP/OLAP, and collaborate cross-functionally to deliver reliable production data systems.
Top Skills:
Apache AirflowApache ArrowApache IcebergAWSAws CodepipelineAzureCdcCi/CdDatabricksDbtDelta LakeEtl/EltGCPGitGithub ActionsGrpcKafkaPandasPolarsPythonRest
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
