The Big Data Engineer will support existing applications and work on new design and implementation requirements, utilizing big data technologies and tools.
This is a remote position.
Role: Big Data Engineer/Developer
Experience: 3-6 Years in Big Data
Immediate Joiners: Preferred
Location: Remote( for now)
Job Description:
- Data Engineer required with experience working in Hadoop in technologies including Hive, Hdfs, Sqoop etc.
- Must have - Python, Pyspark, Spark, AWS/Azure, SQL.
- Candidate will perform the role of senior developer where he needs to support existing applications as well as work on new requirements from a design and implementation perspectives.
- GitLab Hadoop Hive Jenkins MAVEN Nexus
- Scala Shell Scripting YARN Oracle Scrum/Agile Spring.
- Sound communication skills - both written and verbal
- Good to have - Knowledge of Teradata, Airflow, GCP
Similar Jobs
Blockchain • Fintech • Software • Cryptocurrency • Metaverse
Support and optimize large-scale Spark/YARN jobs and storage (S3/EMR). Build job-profiling, cost-analysis, AI-assisted automation, monitoring/alerting (Prometheus, Flink/Spark), and internal ops tooling to improve stability and reduce costs.
Top Skills:
ChatgptClaudeCopilotCursorLinuxPython
Blockchain • Fintech • Software • Cryptocurrency • Metaverse
Design, develop, and maintain high-performance, highly available backend services and APIs for Big Data products using Java/Python. Manage full service lifecycle, capacity planning, profiling/benchmarking, troubleshooting, security, and system architecture. Contribute to open-source big data projects and build scalable tools for global operations.
Top Skills:
HadoopHbaseHiveJavaKafkaLinuxMicroservicesNoSQLPrestoPythonRabbitMQRestful ApisSparkSpring BootSQLYarnZookeeper
Blockchain • Fintech • Software • Cryptocurrency • Metaverse
Lead design and implementation of scalable, high-performance backend services for traditional and AI-powered search. Own search architecture, optimize indexing/retrieval/ranking, build reusable frameworks, collaborate with data scientists on LLM-enabled search and agents, and deliver robust, low-latency solutions.
Top Skills:
Cloud InfrastructureDifyElasticsearchFlinkHybrid RetrievalJavaLangchainLlmMastraOpenai Agents SdkPythonRagSparkVector Search
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
