Build and maintain scalable ETL/ELT pipelines, data ingestion workflows, backend services, APIs, and database systems. Clean, transform, validate, and model structured and unstructured data while implementing quality controls, monitoring, and production reliability. Develop Agentic AI and workflow automation integrations, deploy applications across cloud and on-premises environments, and collaborate with customers and cross-functional teams to deliver AI/ML solutions from proof of concept to production.
SCRY AI is an innovative AI-driven technology company focused on building intelligent, scalable, and high-performance solutions. We work with modern technologies across Software Engineering, AI/ML, and Data to solve real-world business problems and deliver impactful digital products.
Role Overview
We are looking for a skilled Data Engineer with 2-3 years of experience in building scalable data pipelines, backend services, and data processing systems. The ideal candidate should have strong hands-on experience in Python, SQL, ETL/ELT, API development, and database technologies, with exposure to AI/ML applications, Agentic AI, and cloud or on-premises deployments.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for processing structured and unstructured data.
- Build data ingestion and transformation workflows using Python, SQL, and relevant data engineering frameworks.
- Extract, clean, validate, normalize, and transform data from APIs, databases, files, and other sources.
- Design and optimize database schemas, data models, SQL queries, joins, indexes, and aggregations.
- Work with relational databases such as PostgreSQL/MySQL and NoSQL databases where required.
- Develop batch and incremental data processing pipelines with appropriate error handling and recovery mechanisms.
- Implement data quality checks, validation rules, deduplication, and reconciliation to ensure data accuracy and consistency.
- Integrate data pipelines and AI applications with SQL/NoSQL databases, APIs, enterprise systems, and customer-specific data sources.
- Develop Agentic AI and workflow automation solutions using frameworks such as LangChain/LlamaIndex, including tool calling and external system integrations.
- Build and optimize backend services and APIs to support data processing, AI/ML workflows, and enterprise integrations.
- Work directly with customers and stakeholders to understand requirements, troubleshoot issues, demonstrate solutions, and translate business needs into technical implementations.
- Take AI/ML solutions from POC to production, focusing on scalability, reliability, latency, monitoring, and maintainability.
- Deploy and troubleshoot data and AI applications using Docker across cloud, on-premises, and customer environments.
- Implement logging, monitoring, alerting, and performance optimization for data pipelines and production applications.
- Follow engineering best practices using Git, CI/CD, automated testing, and documentation, collaborating with Data Scientists, ML Engineers, Backend Engineers, and business teams.
Key Qualifications
- 2-3 years of experience in Data Engineering, Backend Engineering, ETL development, or a related role.
- Strong proficiency in Python and SQL, including complex queries, joins, CTEs, window functions, and query optimization.
- Hands-on experience building ETL/ELT pipelines, data ingestion workflows, and transformation processes.
- Experience with relational databases, preferably PostgreSQL/MySQL, and database design principles.
- Understanding of data warehousing, dimensional modeling, indexing, partitioning, and incremental data processing.
- Experience integrating REST APIs, databases, CSV/Excel files, JSON, and other data sources.
- Strong experience with FastAPI/Flask, microservices, Docker, and backend architecture; Kubernetes is a plus.
- Experience with AWS/Azure/GCP and cloud or on-premises deployments.
- Knowledge of CI/CD, automated testing, Git, logging, monitoring, production debugging, and AI/ML inference optimization.
- Exposure to LLMs, Agentic AI, tool calling, workflow automation, and frameworks such as LangChain/LlamaIndex.
- Strong problem-solving, communication, customer-facing, and collaboration skills, with the ability to work independently in fast-paced environments.
Good to Have
- Experience with Apache Spark/PySpark, Kafka, or similar distributed data processing and messaging technologies.
- Exposure to cloud data platforms and warehouses such as BigQuery, Redshift, or Azure Data Factory.
- Experience preparing datasets for AI/ML, GenAI, RAG applications, vector databases, or analytics pipelines
SCRYAI FZCO Gurugram, Haryana, IND Office
JMD Megapolis, No. 617 & 618 Sector-48, Sohna Road, Gurugram, India, 122018
Similar Jobs
Information Technology
Design, develop, and maintain scalable data solutions, pipelines, and ETL processes using AWS Glue and PySpark. Ensure data quality, support data migration across systems, optimize workflows, troubleshoot processing issues, and apply data modeling and warehousing concepts. Lead and mentor team members, make technical decisions, and coordinate cross-functional data initiatives.
Top Skills:
Aws GluePyspark
Information Technology
Design, develop, and maintain scalable data solutions, pipelines, and ETL processes using AWS Glue and PySpark. Ensure data quality, integration, transformation, migration, and workflow performance. Serve as a subject matter expert, make team decisions, resolve complex processing issues, coordinate cross-functional initiatives, and mentor junior engineers.
Top Skills:
Aws GluePyspark
Information Technology
Build and operate production ETL/ELT pipelines on Azure data platforms using Python, PySpark, and Spark SQL. Develop lakehouse tables, medallion architectures, data quality checks, monitoring, and integrations across heterogeneous systems. Model and query property and RDF knowledge graphs using Cosmos DB Gremlin, SPARQL, Turtle, and GraphDB. Manage metadata, lineage, data mesh products, performance optimization, and governed analytics- and AI-ready data products.
Top Skills:
Apache AirflowApache GremlinAWSAzureAzure Cosmos DbAzure Data FactoryAzure SynapseDatabricksDataflow Gen2Delta LakeEventstreamFabric Data FactoryGCPGraphdbKqlMicrosoft FabricMicrosoft PurviewOwlPandasPysparkPythonRdfRdfsShaclSkosSpark SqlSparqlSQLTurtle
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
