Gather AI Logo

Gather AI

Software Development Engineer II – Data Engineer

Posted 14 Days Ago
Remote
Hiring Remotely in India
Mid level
Remote
Hiring Remotely in India
Mid level
Build Gather AI’s data foundation from scratch by creating PostgreSQL extraction pipelines, dbt models, semantic metrics, data quality controls, tenant isolation, lineage, and documentation. The role includes warehouse data movement, ingestion-boundary validation, CI/CD delivery, safe backfills, on-call ownership, and collaboration across product, ML, security, and integration teams. Engineers will initially support the Drone product and later expand the platform to additional robotics and warehouse products.
The summary above was generated by AI

About Us

Are you ready to build the future of the supply chain? At Gather AI, we're not just creating software; we're pioneering a new era of warehouse intelligence. We've developed a groundbreaking, vision-powered platform that uses autonomous drones and existing equipment to capture real-time data, completely digitizing workflows that have historically been manual and error-prone. This means facilities operate smarter, safer, and more efficiently, ultimately redefining "on-time, in full" delivery.

If you're looking for an opportunity to contribute to truly transformative technology and make a significant impact in a vital industry, Gather AI is the place for you. We're leading the charge in the rapidly evolving robotics industry, and we invite you to join us in reshaping the global supply chain, one intelligent warehouse at a time.

About the Team

You'll join the Full Stack group within Cloud Services, which is being built now. Today, production and analytical workloads share a single database, and each product defines its own metrics. This team exists to fix that by designing and building the warehouse, transformation layers, and semantic model from the ground up. You'll work closely with Full Stack, ML, Product, Security, and Customer Success.

About the Role

Most data engineers early in their careers maintain one slice of a large, mature platform, or build pipelines against a model someone else designed years ago. This role is the opposite.

As an SDE II, Data Engineer, you'll be one of the first engineers building Gather AI's data foundation from scratch. The work includes:

  • Moving analytics off our production PostgreSQL database
  • Writing the layered dbt models every product will share
  • Defining metrics once so they stay consistent everywhere
  • Linking structured records back to the drone images and video they came from

You'll start by shipping well-scoped pipelines and models on our Drone product alongside senior engineers. From there, you'll grow toward owning a data domain end to end: its design, its quality, and its on-call.

This is a fully remote role on our India-based team. We work across multiple time zones, so clear written communication, initiative, and the ability to make progress independently matter.

What You'll Do

  • Build extraction pipelines. Move data from production PostgreSQL into the analytical warehouse (raw, refined, serving) using incremental loads that protect the production database.
  • Build and extend the shared data model. Write and maintain dbt models, such as dimensions, reusable metric building blocks, and serving tables, following the architecture set by our Principal Data Engineer.
  • Implement metrics. Add metrics to the semantic layer so a measure like "scan accuracy by site" is defined once and matches across every dashboard.
  • Keep data trustworthy. Add tests, freshness checks, and alerts to the pipelines you build, and help run safe backfills when data needs correcting.
  • Build in tenant isolation. Apply our access-control and tenant-separation patterns to every model and pipeline you ship.
  • Maintain lineage. Keep metrics traceable to their source records and drone images, so any number can be checked against the original capture.
  • Work at the ingestion boundary. Partner with the integration team to validate incoming WMS data against agreed contracts.
  • Document your work. Keep models documented and registered in the data catalog.
  • Ship safely. Deliver through CI/CD, use AI-assisted development, and join on-call for the pipelines you own.
  • Grow with the platform. Start on the Drone product, then help onboard MHE Vision, 3D case counting products onto the same data foundation over the year.

What You'll Need

  • Experience: 2–5 years building and running production data pipelines, and a degree in Computer Science or equivalent practical experience.
  • SQL: Strong SQL, including joins, window functions, and CTEs, plus a working understanding of dimensional modelling (facts, dimensions, grain). PostgreSQL experience preferred.
  • Transformation: Hands-on experience building tested models in dbt, Snowflake Dynamic Tables, Databricks Lakeflow Declarative Pipelines, or equivalent.
  • Python: Production pipeline code with tests and code review, beyond notebooks or one-off scripts.
  • Orchestration: Experience running pipelines in Airflow, Dagster, Databricks Lakeflow Jobs, Snowflake Tasks, or equivalent, including handling failures, re-runs, and backfills.
  • Data movement: Has loaded data from an operational database into a warehouse or lakehouse such as Snowflake or Databricks.
  • Cloud: Production experience on Azure or another major cloud, including object storage, Git, CI/CD, and Docker/Kubernetes.
  • Data quality mindset: Writes tests alongside code and cares whether data is correct, not just whether the job ran.
  • Ownership and growth: Hands-on and curious. Digs into problems beyond their own code, brings ideas to the team, and takes review feedback well.
  • Communication: Clear written and spoken English. Writes good PRs and documentation and raises blockers early in a distributed team.

Nice to Have

  • Change data capture (Debezium, Fivetran) or streaming (Kafka, Event Hubs)
  • PySpark or Snowpark
  • Terraform or other infrastructure as code
  • Semantic layers (dbt Semantic Layer, Cube) or data catalogs (Purview, DataHub)
  • Multi-tenant data platforms or row-level security
  • Working with image, video, or sensor data alongside structured records
  • Logistics, warehousing, or robotics domain experience

Similar Jobs

An Hour Ago
Remote or Hybrid
Mid level
Mid level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Develop scalable platforms and services for Mastercard’s Priceless Platform. Responsibilities include writing and reviewing code, collaborating with product and design teams, implementing automated testing and CI/CD, building cloud-native systems, communicating with stakeholders, and improving quality, reliability, security, and technical debt. The role requires expertise in software engineering, distributed systems, APIs, microservices, cloud platforms, and agile product development.
Top Skills: AgileAPIsAWSAzureC#Ci/CdDevOpsDistributed SystemsEvent-Driven ArchitectureGoGCPJavaMicroservicesPHPPythonReactive SystemsTypescript
2 Hours Ago
Remote
Gujarat, IND
Senior level
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Lead mechanical design reviews and coordination for large-scale semiconductor/pharma cleanroom facilities. Perform HVAC, exhaust, utility and piping analyses, CFD review, pipe stress and vibration checks, equipment specification and procurement support, clash detection, BIM coordination, and technical oversight during construction to ensure compliant, energy-efficient mechanical systems and on-time project delivery.
Top Skills: AutocadBimBim 360ClaudeComputational Fluid Dynamics (Cfd)CopilotGen-Ai (ChatgptLlms)NavisworksP&Ids
2 Hours Ago
Remote
Gujarat, IND
Senior level
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Design, review, and optimize high-reliability power distribution and substation systems for semiconductor fabs. Produce SLDs, sizing calculations, system studies, grounding/earthing, protection coordination, and commissioning support. Integrate SCADA/BMS, ensure compliance with standards, manage vendors/contractors, and support procurement, FAT/SAT, and energization.
Top Skills: AisArc Flash AssessmentAutocadAutocad ElectricalBimBmsChatgptClaudeCo-PilotEtapFmcsGeneratorsGisHarmonic FiltersLlmsProtection RelaysRevitRmuScadaSkm Power ToolsSwitchgearTransformersUpsVfd

What you need to know about the Delhi Tech Scene

Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account