Jobs at AgileEngine

Design and optimize scalable ETL/ELT pipelines using Databricks, PySpark, SQL, GCP, BigQuery, and Delta Lake. Build agentic workflows that automate data validation, troubleshooting, and operational processes. Develop reusable frameworks, implement data quality and monitoring controls, optimize workloads, and support testing, deployment, productionization, and ongoing enhancements across data engineering solutions.

Build and operate cloud infrastructure, CI/CD pipelines, Kubernetes platforms, and observability for Data and AI teams. Develop infrastructure as code, implement PCI-aware security and compliance controls, lead incident response, and improve reliability. Partner with developers and technical stakeholders on platform tooling, developer self-service, internal standards, and production operations across distributed teams.

Designs, deploys, and manages scalable GCP infrastructure, Kubernetes workloads, serverless applications, and CI/CD pipelines. Uses Terraform, Azure DevOps, Bash, and PowerShell to automate infrastructure and application delivery. Manages GKE, Helm deployments, networking, storage, load balancing, monitoring, cost optimization, and zero-downtime releases. Integrates cloud security, IAM, compliance, and DevSecOps practices.

Own infrastructure-as-code and deployment pipelines while developing backend services for an identity and entitlement platform. Responsibilities include building API integration components, migrating entitlement data, preserving backward compatibility, executing system cutovers with rollback readiness, validating permissions, supporting QA and UAT, and managing deployment pipelines. The role requires Golang, Node.js, Terraform, DevOps, CI/CD, microservices, and complex systems integration experience.

Build and operate scalable backend payment features using Java, Kotlin, and Python. Develop APIs, microservices, and event-driven systems supporting charges, refunds, disputes, and webhooks. Refactor legacy services, reduce technical debt, improve test coverage, migrate deprecated APIs, and resolve production incidents. Collaborate in Agile sprints with product managers and engineering teams, document designs and runbooks, participate in reviews, and support handoff to the full-time team.

Execute large-scale data platform migrations to Snowflake, adapting approximately 1,000 datasets and existing pipelines. Build, test, monitor, and troubleshoot reliable Apache Airflow workflows while supporting migrations from Airflow 2 to 3, Confluent regions, and legacy formats to Iceberg. Apply Python, advanced SQL, Spark, PySpark, Kafka, AWS S3, and Snowflake data modeling to ensure data quality, reliability, and timely delivery.

Develop and maintain Java and Spring Boot microservices for a distributed payments platform. Build payment methods, event-driven workflows, integrations, and production features with strong transactional consistency and idempotency. Write unit and integration tests, manage MySQL/Aurora persistence and migrations, and improve reliability through observability, resilience patterns, and safe deployments. Use GitLab CI/CD pipelines with Datadog deployment gates and collaborate on financial-grade systems.

Leads complex technical programs involving product integration and AWS-to-GCP cloud migration. Coordinates engineering, testing, data, cloud, and product teams; manages workstreams, dependencies, milestones, risks, validation, data reconciliation, and production cutover. Partners with technical leads on architecture, APIs, databases, and blockers while providing executive reporting and driving delivery across distributed India and North America teams.

Leads complex technical programs spanning product integration and AWS-to-GCP cloud migration. Translates strategic goals into technical workstreams, dependencies, milestones, and execution plans; coordinates engineering, cloud, data, testing, and product teams; manages risks and blockers; oversees validation, parallel runs, reconciliation, cutover readiness, and production delivery; and reports progress to senior stakeholders across distributed teams.