fal Logo

fal

Operations Engineer, HPC Networking

Reposted 17 Days Ago
Remote
Hiring Remotely in IND
Mid level
Remote
Hiring Remotely in IND
Mid level
As an Operations Engineer, you will manage HPC networking, monitor and debug InfiniBand and Ethernet fabrics, and support fabric bring-up while enhancing operational tools and runbooks.
The summary above was generated by AI

fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.

As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.

About the role

We're hiring an Operations Engineer for HPC Networking to keep our InfiniBand and Ethernet fabrics healthy as we scale.

This is a hands-on role. You'll bring up new fabrics alongside DC ops, monitor the ones in production, and chase down the weird stuff: link flaps, congestion, NCCL stalls, firmware bugs that only show up at scale. 

You're a fit if you've:
  • Operated InfiniBand fabrics in production: subnet manager, routing, partitioning, monitoring.
  • Debugged the full stack: cables, transceivers, switch firmware, HCAs, drivers, NCCL.
  • Brought up new fabrics from cable pull through validation.
  • Scripted your way through repetitive operational work (bash, python, go, whatever).
  • Nice to have: Ethernet RoCE, Spectrum-X, or large-scale GPU cluster networking.
Who you are:
  • Detail-oriented. Cable plant hygiene is a personality trait.
  • Calm under fire. A fabric incident during a customer training run doesn't rattle you.
  • You read vendor release notes for fun, or at least out of self-defense.
  • You'd rather find the root cause than reboot the switch.
Responsibilities:
  • Monitor health and performance of InfiniBand and Ethernet fabrics: switches, HCAs, transceivers, links.
  • Investigate and resolve fabric issues: connectivity, congestion, performance regressions.
  • Support fabric bring-up alongside DC ops and customer-facing teams.
  • Run maintenance and upgrades on switches and control plane components.
  • Partner with cluster ops on cross-domain incidents where the line between compute and network is blurry.
  • Improve the tooling and runbooks so the next incident resolves faster than the last.

Similar Jobs

6 Hours Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead and grow a finance data engineering team, provide technical direction for scalable data platforms, drive engineering excellence and processes, and partner with business, data science, and analytics teams to build trusted data products.
Top Skills: AWSDatabricksDbtGraph DatabasesPythonS3SparkSpark StreamingSQL
6 Hours Ago
In-Office or Remote
Expert/Leader
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead architecture and technical direction for the Connector Platform front door: API gateway, developer SDK/codegen, authentication, and integration lifecycle. Improve time-to-production, reliability, and security for edge-facing systems. Design declarative SDK/compiler pipelines, common auth/admission gateway, partner on identity/tenancy contracts, mentor senior engineers, and represent the team in cross-org technical discussions.
Top Skills: Api GatewayAuthenticationCode GenerationCompilerDeclarative Configuration EnginesDeveloper SdkIdentity ManagementOauthTenancy
6 Hours Ago
Remote
India
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Partner with cross-functional teams to design and execute quantitative analyses, experiments, forecasting, and visualizations that influence product and business strategy. Translate data into stories and actionable recommendations, measure impact, and present findings to senior leadership.
Top Skills: LookerMicrostrategyPythonRR-ShinySap Business ObjectsSQLTableau

What you need to know about the Delhi Tech Scene

Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account