Edge & Node Logo

Edge & Node

Data Systems Engineer, Rust

Posted 4 Days Ago
Remote
40 Locations
Entry level
Remote
40 Locations
Entry level
As a Data Systems Engineer, you will develop technology for processing blockchain data, implement storage strategies, and build data transformation pipelines. Responsibilities include optimizing systems for performance and resource efficiency, developing supportive tooling, and applying resource isolation in a multi-tenant environment.
The summary above was generated by AI

Edge & Node is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering subgraphs set the industry standard and solidify The Graph as the premier solution for organizing and accessing blockchain data.

At Edge & Node, we champion a decentralized future based on shared values. Dedicated to decentralizing power and resisting censorship, we aim for a robust, permissionless information era free from central control, thus eliminating the traditional vulnerabilities associated with misplaced trust.

The Graph Network’s talented Engineering team builds and maintains core software components that power The Graph. As a Data Systems Engineer, you will do in-depth work to develop key technology that enables The Graph and participate in a growing ecosystem.

For this role, we are looking for a highly motivated and dedicated Rust Engineer who will support the development of state-of-the-art data services for processing blockchain data. If you’re passionate but don’t have experience with the specific technologies or web3, we encourage you to still apply. We value merit and skill and welcome those willing to learn and grow. 

What You’ll Be Doing

  • Leveraging and contributing to Apache DataFusion, closely monitoring upstream developments and becoming familiar with its codebase.
  • Implementing storage strategies for blockchain and other web3 data sources, while leveraging industry standard formats and keeping in mind their tradeoffs.
  • Developing the internals of a streaming processing system. Given the streaming nature of blockchains, you must understand incremental techniques to update outputs with each new block.
  • Applying resource isolation in a multi-tenant environment for resources such as CPU, RAM and storage.
  • Building data transformation pipelines specifically for blockchain data and implementing operations like aggregations and joins for streamlined usage. 
  • Optimizing compaction and garbage collection processes for performance and resource efficiency particularly in multi-tenant and high-throughput database systems. 
  • Developing supportive tooling, including tracing and  profiling.

What We Expect

  • Experience in database system internals.
  • Rust familiarity is highly desirable.
  • Knowledge of Apache DataFusion and the related ecosystem is highly desirable. (Apache DataFusion Project Page and GitHub)
  • General knowledge of distributed data systems and resource management is highly desirable.
  • Background with data ingestion from blockchain or other high-throughput sources is a plus. 
  • Adaptability to a dynamic and fully-remote work environment.
  • Rigorous approach to software development that reflects a commitment to excellence. 

Compensation/Culture

The overall market range for roles at Edge & Node is typically $100k - $500k annually. This market range is based on total compensation (vs. only base salary). Edge & Node has a culture that values meritocracy, personal growth, and an ego-free environment.

About The Graph

The Graph is the indexing and query layer of web3. The Graph Network’s self service experience for developers launched in July 2021. Developers build and publish open APIs, called subgraphs, that applications can query using GraphQL. The Graph supports indexing data from multiple different networks including Ethereum, NEAR, Arbitrium, Optimism, Polygon, Avalanche, Celo, Fantom, Moonbeam, IPFS, and PoA with more networks coming soon. To date, tens-of-thousands of subgraphs have been deployed on the hosted service, and now subgraphs can be deployed directly on the network. Over 28,000 developers have built subgraphs for applications such as Uniswap, Synthetix, KnownOrigin, Art Blocks, Balancer, Livepeer, DAOstack, Audius, Decentraland, and many others.

If you are a developer building an application or web3 application, you can use subgraphs for indexing and querying data from blockchains. The Graph allows applications to efficiently and performantly present data in a UI and allows other developers to use your subgraph too! You can deploy a subgraph to the network using the newly launched Subgraph Studio or query existing subgraphs that are in the Graph Explorer. The Graph would love to welcome you to be Indexers, Curators and/or Delegators on The Graph’s mainnet. Join The Graph community by introducing yourself in The Graph Discord for technical discussions, join The Graph’s Telegram chat, and follow The Graph on Twitter, LinkedIn, Instagram, Facebook, Reddit, and Medium! The Graph’s developers and members of the community are always eager to chat with you, and The Graph ecosystem has a growing community of developers who support each other.

The Graph Foundation oversees The Graph Network. The Graph Foundation is overseen by the Technical Council. Edge & Node, StreamingFast, Messari, Semiotic  and The Guild are five of the many organizations within The Graph ecosystem.

Top Skills

Rust

Similar Jobs

Be an Early Applicant
16 Hours Ago
28 Locations
Remote
2,350 Employees
Senior level
2,350 Employees
Senior level
Cloud • Security • Software • Cybersecurity • Automation
As the Engineering Manager for GitLab Delivery, you will build and lead a high-performing team of Site Reliability and Backend Engineers, ensuring efficient software release processes while maintaining security and scalability. You will collaborate with cross-functional teams to align business and customer objectives with technical execution, manage agile projects, and enhance the overall quality of the product.
Yesterday
32 Locations
Remote
2,350 Employees
Senior level
2,350 Employees
Senior level
Cloud • Security • Software • Cybersecurity • Automation
Lead and grow a high-performing software engineering team focused on enhancing software supply chain security. Responsibilities include managing engineering managers, collaborating across departments, identifying emerging threats, and implementing metrics for team productivity.
2 Days Ago
28 Locations
Remote
242 Employees
Senior level
242 Employees
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Conversational AI
As a Senior Backend Engineer at Smartcat, you will design and implement scalable backend services and APIs, optimize application performance, collaborate with teams, troubleshoot production issues, and participate in code reviews.

What you need to know about the Delhi Tech Scene

Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account