Data Systems Engineer, Rust

Edge & Node is at the forefront of web3 innovation. Our mission is to establish The Graph as the unbreakable foundation of open data. Our pioneering subgraphs set the industry standard and solidify The Graph as the premier solution for organizing and accessing blockchain data.

At Edge & Node, we champion a decentralized future based on shared values. Dedicated to decentralizing power and resisting censorship, we aim for a robust, permissionless information era free from central control, thus eliminating the traditional vulnerabilities associated with misplaced trust.

The Graph Network’s talented Engineering team builds and maintains core software components that power The Graph. As a Data Systems Engineer, you will do in-depth work to develop key technology that enables The Graph and participate in a growing ecosystem.

For this role, we are looking for a highly motivated and dedicated Rust Engineer who will support the development of state-of-the-art data services for processing blockchain data. If you’re passionate but don’t have experience with the specific technologies or web3, we encourage you to still apply. We value merit and skill and welcome those willing to learn and grow. 

What You’ll Be Doing

• Leveraging and contributing to Apache DataFusion, closely monitoring upstream developments and becoming familiar with its codebase.
• Implementing storage strategies for blockchain and other web3 data sources, while leveraging industry standard formats and keeping in mind their tradeoffs.
• Developing the internals of a streaming processing system. Given the streaming nature of blockchains, you must understand incremental techniques to update outputs with each new block.
• Applying resource isolation in a multi-tenant environment for resources such as CPU, RAM and storage.
• Building data transformation pipelines specifically for blockchain data and implementing operations like aggregations and joins for streamlined usage. 
• Optimizing compaction and garbage collection processes for performance and resource efficiency particularly in multi-tenant and high-throughput database systems. 
• Developing supportive tooling, including tracing and  profiling.

What We Expect

• Experience in database system internals.
• Rust familiarity is highly desirable.
• Knowledge of Apache DataFusion and the related ecosystem is highly desirable.
• General knowledge of distributed data systems and resource management is highly desirable.
• Background with data ingestion from blockchain or other high-throughput sources is a plus. 
• Adaptability to a dynamic and fully-remote work environment.
• Rigorous approach to software development that reflects a commitment to excellence. 

Compensation/Culture

The overall market range for roles at Edge & Node is typically $100k - $500k annually. This market range is based on total compensation (vs. only base salary). Edge & Node has a culture that values meritocracy, personal growth, and an ego-free environment.

About The Graph