Software Engineer, Observability



Software Engineering
Seattle, WA, USA · Remote
Posted on Tuesday, June 25, 2024

Eigen Labs is more than just a leading name in the blockchain space. We’re the driving force behind EigenLayer, a game-changing solution that revolutionizes crypto-economic security. Imagine a world where blockchain projects break free from the shackles of the scaling trilemma and capital limitations. In today's blockchain ecosystem, each service is typically secured by its own tokenized trust-network. With EigenLayer, services can build upon the established security of the Ethereum trust network, unlocking untold scalability while maintaining security and decentralization.

The Platform team at EigenLabs is on a mission to provide scalable and secure cloud services that enable product teams to ruthlessly execute their goals to hyperscale Ethereum. The team is scaling up as we seek out innovative thinkers and engineers to join us on our mission.


We are seeking a talented and experienced Observability Engineer with a strong background in backend software development and cloud technologies. The ideal candidate will have 3-5 years of overall backend software development experience and 2+ years of hands-on experience with various cloud observability technologies such as Datadog, Grafana, Prometheus in addition to cloud native platforms AWS and Kubernetes.


  • Develop and Implement Monitoring Solutions: Design, develop, and implement robust monitoring and observability solutions using Datadog, Prometheus, Grafana, and other industry-standard tools.
  • Performance Monitoring: Set up comprehensive monitoring for system performance, application metrics, and infrastructure health to ensure optimal performance and early detection of issues.
  • Alerting and Incident Management: Develop and manage alerting systems to promptly identify and respond to issues. Collaborate with the incident response team to troubleshoot and resolve performance bottlenecks and other issues.
  • Dashboard Creation: Create and maintain intuitive and informative dashboards in Grafana and other visualization tools to provide insights into system health and performance metrics.
  • Log Management: Implement and manage log aggregation and analysis solutions to support debugging, troubleshooting, and performance tuning.
  • Tracing: Implement and manage distributed tracing systems to monitor and analyze the flow of requests through microservices and detect performance issues.
  • Collaboration: Work closely with software developers and other stakeholders to understand monitoring requirements and deliver effective observability solutions.
  • Documentation: Maintain comprehensive documentation of monitoring configurations, processes, and best practices.


  • c
  • Education: Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent work experience.
  • Experience:
      • 3-5 years of overall backend software development experience.
      • 1-3 years of hands-on experience with observability technologies, specifically Datadog, Prometheus, Grafana and other relevant technologies.
  • Skills:
    • Proficiency in using and configuring monitoring tools.
    • Strong understanding of monitoring and observability principles and best practices.
    • Experience with log management tools and practices.
    • Experience with distributed tracing systems.
    • Familiarity with cloud platforms such as AWS and infrastructure as code tools such as Terraform.
    • Proficiency in at least one programming language (Golang or Python preferred).
    • Excellent problem-solving skills and the ability to troubleshoot complex issues.
    • Strong communication and collaboration skills.


  • Experience with observability of front-end applications.
  • Experience with modern AWS native services.
  • Experience with Ethereum and other PoS blockchain protocols.

In compliance with local law, we are disclosing the compensation, or a range thereof, for roles in locations where legally required. $175,000 - $220,000 is the annual base salary. Other rewards may include annual bonuses, short- and long-term incentives, and program-specific awards. In addition, Eigen Labs provides various employee benefits, including:

  • Employer-covered Medical, Dental, and Vision plans
  • 401k
  • Unlimited Paid Time Off
  • 12 weeks of fully paid maternity and paternity leave

#LI-Remote | #LI-AC1