Job Details

Lead Software Engineer, Resource Management

Job Info:

Category: Development
Company Description: Leading Contributor in Data Management, Machine Learning and Advanced Analytics
Salary: Highly Competitive, Depending on Experience
Position Type: Permanent
Location: Palo Alto, CA
Job Number: 9220

Job Description:

Our client develops the leading platform for data management, machine learning and advanced analytics. Their pioneering hybrid open source software model incorporates the best of open source with our robust proprietary software to form an enterprise-grade platform which runs on millions of servers around the world.



The Resource Management Team is responsible for the scheduling and resource management layers which are core to the platform. They place a strong emphasis on utilization, isolation, scalability, and interoperability across the components in the Hadoop ecosystem. Today they focus primarily on Apache Hadoop YARN, but they are also thinking broadly about how workloads are distributed and managed across clusters and our future efforts may incorporate other projects as well. Upcoming challenges include new analytic workloads across petabytes of data, multi-tenancy (including the challenges that come with it like SLAs, isolation, security, etc), and new types of organizational policies.




  • Drive the technical vision and direction for the team
  • Translate product and customer requirements into engineering plans
  • Design and build impactful features
  • Oversee the team’s technical designs
  • Give technical feedback and drive quality via code reviews
  • Collaborate with other teams on cross-team designs and execution plans
  • Mentor other engineers
  • Support customers by solving their complex issues
  • Represent our client and spread knowledge via talks at conferences and blog posts



  • BS in Computer Science or equivalent work experience
  • 10+ years of software engineering experience
  • Experience as a technical lead for an engineering team
  • Experience leading large, cross-functional projects to success
  • A mature and pragmatic approach to design and coding with consideration for performance, scale, quality, and maintainability
  • An ability to see both the big picture and the details and to effectively switch between the two views
  • Expert understanding of Java or C++
  • Mastery of concurrency
  • A desire to get things done



  • MS or PhD in Computer Science
  • Experience working on resource management systems like YARN, Kubernetes, Mesos, and similar systems
  • Experience working on large-scale distributed systems
  • Excitement about and experience in contributing to open source projects


About our Client

  • Great Team -- We’re a tight-knit team of talented engineers that really enjoy working together on challenging problems. Our engineering division also includes many of the top luminaries in Hadoop and related open source communities. We frequently interact with the research community, collaborate with engineers at other top companies and host cutting edge researchers for tech talks.
  • Open Source -- We contribute to and deliver an open source platform, comprised primarily of Apache Software Foundation projects. Most of our developers are either Apache committers or on the road to becoming one.
  • Innovative work - We push the frontier of big data and distributed computing, as our track record shows. We test and deploy our code on clusters with hundreds of nodes, terabytes of RAM, and petabytes of storage. We work on high-profile open source projects, interacting daily with engineers at other exciting companies, speaking at meet-ups, etc.
  • Great culture - We are a transparent and open meritocracy. Everybody is always thinking of better ways to do things, and coming up with ideas that make a difference. We build our culture to be the best workplace in our careers.
  • Experience - be part of the exhilarating ride at a fast-growing newly public company.
  • Perks - No-meeting Wednesdays, 30” monitors, top of the line laptops, free lunches, happy hours, and so on.

All qualified candidates are encouraged to apply by submitting their resume as an MS word document including a cover letter with a summary of relevant qualifications, highlighting clearly any special or relevant experience.

Please Note: All inquiries will be treated with the utmost confidentiality. Your resume will not be submitted to any client company without your prior knowledge and consent.

Contact Recruiter
Senior Technical Recruiter
Andiamo Partners | 90 Broad Street, Suite 1501, New York, NY 10004

Share Share this Job