Job Details

Senior Software Engineer - Streaming Platform as a Service (SPaaS) - SF

Job Info:

Category: Operations/Support, Software Engineering
Company Description: Leading global provider of data, news and analytics
Salary: Highly Competitive, Depending on Experience
Position Type: Permanent
Job Number: 9671

Job Description:

We are investing in an enterprise-wide Streaming Platform as a Service (or, SPaaS) to support large-scale and low-latency event and stream processing pipelines for financial analytics. This platform is being built around the Kafka ecosystem, with Kubernetes as the deployment runtime.

The platform aims to provide management of Kafka flows, connectivity to a variety of internal publish & consume endpoints and cater to streaming workloads ranging from Tickstream analytics to Tradeflow processing. The workloads are both high-throughput (in the order of millions of messages/sec) and low-latency (sub-10 milliseconds). Our team is building this platform to provide standardized workflows for development, multi-DC deployment, monitoring and disaster recovery for streaming applications.

This is a greenfield effort and we could use your help. If the opportunity to define and implement key components of this platform sounds like the challenge you've been looking for, we'd love to hear from you.

We'll trust you to:

  •  Contribute to the development of our Streaming Platform
  •  Interact with application teams to understand specific requirements and drive the next set of platform features
  •  Meet with key players in the open source community to motivate necessary development efforts
  •  Contribute code to the Apache Kafka, Kubernetes and or other open-source communities in areas such as Multi-tenancy

You'll need to have:

  •  3+ years experience programming in in 2 major programming languages (Java/Scala and Python/Go) and willing to pick up more as needed
  •  Understanding and enthusiasm to learn the internals of Kafka and it's surrounding ecosystem - your work will require troubleshooting the internals and perhaps modifying it

We'd love to see:


  •  Experience building data or analytics infrastructure of any kind
  •  Web Development using React, Angular and NodeJS
  •  Open source contributions and community evangelism of any sort

All qualified candidates are encouraged to apply by submitting their resume as an MS word document including a cover letter with a summary of relevant qualifications, highlighting clearly any special or relevant experience.

Please Note: All inquiries will be treated with the utmost confidentiality. Your resume will not be submitted to any client company without your prior knowledge and consent.

Contact Recruiter
Senior Technical Recruiter
Andiamo Partners | 90 Broad Street, Suite 1501, New York, NY 10004

Share Share this Job