Job Details

Senior Software Engineer - Derivatives Data Pipeline (Kafka, Flink, Spark) - SF

Job Info:

Category: Operations/Support, Software Engineering
Company Description: Leading global provider of data, news and analytics
Salary: Highly Competitive, Depending on Experience
Position Type: Permanent
Job Number: 9633

Job Description:

The Derivatives Data Team is building a one-stop solution to bring transparency, efficiency, and excellence to this complex market. The financial data we process, not only high frequency, but also sophisticated, creates unique challenges in this area. The team applies cutting edge technologies like Spark, Cassandra, machine learning to build a data pipeline to produce real time and accurate analytic data to our clients. However, that’s just a start. There are lots of areas, i.e., low latency scoring of streaming data, online machine learning, and real time prediction, waiting for us to explore to offer our clients better quality data. That’s where you will shine!

As part of this creative team, you will be building a groundbreaking platform which will revolutionize data generation. Different technologies: Kafka Streaming, Spark Streaming, Flint, Spark MLlib, are there waiting for YOU to work with the team to make the best choice.

We have:

  • Constantly ticking financial data that needs to be processed in real-time
  • Terabytes of static data as your playground
  • Direct and tremendous impact on top decision-makers
  • Knowledgeable/helpful team members to help you build good understanding of financial data and models
  • An open mind to new ideas and technologies


You have:

  • Professional experience in design/architecture
  • Strong programming proficiency in Scala and/or Java
  • Hands on experience in data streaming and/or Apache Spark
  • Solid understanding of data structures, algorithms
  • The motivation to build scalable, efficient platforms


You might also have:

  • Experience in designing and implementing large scale systems
  • Understanding derivatives financial products
  • Exposure to machine learning
  • Knowledge of cloud computing technologies


You will work at the intersection of technology, data science, finance and mathematics. The goal of this platform is analyze, predict, clean and generate best quality derivatives data.



All qualified candidates are encouraged to apply by submitting their resume as an MS word document including a cover letter with a summary of relevant qualifications, highlighting clearly any special or relevant experience.

Please Note: All inquiries will be treated with the utmost confidentiality. Your resume will not be submitted to any client company without your prior knowledge and consent.

Contact Recruiter
Senior Technical Recruiter
Andiamo Partners | 90 Broad Street, Suite 1501, New York, NY 10004

Share Share this Job