Job Details


Data Services - Software Engineer (C++/ Scala/Java +Spark)

Job Info:


Category: Development
Company Description: Leading global provider of data, news and analytics
Salary: Highly Competitive, Depending on Experience
Position Type: Permanent
Location:
Job Number: 8694

Job Description:


 

Engineering Data Services group is responsible for core data and analytics services that are used across application teams. Our service stack currently runs on over 900 machines and serves over 120 billion requests a day. With ever increasing data volumes and growth of Enterprise products this footprint has been growing at a rapid pace year over year. Our team also provides multiple foundational services such as meta data and id master for our Query Language (BQL), the next generation analytics and screening engine for financial datasets.

 

We are building out a suite of tools that help developers support and optimize implementation of reference data and analytics. One such tool, the reference data integrity, is required to verify 50 billion unique data points daily to detect anomalies. This immense scale requires the use of Hadoop and Spark analytics framework. We are developing a set of brand new services for metadata, security & entity relationships and entitlement. Due to the large volume and explosive growth of underlying data we are looking to leverage Hadoop based storage for these services. We are also building new tools to manage our server farm more efficiently and leverage analytics to ensure high availability, efficient load balancing and fair scheduling.

 

We are looking for strong C++/Scala software engineers who can design and develop low latency, high performance distributed systems. If you have strong programming skills, the ability to work collaboratively and a proven track record of delivering quality engineering solutions to real world problems, you'll fit right in.

Our team is comprised of a small group of technologists passionate about data and pushing the boundaries of technology to deliver innovative solutions. We expect you to be proactive, able to work independently and take ownership in driving the vision and execution of the product.

We'll trust you to:

  •  Design, implement and own critical applications and components of our services stack
  •  Participate in the full SDLC (Software Development Life Cycle) of various components and systems that are required to be highly efficient, robust and scalable
  •  Enhance our infrastructure to fulfill mission critical SLAs, whether low latency or high throughput data retrieval
  •  Get to know development teams across the company, understand their application requirements and data access patterns

You need to have:

  •  Proven C++ or Java on UNIX/Linux environment
  •  Solid understanding of algorithms and data structures, knowledge of object-oriented design and multi-threading
  •  Excellent problem solving and communication skills, and ability to thrive in a highly collaborative and dynamic work environment
  •  Experience with high volume, high availability distributed systems
  •  Experience working in a test-driven development and agile environment

We'd love to see:

  •  Knowledge of low-level Linux, UNIX networking and C system calls for high performance computing and debugging
  •  Experience with systems level Java or Scala
  •  Experience with Hadoop and/or using a distributed analytics infrastructure like Apache Spark

 

 


All qualified candidates are encouraged to apply by submitting their resume as an MS word document including a cover letter with a summary of relevant qualifications, highlighting clearly any special or relevant experience.


Please Note: All inquiries will be treated with the utmost confidentiality. Your resume will not be submitted to any client company without your prior knowledge and consent.


Contact Recruiter
kimberly.vaio@andiamogo.com
Senior Technical Recruiter
Andiamo Partners | 90 Broad Street, Suite 1501, New York, NY 10004


Share Share this Job