Job Details

Big Data Engineer

Job Info:

Category: Software Engineering
Company Description: Leading Hedge Fund
Salary: Highly Competitive, Depending on Experience
Position Type: Permanent
Location: New York, NY
Job Number: 8602

Job Description:


The Big Data Engineer will work on the collecting, storing, processing, and analyzing of huge data sets. The main objective will be to design the optimal software solutions, implementing, maintaining and monitoring them.

  • Work closely with financial analysts to develop new algorithms to automate the investment process
  • Process unstructured data into a form suitable for analysis
  • Support business decisions with ad hoc analysis as needed
  • To be able to work in teams and collaborate with others to clarify requirements


  • Strong programming experience (8+ years) in Python or C++
  • Strong SQL expertise (6+ years), including designing data warehouse schemas and tuning performance of very complex SQL queries
  • Experience processing large amounts of structured and unstructured data at scale (including writing scripts, web scraping, calling APIs, writing SQL queries, etc.)
  • Ability to clean and scrub noisy datasets
  • Ability to build custom software tools
  • Experience with AWS/EMR and other web services
  • Experience with statistical analysis, data mining, machine learning, natural language processing, or information retrieval is a plus
  • Experience with Spark and MapReduce is a plus
  • Experience with data visualization (Tableau) is a plus



All qualified candidates are encouraged to apply by submitting their resume as an MS word document including a cover letter with a summary of relevant qualifications, highlighting clearly any special or relevant experience.

Please Note: All inquiries will be treated with the utmost confidentiality. Your resume will not be submitted to any client company without your prior knowledge and consent.

Contact Recruiter
Senior Technical Recruiter
Andiamo Partners | 90 Broad Street, Suite 1501, New York, NY 10004

Share Share this Job