Senior Data Engineer

Taiwan·Taipeisenior

Data EngineerData

0 views0 saves0 applied

Apply Now

Quick Summary

Overview

Key Responsibilities

Engage with various data vendors to find the best data for the fund’s investment and trading activities Evaluate data quality, delivery timing, frequency, method, and symbology of different data sources Follow up contract and budget approval process…

Requirements Summary

Bachelor’s degree in computer science, electronic engineering or similar engineering background At least 5 years of experience in data engineering, preferably in the hedge fund industry or a related field Curiosity about the finance industry and the…

Technical Tools

airflowcsharpjavakafkapostgresqletlperformance-optimization

We are looking for Senior Data Engineer to join our hedge fund and manage our data operations. You will be responsible for engaging with various data vendors, designing and implementing data pipelines, and ensuring data quality and security. You will also mentor other data engineers who support the data infrastructure and pipelines of the fund.

Responsibilities

~1 min read

→Engage with various data vendors to find the best data for the fund’s investment and trading activities
→Evaluate data quality, delivery timing, frequency, method, and symbology of different data sources
→Follow up contract and budget approval process with data vendors and internal stakeholders
→Keep records of cost splits and propose ratio drafts for data vendor invoices
→Design data pipelines to process various internal and external data according to the nature of the data and the need of internal users
→Make sure the data pipeline and storage solutions are performant and scalable
→Implement automated data quality checks and alert system to monitor and troubleshoot data issues
→Provide adequate access control and usage audit solutions to ensure data security and compliance
→Research and evaluate latest data related technologies and tools to keep our data platform updated and competitive
→Lead and mentor a team of data engineers and ensure they have the necessary skills, tools, and resources to perform their tasks
→Collaborate with the investment and trading teams to understand their data needs and provide them with relevant and timely data access and delivery

Requirements

~1 min read

Bachelor’s degree in computer science, electronic engineering or similar engineering background
At least 5 years of experience in data engineering, preferably in the hedge fund industry or a related field
Curiosity about the finance industry and the ability to handle the data correctly based on the understanding of how users use it
Able to code in at least one static language, such as Java, C# etc.
Familiar with PostgreSQL and experienced with best practices and performance tuning
Familiar with Apache data tool stack, such as Airflow, Spark, Kafka, etc.
Experience with vendor management, price negotiation, and contract review is a plus
Familiar with KDB and other specialized database is a plus
Experience with storage cost optimization and data center hardware for high availability data storage is a plus
Excellent communication, presentation, and interpersonal skills
A keen interest and understanding of the financial markets and hedge fund strategies