What are the responsibilities and job description for the Data Engineer (Full-Time, Salaried) position at Top Stack?
Our financial services client in Manhattan is seeking a Data Engineer to join their team. This is a full-time, salaried position. Three days in the office (Manhattan, New York) and two days work from home.
Position Overvie
wAs a Data Engineer, you will develop a deep understanding of our client's data landscape and collaborate closely with cross-functional teams to gather requirements and deliver data-driven solutions. You will be responsible for providing data services through reports, systems, and interface applications to support various business functions
.
The ideal candidate has a strong background in data engineering, is proficient in mainstream database systems, and possesses solid development skills, including the ability to perform in-depth debugging and troubleshooting. A passion for solving complex data challenges and enabling data-driven decision-making is essentia
l.
Key Responsibiliti
- es:Data Analysis and Reporting: Work with business analysts and stakeholders to understand their data needs and deliver data solutions. Requires a strong understanding of data processing and hands-on experience with tools such as SQL, Pandas, and Jupyt
- er.Data Service Platform Development: Identify recurring analytical and reporting needs and implement reusable solutions within the internal data service platform. Proficiency in Python, Django, and JavaScript is required, along with strong debugging skil
- ls.Data Processing Pipelines: Design, build, and maintain reliable and scalable daily data pipelines. Experience with Apache Airflow or other ETL orchestration tools is essenti
- al.External Data Interfaces: Develop and maintain data services for external systems based on internal datasets. Requires knowledge of RESTful APIs and message queue technologies such as IBM MQ or Apache Kaf
- ka.Data Platform Infrastructure: Work with cloud-based infrastructure components including EC2, Docker, RDS, Redshift, and S3 to support the data platfo
rm.
Qualificati
- ons:Must:Bachelor’s degree in Data Engineering, Computer Science, Information Technology, or a related f
- ieldMinimum of 3 years’ experience in a data engineering
- roleProficiency in Python and Pa
- ndasStrong SQL sk
- illsPreferred:Experience with JavaScript and web debugging t
- oolsFamiliarity with Apache Air
- flowExperience with Dj
- angoExperience with AWS and related cloud technolo