What are the responsibilities and job description for the Data Engineer position at On-Demand Group?
Job Description
Data Engineer
Direct hire
This role develops enterprise data solutions that support the organization in achieving its strategic goals. Your work on cloud data pipelines will advance our enterprise data capabilities, while you get immersed in our collaborative, fun, and engaging culture. The position reports to our IT Data Engineering department and is a part of projects that align with key strategic initiatives to meet our business objectives. In your role, you will be part of a team that is responsible for the design, development, testing, deployment and support of cloud-based (Google Cloud Platform), data, analytical, and reporting applications.
Essential Duties & Responsibilities:
• Develop and maintain custom ELT data pipelines with Python and SQL-based transformations running on the Google Cloud Platform.
• Collaborate and implement event and batch based data science scoring pipelines.
• Develop data access APIs to facilitate cross application data sharing.
• Conduct and/or participate in requirements analysis sessions with internal customers, external vendors, and project teams.
• Translate business requirements into technical designs.
• Follow engineering best practice to ensure robust, tested, and reliable data pipelines.
• Support data governance and security practices.
• Follow agile development methodologies and actively participate in sprint planning sessions.
• Support downstream users and resolve production issues with excellent customer service.
Job Skills:
• Hands-on experience in creating API based data ingestion pipelines.
• Good design skills in data pipeline, enrichment, and API patterns.
• Good understanding of object oriented software engineering patterns.
• Good relationship-building, customer service, and problem resolution skills.
• Knowledge of software engineering, version control, and testing practices.
• Knowledge of Agile software development methodologies.
• Works effectively in a dynamic work environment with competing priorities.
Work Experience (6 months experience each)
• Python object oriented programming. Multi-language experience preferred.
• API based custom data ingestion, particularly working with 3rd party vendor API's including reading API documentation, authentication, and bulk data staging strategies.
• Cloud-based development. Google Cloud Platform preferred.
• SQL
• Experience with development in a version control, CI/CD environment.
Education:
• From an accredited institution, Bachelor’s degree is required.
Salary : $100,000 - $0