Data Engineer

Project Overview

We are seeking contractor services for a Data Engineer on a project that will help our client to lay the foundational components to improve Data Quality, Data Integrity and utilization of Data as an Asset. This project is part of a broader strategic roadmap to modernize the Data foundations and Analytics capabilities for our client by delivering on an upgrade program from SAP ECC to SAP S/4 Hana.

The projects business objectives are as follows:

• Support requirements of digital initiatives by delivery of the shared, reusable data platform and integration capabilities.
  
• Facilitate faster solution development, maintenance and customization and overall time to deliver
  
• Increase transparency and supportability of integrations and data platforms.
  
• Improve resilience and scalability of data pipeline, data platform, and related integrations.
  
• Manage data flows between applications and the Enterprise Data Warehouse (EDW) in an efficient and thorough manner.
  
• Reduce technical debt resulting from the current data pipeline middleware solutions.
  
• Increase the scope and trustworthiness of historical data in EDW.
  
• Provide a Minimum Viable Foundation to enable dependent workstreams to leverage these elements as the Data Platform continues to expand over time.
  

The Data Engineer will be accountable for understanding the business goals and understanding of the business use cases, championing the stakeholders’ objectives and overseeing the activities of a system integrator to ensure proper adherence to IT governance and SDLC policy during planning, development, integration, testing, and implementation activities during the upgrade from SAP ECC to SAP S/4

Responsibilities

Scope

• To build a data management platform to catalog the data, profile the data for sharing, reuse and improve the data quality and data integrity of customer and relevant business functions data
  
• To design and implement a new data architecture that leverages the existing Azure cloud platform to host a centralized, comprehensive Enterprise Data Warehouse (EDW) for all enterprise analytics and reporting use cases.
  
• An EDW enables data journey from Data → Information → Insights → Decisions
  

Deliverables

The Data Engineer will collaborate with company stakeholders and System Integration partner to deliver:

• Gather requirements, provide design, and implement solutions to extract data from souce systems, and transform and load data into our Enterprise Data Warehouse (EDW) in Azure cloud and on- premise.
  
• Facilitate implementation and expansion of an enterprise data catalog solution.
  
• Data profiling of key master and reference data objects – identifying gaps and quality issues across software assets in scope.
  
• Discover, Catalog, Profile and assess key SAP ECC master data attributes to provide an actionable and prioritized data quality/ data cleansing remediation plan
  
• Assess and document security requirements from data privacy, confidentiality and sensitivity aspects for the SAP ecosystem.
  
• Understand and support data standards and processes to support master data migration
  
• Prepare and/or update operating procedures and other documentation needed to support data migration activities
   
  

Expectations

• Use appropriate company practices, in accordance with SDLC policies and quality expectations.
  
• Follow company policies, standards, procedures, templates, and processes (i.e. forms, access requests, deliverables, etc.)
  
• Work with and coordinate with internal resources, technical consultants, SMEs, System Integration (SI) partners and specialists in support of technical planning, design, and implementation.
  
• Proper fit with company relationship driven culture of customer focus, respect, accountability, and continues learning
  
• Assistance to project manager in overall project delivery by focusing on scoping, effort and resource estimating of technical tasks.
  
• Establishment of quality targets and operational metrics for technical deliverables in accordance with company's SDLC policy
  
• Problem-solving/decision-making as needed by the project
  

Qualifications

• Bachelor’s Degree in Computer Science, Information Technology or equivalent experience.
  
• 5 years of experience as a Data Engineer or in a similar role
  
• Informatica development and administration experience.
  
• Experience with data modeling, data warehousing, and building ETL pipelines
  
• Experience in SQL
  
• Experience with data modeling, data warehouse design, and building data marts and data pipelines
  
• Strong knowledge of data fundamentals including data structures, algorithm design and complexity analysis
  
• Design and implement system modifications
  
• Proficiency with RDBMS technology fundamentals, SQL and Query optimization
  
• Strong troubleshooting and diagnostic skills to determine and resolve issues.
  
• Experience supporting, architecting, and designing requirements with respect to the flow of data between SAP and non-SAP systems preferred.
  
• Knowledge and practical application of best practices for architecting, designing & supporting BI data platforms.
  
• Ability to optimize the performance of enterprise business intelligence solutions by means redesigning or re-architecting data structures or data flows.
  
• Experience working in the Microsoft Azure cloud environment.
  

 
Skills

• Ability to elicit requirements and motivations of the business community through interviews, facilitated sessions and written correspondence
  
• Demonstrate ability to effectively articulate technical challenges and solutions.
  
• Basic knowledge and proficiency to write Data Definition Language or Data Manipulation Language SQL commands
  
• Experience working with business areas and other non-technical groups, translating requests into requirements
  
• Have the investigative mindset and/or techniques that can be used with any number of tools to explore the available data
  
• Ability to understand and translate the need of business units into effective data management solutions.
  
• Experience in data validation and ability to analyze large datasets
  
• Some hands-on experience with reporting / visualization tools is greatly desired
  
• Background in Gas Utilities industry preferred
  
• Understanding and knowledge of IT standards and controls, IT Service Management [ITSM, ITIL] methods
  
• Mature planning, organizational, and time management skills
  
• Excellent interpersonal skills, including collaboration, facilitation, and negotiation