What are the responsibilities and job description for the Sr. Data Engineer position at Compunnel Inc.?
Role - Sr. Data Engineer
Location - Dallas Texas
Hybrid - 2 weeks onsite a month
Must Have - Oracle, Snowflake, PL.SQL Development, RDMBS, ETL, Informatica, Python
The Expertise and Skills You Bring
- Design, develop, and maintain data pipelines and ETL processes using Oracle, Snowflake, and Aws batch, Python.
- Responsible for System analysis including analyzing system requirements, identifying system specifications.
- Implement and manage data integration solutions to ensure seamless data flow across systems.
- Develop and optimize Unix shell scripts for automation and data processing tasks.
- Utilize AWS Batch for scheduling and executing ETL pipelines and batch processing jobs.
- Implement CI/CD pipelines using tools like Jenkins, Git, and Artifactory to automate deployment and integration processes.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
- Ensure data quality, integrity, and security across all data platforms.
- Troubleshoot and resolve data-related issues in a timely manner.
- Document data engineering processes and maintain comprehensive technical documentation.
- Strong experience with Oracle databases and Snowflake data warehousing.
- Proficiency in Unix and shell scripting.
- Hands-on experience with AWS Data Engineering services including AWS Batch, S3, EMR, EC2
- Expertise in Informatica for data integration and ETL processes.
- Solid understanding of data modeling and data architecture principles.
- Strong SQL skills for data querying and manipulation.
- Familiarity with CI/CD tools such as Jenkins, Git, and Artifactory.
- Knowledge of data governance and data quality best practices.
- Knowledge of Python for data processing and automation.
- Experience with big data technologies (e.g., Hadoop, Spark).
- Solid understanding of data warehousing concepts and ETL processes.
- Excellent analytical and problem-solving skills.
- Ability to work independently and as part of a team in a fast-paced environment.
- Strong communication and collaboration skills.
- Ability to translate business requirements into data-driven solutions.
- Strong communication skills to convey data insights to non-technical stakeholders
- Ability to analyze large datasets to identify trends and insights.
- Proficiency preferred in developing and maintaining dashboards and reports using data visualization tools (e.g., Tableau, Power BI).
