What are the responsibilities and job description for the Senior Data Engineer position at Qode?
Job Title: Senior Data Engineer – Hadoop Location: Pittsburgh, PA /Cleveland,OH Department: Enterprise Data & Analytics Employment Type: Full-timeJob Summary:PNC Bank is seeking a highly skilled Senior Data Engineer with extensive experience in Hadoop-based big data ecosystems. As part of our Enterprise Data & Analytics team, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support advanced analytics and business intelligence initiatives. You will work with cross-functional teams to enable data-driven decision-making across the organization.Key Responsibilities:Design, build, and optimize large-scale data pipelines using Hadoop and related technologies (Hive, Pig, HDFS, Spark, Sqoop, etc.).Collaborate with data architects and business stakeholders to understand data requirements and translate them into scalable data solutions.Implement data integration and ETL processes from diverse sources into Hadoop data lake environments.Ensure data quality, data security, and governance standards are upheld across systems.Troubleshoot and resolve issues in complex data environments.Monitor and maintain performance, availability, and reliability of big data platforms.Mentor junior engineers and contribute to the development of best practices and engineering standards.Collaborate with DevOps to support CI/CD and automation processes.Required Qualifications:Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field.5 years of experience in data engineering, with a strong focus on Hadoop ecosystem tools.Strong programming skills in Python, Java, or Scala.Deep understanding of HDFS, Hive, Spark, Sqoop, and Kafka.Experience with workflow orchestration tools such as Apache Airflow or Oozie.Proficient in SQL and working with relational and non-relational databases.Experience working in cloud environments (AWS/GCP/Azure) is preferred.Familiarity with data governance and security compliance in the financial services industry.
