Senior DataOps Engineer

Details:

Job Description

Stefanini Group is hiring!

Stefanini is looking for Senior DataOps Engineer, Dearborn, MI (Onsite)

For quick apply, please reach out Pawan Rawat Singh at 248-213-3605/pawansingh.rawat@stefanini.com

We are seeking a highly skilled and experienced Senior DataOps Engineer to join our EPEO DataOps team. This role will be pivotal in designing, building, and maintaining robust, scalable, and secure telemetry data pipelines on Google Cloud Platform (GCP). The ideal candidate will have a strong background in DataOps principles, deep expertise in GCP data services, and a solid understanding of IT operations, especially within the security and network domains. You will enable real-time visibility and actionable insights for our security and network operations centers, contributing directly to our operational excellence and threat detection capabilities.

Responsibilities

• Lead the design, development, and implementation of high-performance, fault-tolerant telemetry data pipelines for ingesting, processing, and transforming large volumes of IT operational data (logs, metrics, traces) from diverse sources, with a focus on security and network telemetry.
• Architect and manage data solutions using a comprehensive suite of GCP services, ensuring optimal performance, cost-efficiency, and scalability. This includes leveraging services like Cloud Pub/Sub for messaging, Dataflow for real-time and batch processing, BigQuery for analytics, Cloud Logging for log management, and Cloud Monitoring for observability.
• Drive the adoption and implementation of DataOps best practices, including automation, CI/CD for data pipelines, version control (e.g., Git), automated testing, data quality checks, and robust monitoring and alerting.
• Develop specialized pipelines for critical security and network data sources such as VPC Flow Logs, firewall logs, intrusion detection system (IDS) logs, endpoint detection and response (EDR) data, and Security Information and Event Management (SIEM) data (e.g., Google Security Operations / Chronicle).
• Implement and enforce data governance, compliance, and security measures, including data encryption (at rest and in transit), access controls (RBAC), data masking, and audit logging to protect sensitive operational data.
• Continuously monitor, optimize, and troubleshoot data pipelines for performance, reliability, and cost-effectiveness, identifying and resolving bottlenecks.
• Continuously monitor, optimize, and troubleshoot data pipelines for performance, reliability, and cost-effectiveness, identifying and resolving bottlenecks.
• Collaborate closely with IT operations, security analysts, network engineers, and other data stakeholders to understand data requirements and deliver solutions that meet business needs. Mentor junior engineers and contribute to the team's technical growth.
• Create and maintain comprehensive documentation for data pipelines, data models, and operational procedures.
  
  

Job Requirements

Details:

Experience Required

• Typically, 8 years of experience in data engineering, with at least 4 years in a Senior or Lead role focused on DataOps or cloud-native data platforms.
• Proven experience in DataOps/Data Engineering, operationalizing large-scale, optimized batch and real-time data pipelines.
• Strong understanding of DataOps principles: CI/CD, automation, data quality, data governance, monitoring.
• Proficiency in Python. Experience with Infrastructure as Code (IaC) tools (e.g., Terraform).
• Solid understanding of data modeling, schema design, and data warehousing (e.g., star schema).
• GCP Expertise: Data Ingestion & Messaging: In-depth experience with Cloud Pub/Sub, Cloud Logging, and integrating diverse log sources (e.g., VPC Flow Logs).
• Data Processing & Transformation: Hands-on experience with Dataflow (Apache Beam), Cloud Functions.
• Data Storage & Warehousing: Proficient in BigQuery, Cloud Storage (and potentially Bigtable).
• Orchestration: Experience with Cloud Composer (Apache Airflow).
• Monitoring & Observability: Strong skills in Google Cloud Operations Suite (Cloud Monitoring, Cloud Logging, Cloud Trace).
• Security Services: Familiarity with IAM, VPC Service Controls, KMS; understanding of Google Security Operations (Chronicle) desirable.
• Domain-Specific (IT Operations, Security & Networks): Understanding of IT operations telemetry (logs, metrics, traces).
• Experience collecting/processing security logs (firewall, IDS/IPS, EDR, SIEM) and network flow data (VPC Flow Logs).
• Familiarity with security concepts: threat detection, incident response, compliance. Knowledge of network protocols and topologies.
  
  

Education Required

• Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related quantitative field.
• Listed salary ranges may vary based on experience, qualifications, and local market. Also, some positions may include bonuses or other incentives***
  
  

Stefanini takes pride in hiring top talent and developing relationships with our future employees. Our talent acquisition teams will never make an offer of employment without having a phone conversation with you. Those face-to-face conversations will involve a description of the job for which you have applied. We also speak with you about the process, including interviews and job offers.

About Stefanini Group

The Stefanini Group is a global provider of offshore, onshore and near shore outsourcing, IT digital consulting, systems integration, application, and strategic staffing services to Fortune 1000 enterprises around the world. Our presence is in countries like the Americas, Europe, Africa, and Asia, and more than four hundred clients across a broad spectrum of markets, including financial services, manufacturing, telecommunications, chemical services, technology, public sector, and utilities. Stefanini is a CMM level 5, IT consulting company with a global presence. We are a CMM Level 5 company.