What are the responsibilities and job description for the Senior Data Specialist - R01553679 position at Brillio?
Senior Data Specialist
\n- ETL Fundamentals, SQL, BigQuery, Dataproc, SQL (Basic Advanced), Python, Data Catalog, Data Warehousing, Composer, Dataflow, Cloud Trace, Cloud Logging, Cloud Storage, Datafusion, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
- Azure Data Engineer
- Strong with PySpark (esp. Spark SQL) for complex transformation pipelines
- Hands-on with Airflow for orchestration and BigQuery SQL for querying and data modeling
- Good experience in GCP (BigQuery, GCS, Pub/Sub, Cloud Run, Functions,Cloud SQL)
- Comfortable with real-time ingestion: Kafka, webhooks, file-based triggers
- Solid API integration skills (REST/webhooks), with ability to handle payload-driven workflows
- Experience working in Kubernetes (GKE) for deploying and scaling pipelines
- Comfortable handling UI-driven configuration, YAML-based setups, and modular frameworks
- Exposure to schema transformation, data validation, hashing, and DQF logic
- Domain familiarity with logistics/healthcare (CVS context is a big plus)
- Strong ownership mindset — able to work under pressure and balance speed with reliability
- Basic understanding of BASH, SFTP transfers, Networking, Access Management
- Bonus: PostgreSQL, CI/CD, monitoring, dashboarding, or lightweight UI development
- =================================
- Python & PySpark (Spark SQL) – 3 years
- Airflow (or any orchestration tool) – 2 years
- Google Cloud Platform (BigQuery, GCS, Pub/Sub, Cloud Run, Functions, Cloud SQL) – 3 years
- Real-time data ingestion (Kafka, webhooks, file-based) – 2 years
- API integration (REST/webhooks) – 2 years
- Kubernetes (GKE preferred) – 1–2 years
- BigQuery SQL & PostgreSQL – 2 years
- YAML/config-driven pipeline design – 2 years
- Schema transformation, hashing, DQF – 2 years
- CI/CD, observability, lightweight dashboards (Grafana/Streamlit/Flask UI) – 1 year
- Logistics or healthcare domain exposure – nice to have
Know more about:
DAI: https://www.brillio.com/services-data-analytics/
Know what it’s like to work and grow at Brillio: https://www.brillio.com/join-us/
Equal Employment Opportunity Declaration
Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.
#LI-SR1
