What are the responsibilities and job description for the Azure Data Bricks Architect position at iTech US, Inc.?
Job Details
Job Role: Azure Data Bricks Architect
Location: Tampa, FL
Duration: 12 months
Job Description:
- Design and implement scalable data platforms and pipelines using Databricks (including Spark, Delta Lake, MLflow, etc.).
- Work with stakeholders to develop modern data architectures that meet business requirements.
- Lead the migration from legacy platforms to the Databricks Lakehouse architecture.
- Establish data governance, quality, and security standards in collaboration with InfoSec and Compliance teams.
- Optimize data ingestion, transformation, and consumption processes.
- Mentor data engineers and developers on best practices for using Databricks.
- Integrate Databricks with enterprise tools such as Power BI, Tableau, Kafka, Snowflake, and others. Develop and implement machine learning/Al workflows within a Databricks environment.
- Collaborate with cloud architects to ensure a robust infrastructure setup on AWS, Azure, or Google Cloud Platform. Produce technical documentation, architectural diagrams, and data models.
Qualifications**
- Over 8 years of experience in data engineering or architectural roles.
- More than 5 years of experience in architecting solutions with Databricks.
- Expertise in Apache Spark, Delta Lake, MLflow, and Lakehouse architecture.
- Proficiency in SQL, Python, and/or Scala.
- Practical experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Strong understanding of distributed computing, performance tuning, and data security.
- Experience with CI/CD pipelines, DevOps tools, and orchestration tools like Airflow or Data Factory.
Preferred Qualifications
- Databricks Certified Data Engineer or Solutions Architect.
- Knowledge of MLOPs and deploying machine learning models into production.
- Experience with data mesh, data fabric, or similar enterprise data architectures.
- Experience in public sector, healthcare, or financial services is advantageous.
Education: At least a bachelor s degree (or equivalent experience) in Computer Science, Software/Electronics Engineering, Information Systems, or a closely related field is required.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
