What are the responsibilities and job description for the Databricks Admin position at Smart IT Frame LLC?
We are hiring!!
Role: Databricks Admin with AWS
Location: Menlo Park CA
Type: Contract
Job Description:
Responsibilities:
- Databricks Platform Infrastructure: Design, build, and maintain data infrastructure on the Databricks Platform, including Spark and Databricks SQL.
- Data Team Enablement: Provide technical expertise and support to Data Scientists, Data Engineers, and Analysts, enabling them to effectively utilize the Databricks platform.
- Performance Optimization: Optimize Databricks workloads for performance, scalability, and cost efficiency.
- Infrastructure as Code (IaC): Implement and manage infrastructure using IaC tools such as Terraform or CloudFormation.
- Security and Governance: Implement and maintain security and governance best practices for the Databricks platform.
- Monitoring and Troubleshooting: Monitor the health and performance of the Databricks infrastructure and troubleshoot and resolve technical issues.
- Best Practices: Develop and document best practices for Databricks platform management.
Minimum Qualifications:
- Extensive hands-on experience with the Databricks Platform, including Delta Lake, Spark, and Databricks SQL.
- Proven experience in building and maintaining cloud-based data infrastructure, preferably on AWS.
- Strong understanding of data warehousing, data lake, and data engineering concepts.
- Demonstrated experience supporting Data Scientists, Data Engineers, and Analysts.
- Proficiency in Infrastructure as Code (IaC) tools. Preferably Terraform.
- Experience with data pipelines, ETL/ELT processes, and data modeling.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
Thanks and Regards
Karan Kumar S
