What are the responsibilities and job description for the Sr Databricks Developer position at SightSpectrum LLC?
Role: Senior Databrick Developer/Support Engineer Experience: 7 10 years Work Mode: Hybrid (with 5-hour overlap with US EST) Core Technical Skills: Databricks Skill Level - Expert Solid experience in PySpark for data ingestion, transformation, and cleansing. Expertise in Delta Lake, job scheduling, and optimizing Spark jobs. Implement New Enhancements and new plant onboarding. Experience integrating Databricks with ADF pipelines and Azure Data Lake. Knowledge of data validation, logging, and e