What are the responsibilities and job description for the Full Time: Data Solution Architect position at Visionary Innovative Technology Solutions LLC?
Position: Data Solution Architect
Location: Mount Laurel, NJ (4 days onsite per week)
Duration: Full Time
Job Description:
Primary skillset: Technical Architect /Lead | Azure, Databricks, Apache Spark/PySpark, Data Modeling
Secondary skillset: SQL, Python, Datawarehouse
• Design scalable, secure, and high-performance cloud solutions on Microsoft Azure services
• Design large-scale data processing and analytics solutions using Azure Databricks.
• Develop comprehensive architecture blueprints and technical documentation for data solutions.
• Lead the implementation of Databricks-based solutions, ensuring alignment with best practices and business requirements.
• Lead Data Mesh/Data products architecture building in Databricks-based solutions
• Provide technical leadership and guidance throughout the project lifecycle.
• Lead the implementation of Azure-based solutions, ensuring alignment with best practices and business requirements.
• Collaborate with stakeholders to gather requirements and translate them into technical solutions.
• Design and implement CI/CD pipelines using Azure DevOps.
• Ensure robust security measures are in place, including identity management, encryption, and network security.
• Optimize cloud resources for performance, cost, and reliability.
• Stay updated with the latest Azure services, features, and industry trends. Requirements:
• Bachelor’s degree in computer science, Engineering, or a related field.
• 10-15 years of experience in data engineering or a related field.
• Extensive experience with Databricks and Apache Spark.
• Proficiency in programming languages such as Python
• Strong knowledge of SQL and experience with relational databases.
• Experience with cloud platforms Especially in Azure
• Strong with data warehousing solutions (e.g., Delta Lake, Lakehouse)
• Understanding of data governance and security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and teamwork skills.
