What are the responsibilities and job description for the Scala Data Engineer / Scala Developer position at Pyramid Technology Solutions?
Job Title: Scala Data Engineer / Scala Developer
Location:- McLean, VA
Duration:- 12 Months
Job Description:
Collaborate with cross-functional Agile teams to design, develop, test, implement, and support scalable data solutions using Scala in distributed environments.
Build and maintain high-performance, fault-tolerant data pipelines using Scala-based frameworks such as Apache Spark, Kafka, and related Big Data technologies.
Develop backend services and data processing applications using Scala, with exposure to Java where required.
Work closely with teams experienced in distributed microservices, real-time data processing, and large-scale data platforms.
Design and optimize data storage and retrieval using NoSQL databases (MongoDB, Cassandra) and open-source RDBMS.
Implement and manage cloud-based data solutions leveraging platforms such as AWS, Azure, or Google Cloud, including data warehousing technologies like Redshift and Snowflake.
Participate in code reviews, unit testing, performance tuning, and production support to ensure high code quality and system reliability.
Collaborate with product managers and stakeholders to deliver robust, scalable, cloud-native data solutions that support enterprise analytics and real-time use cases.
Stay current with emerging Scala, Big Data, and streaming technologies, and contribute to internal knowledge sharing and mentoring.
Basic Qualifications:
Bachelor’s degree in Computer Science, Engineering, or related field.
4 years of experience in application or data engineering, with strong hands-on development.
2 years of hands-on experience with Scala in production environments.
2 years of experience working with Big Data technologies such as Spark, Kafka, or distributed data platforms.
1 year of experience with cloud platforms (AWS, Microsoft Azure, or Google Cloud).
Preferred Qualifications:
7 years of overall software or data engineering experience, with a strong focus on Scala development.
4 years of experience building distributed systems using Scala and Spark.
4 years of experience with streaming and real-time data processing using Kafka or similar technologies.
4 years of experience with NoSQL databases (MongoDB, Cassandra).
4 years of experience with data warehousing solutions such as Redshift or Snowflake.
4 years of experience working in cloud environments (AWS, Azure, or GCP).
Strong experience with UNIX/Linux environments, including shell scripting and system troubleshooting.
2 years of experience working in Agile/Scrum engineering teams.