What are the responsibilities and job description for the Databricks Data Engineer position at Square Peg Technologies?
Clearance Required:
Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph.
Location:
Northern Virginia
The Mission:
Square Peg is seeking a Data Engineer to be responsible for designing, implementing, and maintaining data pipelines for our customers. The Data Engineer will develop automated pipelines for a variety of data types and datasets. Using Databricks, which was named to both the Magic Quadrant for Cloud Database Management Systems and the Magic Quadrant for Data Science and Machine Learning Platforms, you'll using best in class technology to help our customer solve some of their most challenging data problems.
Don't know Databricks, no problem! Sign up for our extensive training program to be a part of shaping the future of AI/ML
Basic Qualifications:
- Proficient with one or more programming languages (Python, SQL, Java)
- Prepare big data, implement data models and develop database to support the business solutions
- Understanding of SQL database structures and mapping data structures between different SQL databases
- Knowledge of API development techniques
- Demonstrated experience in data engineering, data processing and modeling techniques using cloud-based data management, data science, and ML platforms such as Databricks, Splunk, Cloudera, and Snowflake.
- Demonstrated experience with cloud based database services such as Databricks and AWS
Preferred Qualifications
- Experience with using Apache Spark and Hadoop to conduct large-scale data processing
- Extensive experience in Extract-Transform-Load (ETL) processes
- Demonstrated extensive experience with cloud services (AWS strongly preferred)
- Familiarity with open source data engineering tools and processes
Square Peg Technologies Company Information
Square Peg Technologies is a boutique technology consulting firm that specializes in data solutions using the latest technologies in analytics, data science, data engineering and data management. Our mission is to develop and integrate cutting edge technology solutions that inspire our customers to push the fields of science and technology forward. Here at Square Peg, you will not get lost in a crowd. We value each person’s contribution, celebrate wins together and invest in the personal and professional development of our employees. Along with a strong positive culture that allows employees to thrive and grow, we also offer top notch benefits to include a large amount of vacation, annual bonuses, 401k matching, paid training, and 100% health care coverage.
At Square Peg Tech, we aim to be at the forefront of technology and innovation. Our ideal candidate must be forward leaning and eager to engage with customers, academia and industry leaders on the future applications of AI/ML, as well as best practices in advanced analytics. With a firm footprint in the Intelligence Community, Square Peg Tech is looking to expand its capabilities into the Department of Defense, NASA and other prominent government agencies.
