What are the responsibilities and job description for the Data Engineer (TS/SCI + Poly) position at The DarkStar Group, LLC?
Description
The DarkStar Group is seeking a Data Engineer with a TS/SCI Poly clearance (applicable to this customer) to join one of our top projects in Chantilly, VA. Below is an overview of the project, as well as information on our company, our benefits, and our $25,000 referral program.
THE PROJECT
The DarkStar Group's team provides tactical data engineering solutions. We embed skilled Data Engineers, Data Scientists, and ETL Developers directly into intelligence analyst groups to be their go-to data wranglers. We develop new tools, code, and services to execute data engineering activities. Our engineers work to collect, process, and feed analytic tools, turning data into intelligence in response to immediate mission needs, with direct impact on real world situations. You will see your work used here on a daily basis, and you'll have the opportunity to support a variety of Sponsor mission organizations and mission partner organizations.
This is a time of development and growth on the program, with an increasing number of missions being supported. The work is high impact and important, and the customer moves quickly. The environment is fast-paced, flexible, and open to innovation - you'll have more latitude here in choosing how to achieve results than on many other projects. The customer cares more about what you can do as opposed to your years of experience, and work hours are typically quite flexible - roll up your sleeves, get things done, and no one cares much about the specific hours that you work. The work space itself is also quite nice, and there is an excellent cafeteria!
The tech stack on this team is rather huge and includes Python (Pandas, numpy, scipy, scikit-learn, standard libraries, etc.), Python packages that wrap Machine Learning (packages for NLP, Object Detection, etc.), Linux, AWS/C2S, Apache NiFi, Spark, pySpark, Hadoop, Kafka, ElasticSearch, Solr, Kibana, neo4J, MariaDB, Postgres, Docker, Puppet, and many others.
Work on this program takes place in Chantilly, VA, McLean, VA and in various field offices throughout Northern VA (we cannot support remote work) and requires a TS/SCI Polygraph clearance (acceptable to this customer).
THE ROLE
The Contractor shall develop new tools, code, and services to execute data engineering activities on Sponsor provided systems. Data engineering activities for each Sponsor mission organization and/or mission partner organization shall include the following tasks:
- Movement of structure and unstructured data (gigabyte to terabyte range) using Sponsor approved methods
- Execute data ingestion activities for storing data in a local or enterprise level (Integrated Data Layer) location
- View data in its source format
- Develop code to format data that facilitates exploration
- Analyze source data formats and work with Data Scientists and Mission Partners to determine the formats and transforms that best meet mission objectives
- Develop code and tools to provide one-time and on-going data formatting and transformations into enterprise or boutique data models
- Implement existing ETL code and best practices/standards that are currently in use in the enterprise
- Develop an ETL Code Transition Plan when the Sponsor identifies a specific project. Projects will be identified periodically. The draft is due after 30 days of notification from the Sponsor. The plan should include details on how the code can be integrated into the enterprise ETL service portfolio. The final plan is due 30 days after receiving comments from the Sponsor
- Develop and deliver Software Documentation for each code project that includes ETL mappings, code use guide, code location (generally GitHub) and access instructions), and anomalies encountered.
- Facilitate Code Reviews twice a year for each Sponsor mission organization or mission partner organization and one for each project. Code Reviews shall identify bugs and areas for code improvement to ensure high quality software. Contractor shall document results.
- The Contractor shall provide consulting services to the Mission Partner to support mission needs for data transport, ingestion, conditioning, access, and management.
- The Contractor shall support code review with the Sponsor up to two times a year.
Required Skills
- AWS (Intermediate)
- Linux (Intermediate)
- Python (Intermediate)
- SQL (Intermediate)
- HTTP API Usage/Integration (Intermediate)
- Experience analyzing diverse file types (text, image, video, audio, and binary) (Basic)
- Experience with geospatial tools/data (Basic)
- Docker (Intermediate)
- Puppet (Intermediate)
- Solr (Basic)
- Postgres Admin(Basic)
- MariaDB Admin (Basic)
- Hadoop/Spark (Intermediate)
- ElasticSearch (Intermediate)
- Kibana (Basic)
- Kafka (Beginner)
- NiFi (Intermediate)
About The DarkStar Group
Our Company
The DarkStar Group is a small business that solves BIG problems. We're one of the Inc. 5000 fastest-growing private companies in the US, and our engineers and scientists support the most critical national security missions in Virginia, Maryland, and elsewhere. Data Science, Software Engineering, Cloud/AWS Infrastructure, and Cyber/CNO are our core areas of expertise. We offer interesting and important work, job security, some of the best and most flexible benefits you'll find in the IC, and salaries so strong that they'll likely surprise you.
Our Benefits
The DarkStar Group offers exceptional compensation and benefits:
- very strong salaries;
- 100% company-paid medical, dental, and vision premiums for you and all dependents;
- the ability to get increased salary if you don't need medical/dental/vision;
- 100% company-paid disability and life insurance benefits;
- a generously-funded HSA;
- an 8% 401(k) contribution;
- 31 days of PTO/holidays to start (more with tenure);
- the ability to flex time across pay periods without using your PTO;
- a generous training budget;
- $25,000 employee referral bonuses;
- business development / growth incentives; and
- top notch company swag.
** We have a huge growth opportunity, so we are offering up to a $25,000 reward for anyone new you refer whom we hire. **
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Salary : $25,000