What are the responsibilities and job description for the Data Lake Engineer with 15+ years exp position at SRS Consulting Inc?
Job Title: Data Lake Engineer
Job Location: Dallas, TX (Hybrid/Locals) (2 – 3 days onsite)
Duration: Long Term up to 4 years
Contract W2
Only Contract W2
Minimum Exp required: 15 years
Overview:
- Client is refactoring how we collect, store, and expose data across the Enterprise using the latest cloud architectures, tools, Devops mindset for quicker feedback loop while leveraging Agile principles.
- Our team is looking to solve these pain points with a Data Lake House solution where we store, govern and provide the right data to the right customer at the right time that will integrate and accel both business and technology analytical users.
- This solution is and will be the foundation of Southwest Airlines for the future using a Cloud based platform that can scale and continuous integrate with tools and concepts to provide exponential value.
Technical Requirements
AWS
- Lake Formation
- S3
- Glue - Crawler, Catalog, Glue Registry, Glue Jobs
- Step Function
- DynamoDB
- IAM
- Lambda
DevOps
- GitLab
Languages
- Python (aws)
- Pyspark
Frameworks
- Serverless
- Stacker
- CloudFormation
- Terraform
Senior Project Manager/Architect
exp -
Dallas, TX
