What are the responsibilities and job description for the Data Analyst (two positions) position at NovaGigs?
ID: 072423-da
Posted Date: 07/24/2023
Employer: NovaGigs, Inc.
Title: Data Analyst (two positions)
Employment Type: Full-Time
Job Location: McLean, VA
Posted Date: 07/24/2023
Employer: NovaGigs, Inc.
Title: Data Analyst (two positions)
Employment Type: Full-Time
Job Location: McLean, VA
Job Duties
- Analyze business requirements and translate into feasible and effective technical solution.
- Create data dictionary, solution documents, implementation guides, architecture diagrams and design documents.
- Implement planned and ad-hoc data analysis on raw data to provide insight on data migration, data reconciliation.
- Work on Java/JavaScript code development for projects using Spring framework, based on planned requirements and insight of data analysis.
- Design and develop automation tool using Python with parallel processing to generate data analysis reports, validate data integrity, and preform data visualization.
- Design and refine ETL data access pattern with upstream & downstream applications and enterprise data warehouse and test data flow.
- Migrate on-premises data-intensive application into AWS cloud environment. Convert the SQL into Hive SQL to be compatible with Apache Hadoop ecosystem and achieve the full functionalities.
- Design and implement database management system with AWS Redshift, Apache Hive, AWS Glue catalog.
- Apply big data technologies to implement data validation process with AWS services such as Elastic Map Reduce (EMR), Elastic Container Service (ECS), S3, EC2, RDS, SNS/SQS, Lambda function, Step function, etc. Implement the functions with Spark, PySpark, Scala.
- Develop and maintain scalable data pipelines for the AWS projects to upload files and send requests from on-premises servers to AWS environment.
- Identify measures, indicators of system performance, and the actions needed to improve or correct performance to achieve desired outcome.
- Manipulate, process and extract value from large datasets. Build infrastructures required to process data from a variety of data sources using Structured Query Language and Python.
Qualifications
Master’s degree in Statistics, Business/Data Analytics, Information Systems, Quantitative Finance, Financial Engineering, Economics, Applied Mathematics, or other related quantitative discipline.
Senior Data Analyst
Strategic Data Systems -
Dahlgren, VA