What are the responsibilities and job description for the Python Architect position at Gandiva Insights LLC?
Role: Python Architect (development)
Location: San Diego, CA (Hybrid)
· Primary Skills: Python, Pyspark, Pytest
· Secondary Skills: AWS, MongoDB, Kafka, RabbitMQ
JD:
· Experience in data architecture, cloud infrastructure, and automation.
· Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud, with deep expertise in services such as AWS Lambda, S3, RDS, EMR, Azure Data Factory, Databricks, etc.
· Hands-on experience in Python, PySpark, PyTest, Docker.
· Strong knowledge in Kafka and MongoDB.
· Strong knowledge of infrastructure-as-code (IaC) tools such as Terraform, CloudFormation, or Ansible.
· Proven expertise in automating data pipelines using tools like Apache Airflow, Jenkins, or similar CI/CD tools.
· Proficiency in scripting and programming languages (e.g., Python, Bash, Java).
· Experience with big data technologies such as Hadoop, Spark, or Kafka.
Strong knowledge of DevOps methodologies and containerization tools (e.g., Docker, Kubernetes).