Job Details

Senior Data Engineer
Location: Alameda, California (Hybrid)
Duration: 06 Months plus
Rate: DOE

US Citizens and Green cards Preferred. No 3rd party corp to corp

Job Description:
We are seeking an experienced Senior DevOps Engineer with a strong background in automating data engineering infrastructure. The ideal candidate will be proficient in orchestrating data workflows, including data ingestion, processing, and pipeline development, utilizing a range of tools like AWS Glue, S3, Redshift, Terraform, and GitHub. This role involves close collaboration with our data engineering and IT teams to ensure efficient, scalable, and reliable data operations.

Key Responsibilities:

• Design, implement, and maintain robust, scalable, and automated data engineering solutions.
• Develop and manage data pipelines using AWS services like Glue, S3, and Redshift.
• Utilize Terraform for infrastructure as code (IaC) to ensure consistent and reliable environment provisioning.
• Maintain and enhance CI/CD pipelines for data engineering applications, ensuring seamless integration and deployment.
• Collaborate with data engineers to understand data needs and implement solutions that meet these requirements.
• Develop scripts and tools in Python to automate various data engineering tasks.
• Manage source control using GitHub, including branching, merging, and version control.
• Ensure data security and compliance with industry standards and company policies.
• Monitor, troubleshoot, and optimize data systems for performance and efficiency.
• Stay updated with the latest trends and technologies in DevOps and data engineering.

• Bachelors or Master's degree in Computer Science, Engineering, or a related field.
• At least 9+ years of experience in a DevOps role with a focus on data engineering infrastructure.
• Strong experience with AWS services, especially Glue, S3, and Redshift.
• Proficient in Terraform for infrastructure automation.
• Extensive experience in Python programming, specifically for data engineering tasks.
• Solid understanding of data pipeline and workflow management tools.
• Expertise in source control management using GitHub.
• Excellent problem-solving skills and ability to work under tight deadlines.
• Strong communication and teamwork skills