Data Engineer

Candidates MUST be authorized to work without sponsorship

• Candidate must be able to work EST hours from day 1* Remote

We are seeking a highly skilled Senior Data/Software Engineer with expertise in CI/CD pipelines, automation, and full-stack development to drive a high-priority project. This role involves building and testing code through CI/CD pipelines in AWS, managing test case definition, and storing data in a Datalake. The role is critical in meeting tight deadlines, with a focus on delivering product readiness by mid-October and full results by the end of October. Top Requirements: JAMA, BAZEL, Step Functions, Python and AWSKey Responsibilities

• CI/CD Development: Build and manage CI/CD pipelines using Jenkins and Bazel for continuous integration and testing.
• Test Case Management: Define test cases with strict adherence to requirements and ensure documentation is stored in Jama.
• Scripting & Automation: Perform heavy scripting and automation tasks to streamline processes.
• Datalake Management: Store and manage CI test results in a Datalake accessible through APIs.
• AWS Infrastructure: Utilize AWS services, including EC2 and Terraform, to build, maintain, and automate the infrastructure.
• API Integration: Drive extensive API integration work for seamless data access and functionality.
• Simulation Testing: Conduct sensor simulation tests and provide detailed reports on status and results.
• Leadership & Oversight: Assign and manage contractors to ensure smooth project execution, track progress, and address any technical questions or concerns.

Skills & Experience Required

• Strong background in CI/CD pipeline development using Jenkins and Basil.
• Experience with AWS services (EC2, Datalake, Terraform).
• Proficient in scripting and automation with hands-on experience in API integration
• Ability to manage test case creation and reporting in Jama.
• Experience with full-stack development, with a focus on automation.
• Strong problem-solving and project management skills to meet tight deadlines.
• Excellent communication and leadership skills, with the ability to manage and mentor contractors.

Preferred Qualifications

• Prior experience in sensor simulation testing and familiarity with testing frameworks
• Experience with Bazel for build and testing frameworks.
• Strong organizational skills to ensure all timelines are met.

System Description!!! Product Readiness Report Overview

• Objective:
• Build and test code through CI/CD pipelines.
• Store results in the datalake, accessible via API.
• Define and execute test cases with strict adherence to requirements recorded in Jama.
• Technologies & Tools:
• CI/CD: Jenkins pipelines in AWS.
• Build & Testing Frameworks: Bazel.
• Infrastructure: Terraform, EC2.
• Data Storage: Datalake with API integration.
• Scripting & Automation: Heavy emphasis on scripting and automation.
• Full-Stack Skills: Required, though front-end specifics are uncertain.
• Responsibilities:
• Create and store CI test results in the datalake.
• Drill down into test results to assess basic status and specifics around sensor test simulations.
• Manage tight deadlines:
• Mid-October for initial results.
• End of October for final results.
• Team Structure:
• Senior engineer assigned to manage contractors.
• Drive production, track progress, and address questions.
• Project Duration:
• 3 months.
• Start Date:
• Immediate start required to meet deadlines.

Skills: full-stack development,communication,ci,ec2,bazel,test case management,api integration,problem-solving,datalake management,automation,jenkins,project management,data,terraform,leadership,aws services,scripting,ci/cd pipeline development,integration