company

Senior Data Engineer

Spear AIUnited States / Remote
Remote Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

A Bachelor's Degree in Computer Science, Engineering, or a related field is preferred. Candidates should possess significant experience in data engineering, including the implementation of data pipelines and data warehousing solutions. Proficiency in programming languages such as Python or Java, along with familiarity with tools like Postgres, Apache Iceberg, and CI/CD processes, is essential.

About the job

Spear AI is on the lookout for an experienced Data Engineer to join our team as we develop a pioneering data management and AI platform focused on maritime domain awareness. As a growing defense contractor, we pride ourselves on delivering innovative solutions that bolster national security. Our organizational culture promotes a flat structure, allowing every team member to have a significant impact, collaborate closely with leadership, and engage in meaningful projects across our Hardware, Software, or Services divisions. You will work alongside a talented group of professionals dedicated to excellence and enhancing the capabilities that safeguard our nation.

At Spear AI, we specialize in the creation of sonobuoy sensors that gather edge data from aquatic environments, and we collaborate with the U. S. Navy to process their SONAR data. In this role, you will have the opportunity to contribute to real-world projects that directly influence the capabilities of warfighters and the success of their missions.

Key Responsibilities

As a member of our dynamic team, you will take on a variety of responsibilities, including:

  • Developing real-time data pipelines utilizing MQTT and Redpanda for effective stream processing.

  • Creating offline data pipelines with Dagster for batch processing.

  • Parsing and processing binary message formats from diverse data sources.

  • Building robust data warehouses using Postgres, Apache Iceberg, Parquet, and S3.

  • Designing data models that facilitate high-performance querying.

  • Validating and normalizing various data sources.

  • Enhancing local development and CI/CD processes using contemporary tools and GitHub Actions.

Your Profile

We are looking for a candidate with a strong foundation in Software Engineering who embodies our core values:

  • Detail-oriented with a passion for code quality; you ensure your code is well-structured, formatted, and thoroughly tested.

  • Committed to correctness; you take pride in building reliable libraries and services that users can trust.

  • Performance-focused; you continually strive to optimize query speeds and overall system efficiency.

  • Inquisitive and proactive; you enjoy delving into the intricacies of systems, developing prototypes, and conducting experiments to deepen your understanding.

About Spear AI

Spear AI is an innovative defense contractor focused on developing advanced technologies that enhance maritime security. Our commitment to fostering a culture of collaboration and innovation sets us apart as we strive to deliver exceptional solutions for our nation's safety.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.