companyUnity Technologies logo

Senior Data Engineer at Unity | San Francisco

Unity TechnologiesSan Francisco, CA, USA
On-site Full-time $172K/yr - $215K/yr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Key ResponsibilitiesDesign and implement near real-time data pipelines and reporting infrastructure. Architect distributed stream and batch processing systems utilizing technologies such as Apache Flink, Spark, and Airflow. Develop and maintain data processing frameworks capable of handling large-scale event ingestion and transformations with strong correctness guarantees. Ensure production-grade reliability, observability, and operability across distributed systems. Define and enforce data processing semantics including:Exactly-once processingEvent time vs. processing time handlingStateful stream managementBackpressure and fault tolerance strategiesCollaborate cross-functionally with data consumers, product, and infrastructure teams to define scalable reporting solutions. Contribute to long-term platform architecture, setting engineering standards for performance, resilience, and maintainability. QualificationsSolid foundation in distributed systems and systems design. Hands-on experience in building and operating large-scale data processing systems. In-depth understanding of streaming concepts, including:Exactly-once semanticsWatermarking and event-time processingStateful stream processingCheckpointing and recoveryBackpressure handlingProduction experience with frameworks such as Apache Flink, Spark, Kafka, or similar technologies. Proficiency in programming languages such as Python, Java, or Scala. Experience with workflow orchestration tools (e.g., Airflow) for coordinating stream and batch processes. Strong understanding of cloud-native architectures and distributed infrastructure (Kubernetes, containerization, etc.).

About the job

Join Our Team
At Unity Technologies, we are on a mission to create a powerful, near real-time reporting platform that is essential for analytics and decision-making across our expansive ecosystem. We are in search of a talented Data Engineer who will play a pivotal role in architecting and implementing distributed data systems that enable this platform to operate at scale.

In this dynamic role, you will design and construct high-throughput, low-latency data processing pipelines that support reporting functionalities for both internal teams and external clients. You will work at the forefront of distributed systems, stream processing, and cloud-native infrastructure, ensuring the reliability, correctness, and scalability necessary for a high-volume production setting.

This is an impactful position where your engineering excellence, architectural vision, and ownership of production will be highly valued.

About Unity Technologies

Unity Technologies is a leading platform for creating and operating interactive, real-time 3D content. Our robust platform empowers creators with powerful tools to build, deploy, and monetize their content across multiple platforms.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.