[Remote] Senior Autonomy Data Engineer

Note: The job is a remote job and is open to candidates in USA. Torc Robotics is a leader in autonomous driving technology, focusing on developing software for automated trucks. They are seeking a Senior Autonomy Data Engineer to design and operate the data infrastructure that supports their autonomy program, ensuring reliable data pipelines and effective collaboration with cross-functional teams.ResponsibilitiesOwn the design and organization of the program’s data lake, including schema definitions, partitioning strategy and metadata indexingDesign and maintain end-to-end pipelines that ingest high-bandwidth sensor logs from vehicles into cloud storage with high reliability and tolerant of ad-hoc and intermittent connectivity mechanismsDevelop data validation and integrity checks that can detect corrupted information, missing sensors, and inconsistent calibration prior to the data being processed by downstream systemsImplement retention, tiering and lifecycle policies for data to balance storage costs with development valueBuild tooling to query raw logs to produce curated training and evaluation datasetsBuild automation to run cost-effective pseudo-labeling workflows at the scale of data ingestImplement data quality and model performance metrics that are used to direct labeling effort toward the highest-value examplesDeploy and maintain data visualization tooling to support log review, annotation QA, and autonomy debugging workflowsBuild integrations between the visualization tooling and the data lake so engineers can navigate from a dataset entry or model failure directly to the origin log dataWork with autonomy engineers to define and surface custom visualization panels and implement metrics for analyzing unstructured operating environmentsBuild dashboards that provide the autonomy engineers visibility into data coverage by terrain type, operating environment and geographic regionEstablish and document data contracts between the data services and model training consumersPartner with perception, planning and embedded engineers across the data lifecyle: from shaping the logging schemas and collection triggers to defining the dataset interfaces that supply model training and evaluationDefine data engineering standards, best practices, and tooling choices for an innovative and fast-paced teamContribute to the data roadmap and provide input to technical leadership on investment prioritiesMentor junior engineers and raise the team’s capabilities in data infrastructure scalability and operational hygieneSkillsBachelor's degree in Computer Science, Computer Engineering, Software Engineering, Electrical Engineering or a related field with 6+ years of data engineering experience or a Master's with 4+ yearsStrong proficiency in Python and SQL, with demonstrated ability to build production-quality data pipelinesDeep experience with cloud data infrastructure (AWS preferred: S3, Glue Athena, redshift, or equivalent) and infrastructure-as-code tools (Terraform, Cloud Formation)Solid understanding of data partitioning strategies and columnar storage formats (Parquet, Orc, etc.)Experience building and operating data pipelines that process time-series and binary dataProven ability to evaluate and integrate open-source tooling when appropriate versus building from scratchStrong instincts for delivering data quality through first-class implementations of monitoring, validation and lineage trackingExperience with autonomous vehicles, robotics, or other sensor-driven autonomous systemsDeep experience with Foxglove or Rerun beyond basic playback, e.g. building custom extensions or integrating them into a structured log review or annotation QA workflowFamiliarity with the MCAP CLI and/or python library and experience converting MCAP data to columnar data formats for further querying and processingExperience with data curation for ML training, e.g. diversity sampling, pseudo-labeling, and dataset versioningBenefitsA competitive compensation package that includes a bonus component and stock options100% paid medical, dental, and vision premiums for full-time employees401K plan with a 6% employer matchFlexibility in schedule and generous paid vacation (available