[Remote] Data Engineer III

Note: The job is a remote job and is open to candidates in USA. Robert Half, one of FORTUNE’s World’s Most Admired Companies, is hiring for a Data Engineer III to join the ATI Data Science Innovation department. The role involves leading the architecture and design of complex data pipelines, optimizing data infrastructure, and implementing data quality strategies to support AI/ML capabilities.ResponsibilitiesLead architecture and design of complex data pipelines on Databricks lakehouse architecture (Unity Catalog, Delta Lake, Structured Streaming)Define technical approach for data engineering initiatives, mentor less-senior engineers, and set standards for code quality through leadership and code reviewsDesign and build data foundations that enable AI/ML capabilities — feature stores, embedding pipelines, vector search indexes, and model training datasetsAlign data engineering solutions with business strategy, including support for Agentic AI workloadsOwn health, scalability, and modernization of data infrastructure with Databricks as the strategic platform — including workload migration, compute optimization, and Unity Catalog adoptionOptimize pipeline performance (Delta Lake table layouts, clustering, Z-ordering) and establish monitoring/alerting best practices with clear SLAsBuild data infrastructure supporting Agentic AI systems — real-time data access layers, context retrieval pipelines, and agent-accessible data servicesCollaborate cross-functionally with DevOps, Platform Engineering, and MLOps roles to integrate data solutions into the broader technology environment and shared AI infrastructure – Mlflow registries, feature stores, and agent orchestration layersProvide consultation to Senior Leadership on complex projects and drive continuous improvement initiativesChampion data governance at all layers for data, models, and AI assetsImplement data quality strategies (master data management, validation rules, Delta Live Tables expectations) to ensure trust in enterprise dataServe as liaison across data engineering, AI engineering, and business teams; promote data literacy and stewardshipSkillsBachelor's in Computer Science, Engineering, or related field (Master's preferred)5+ years with Python and SQL in data engineering for big data ML/analytics workloads5+ years designing, building, and troubleshooting scalable ETL/ELT pipelines for business-critical production systems3+ years with cloud data services (AWS), container orchestration (Docker, Kubernetes), and IaC (Terraform, CloudFormation)3+ years architecting ML workflows and data platforms with CI/CD, automated testing, and distributed processing (Spark)3+ years collaborating cross-functionally with Data Science, MLOps, Platform Engineering, and DevOps teams3+ years implementing data quality testing and optimizing SQL/Python for cost/performance in the cloudUnderstanding of the full Data Science SDLC, and experience mentoring engineers2+ years hands-on with Databricks (Delta Lake, Unity Catalog, Databricks SQL)Experience with MLflow experiment tracking and model registry workflowsExperience designing pipelines that serve AI/ML inference — real-time feature engineering, embedding generation, and context retrieval for LLM-based systemsUnderstanding of how data engineering supports Agentic AI: agent-accessible data services, low-latency retrieval, and pipelines enabling autonomous multi-step workflowsFamiliarity with Databricks Mosaic AI, Vector Search, and/or Feature StoreFinOps awareness — compute cluster optimization, cost attribution by workloadFamiliarity with Salesforce/Heroku data infrastructuresExperience with data virtualization (e.g., Dremio)Understanding of Platform Engineering concepts and internal developer platformsExperience migrating from legacy data warehouse/lake to unified lakehouse architectureFamiliarity with Odaseva data security and managementBenefitsDiscretionary annual bonusGroup health insurance benefits (medical, vision, dental)FSA and HSA healthcare accountsLife and accident insuranceAdoption and fertility assistancePaid parental leave of up to 6 weeksShort/long term disabilityPaid time off for vacation, personal needs, and sick timeChoice Time Off (CTO) our people receive varies based on their years of service and is pro-rated based on the hours worked per weekA new hire earns up to 17 days of CTO per calendar yearUp to 11 paid holidays per calendar yearOpportunity to contribute to our company 401(k) savings and investment plan or deferred compensation plan (if eligible), with an employer match of 100% on the first 3% of your contributions for eligible employeesCompany OverviewRobert Half provides staffing, recruiting, finance, and accounting services. It was founded in 1948, and is headquartered in Frankfurt, Hessen, DEU, with a workforce of 10001+ employees. Its website is https://www.roberthalf.de.Company H1B SponsorshipRobert Half has a track record of offering H1B sponsorships, with 1 in 2024, 31 in 2023, 32 in 2022, 18 in 2021, 22 in 2020. Please note that this does not guarantee sponsorship for this specific role.