[Remote] Lead Data Engineer
Note: The job is a remote job and is open to candidates in USA. 3M is a global company that values innovation and collaboration among its employees. They are seeking a Lead Data Engineer who will design, develop, and optimize data platforms to support advanced analytics and machine learning applications across the organization.ResponsibilitiesLead the architecture and development of scalable, secure data pipelines supporting AI/ML workloadsOwn end to end data engineering processes: ingestion, transformation, storage, quality, and monitoringCollaborate with data scientists and ML engineers on model features, training pipelines, and deploymentDrive best practices in data modeling, orchestration, versioning, and performance optimizationMentor and guide junior engineers; contribute to technical roadmaps and solution patternsEnsure data governance, lineage, and compliance standards are met across platformsSupport real time and batch processing frameworks in production environmentsSkillsBachelor's degree or higher in computer science (completed and verified prior to start) from an accredited institutionSeven (7) or more years of data engineering experience, including leading technical initiativesStrong expertise in Python, SQL, and distributed data systems (e.g., Spark, Databricks, Synapse)Experience building AI/ML ready data pipelines, including feature stores and model training data flowsHands on experience with cloud platforms (Azure preferred — Data Lake, Data Factory, Databricks, Cosmos DB)Strong understanding of ML concepts, lifecycle, and MLOps practicesProven experience with workflow orchestration (Airflow, Data Factory, Synapse Pipelines, etc.)Strong communication and ability to translate business needs into technical solutionsExperience with streaming platforms (Kafka, Event Hub)Familiarity with vector databases, embeddings, or LLM oriented data pipelinesBackground in DevOps, CI/CD, or infrastructure as codeExperience designing data solutions for AI applications or intelligent platformsBenefitsMedical, Dental & VisionHealth Savings AccountsHealth Care & Dependent Care Flexible Spending AccountsDisability BenefitsLife InsuranceVoluntary BenefitsPaid Absences and Retirement BenefitsCompany Overview3M touches virtually every part of your life. Our people and technology make the impossible, possible. It was founded in 1997, and is headquartered in Astwick, Bedfordshire, GBR, with a workforce of 10001+ employees. Its website is https://www.kciuk.co.uk/.