[Remote] Senior Lead Data Engineer, Content Engineering

Note: The job is a remote job and is open to candidates in USA. Paramount is on a mission to unleash the power of content, and they are seeking a Senior Lead Data Engineer to build and scale the data foundations for their personalization systems. This role involves designing and operating data pipelines, ensuring data quality, and collaborating with various teams to support machine learning initiatives.ResponsibilitiesBuild & Operate Large-Scale Feature Pipelines: Design and maintain batch/streaming pipelines (Spark, Flink, Databricks, Airflow) producing ML features for ranking modelsEnsure Point-in-Time Correctness: Develop feature sets that enable unbiased offline training and credible online inferenceDevelop Embedding & Content Pipelines: Build scalable workflows for metadata, imagery, and multimodal representations; partner with Science teams to operationalize new modelsArchitect Data Foundations: Design Delta/Parquet data models and medallion layers, optimizing storage layout and partitioning for latency and costReal-Time Engineering: Build Kafka-based systems for real-time features and user-activity aggregations, ensuring robust handling of out-of-order events and exactly-once semanticsGovernance & Leadership: Define data quality rules and schema evolution processes while collaborating across ML pods to translate model needs into infrastructureSkills7+ years of experience in large-scale data or software engineeringDeep experience with Spark (PySpark/Scala), Databricks, Airflow, and KafkaProficiency in feature pipelines, temporal joins, and mitigating training-serving skewExperience with AWS/Azure/GCP and high-performance engines like Snowflake or RedshiftProficient programming skills in Python and SQL with a focus on performance optimizationExperience in personalization domains (search, ranking, or recommender systems)Experience supporting petabyte-scale data lakehouses or feature storesFamiliarity with GenAI/RAG systems, multimodal content, or Delta Live TablesKnowledge of Causal Inference, experimentation signals, or ML evaluation workflowsExperience with Terraform for governed, repeatable deploymentsBenefitsMedicalDentalVision401(k) planLife insurance coverageDisability benefitsTuition assistance programPTOThis position is bonus eligible.Generous paid time off.Opportunities for both on-site and virtual engagement events.Unique opportunities to make meaningful connections and build a vibrant community, both inside and outside the workplace.Company OverviewParamount is a leading media and entertainment company that creates premium content and experiences for audiences worldwide. It was founded in 1914, and is headquartered in New York, New York, USA, with a workforce of 10001+ employees. Its website is https://www.paramount.com.Company H1B SponsorshipParamount has a track record of offering H1B sponsorships, with 2 in 2024. Please note that this does not guarantee sponsorship for this specific role.