[Remote] Senior Data Engineer

Note: The job is a remote job and is open to candidates in USA. Live Nation Entertainment is the world’s leading live entertainment and eCommerce company, comprised of four market leaders. They are seeking a Senior Data Engineer to design and implement large-scale data systems, optimize data workflows, and leverage AI technologies to improve productivity and enhance pipeline reliability.ResponsibilitiesDesign, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, and SQLOptimize data workflows and SQL/Spark queries for performance, cost efficiency, and reliabilityContribute to the design of our enterprise Data Lake and curated data assetsBuild robust ingestion frameworks, transformation logic, and reusable data engineering componentsSupport data migrations and modernization efforts from legacy systems to cloud-based platformsUse AI coding copilots (Databricks Assistant, GitHub Copilot, SQL copilots) to accelerate development, code review, test creation, and documentationAutomate repetitive tasks (schema evolution, config generation, logging templates, test data creation) with generative AI toolsLeverage AI to auto-detect pipeline anomalies, data drift, quality issues, and performance bottlenecksIncorporate AI-assisted query optimization tools to improve Spark & SQL performanceAbility to learn and utilize LLM-powered tools to generate, refactor, and explain complex SQL, PySpark logic, and pipeline configurationsWork cross-functionally with Product, data consumers to deliver high-quality data solutionsParticipate in Agile ceremonies & contribute to sprint planning & technical design discussionsMentor junior data engineers, promote best practices in AI-assisted data engineeringEnsure strong documentation, standards adoption, & continuous improvement across the teamSkills5–7+ years of hands-on data engineering experienceAdvanced proficiency in Python, SQL, PySpark, and ETL/ELT frameworksStrong experience with Databricks and distributed data processingDemonstrated ability to optimize SQL/Spark workloads for performance and costExperience using AI development tools such as: GitHub Copilot, Databricks Assistant, SQL/IDE AI copilots, AI-based data quality or monitoring toolsSolid understanding of data modeling, governance, and CI/CD for data pipelinesExcellent communication skills and ability to work in a cross-functional environmentExperience working in Agile environments with tools like Jira and ConfluenceBenefitsMedical, Vision and Dental benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs)Generous paid time off policy including paid holidays, sick time and paid days off for your birthdayFree concert tickets401(k) program with company matchStock ProgramNew parent programs & support including caregiver leave and childcare cashInfertility supportTuition reimbursementStudent loan repayment internal growth and development programs & trainingsVolunteer time offCrowdfunding networkCompany OverviewLive Nation Entertainment is a producer, promoter, and seller of live concert tickets for artists and fans. It is a sub-organization of Priority Records. It was founded in 1996, and is headquartered in Beverly Hills, California, USA, with a workforce of 10001+ employees. Its website is https://www.livenationentertainment.com.Company H1B SponsorshipLive Nation Entertainment has a track record of offering H1B sponsorships, with 7 in 2026, 44 in 2025, 23 in 2024, 34 in 2023, 39 in 2022, 39 in 2021, 49 in 2020. Please note that this does not guarantee sponsorship for this specific role.