[Remote] Data Engineer II
Note: The job is a remote job and is open to candidates in USA. NPS Prism is a market-leading, cloud-based CX benchmarking and operational improvement platform owned by Bain & Company. We are seeking a highly skilled and experienced Data Engineer to design and implement robust data solutions for scalable business needs, utilizing cloud platforms and big data technologies.ResponsibilitiesDesign, build, and optimize ETL/ELT workflows using tools like Databricks, SQL, Python/pyspark & Alteryx (Good to have)Develop and maintain robust, scalable, and efficient data pipelines for processing large datasets. from source to emerging dataWork on cloud platforms (Azure, AWS) to build and manage data lakes, data warehouses, and scalable data architecturesUtilize cloud services like Azure Data Factory, AWS Glue, or for data processing and orchestrationUse Databricks for big data processing, analytics, and real-time data processingLeverage Apache Spark for distributed computing and handling complex data transformationsCreate and manage SQL-based data solutions, ensuring high availability, scalability, and performanceDevelop and enforce data quality checks and validation mechanismsCollaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to deliver impactful data solutionsUnderstand business requirements and translate them into technical solutionsLeverage CI/CD pipelines to streamline development, testing, and deployment of data engineering workflowsWork with DevOps tools like Git, Jenkins, or Azure DevOps for version control and automationMaintain clear documentation for data workflows, pipelines, and processesOptimize data systems for performance, scalability, and cost-efficiencySkillsBachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field3–6 years of experience in Data Engineering or related rolesHands-on experience with big data processing frameworks, data lakes, and cloud-native servicesProficiency in Python, SQL, and PySpark for data processing and manipulationProven experience in Databricks and Apache SparkExpertise in working with cloud platforms like Azure, AWSSound knowledge of ETL processes and tools like AlteryxLeveraging data lakes, data warehouses, and data pipelinesBuild a Data Pipeline from scratchStrong understanding of distributed systems and big data technologiesBasic understanding of DevOps principles and familiarity with CI/CD pipelinesHands-on experience with tools like Git, Jenkins, or Azure DevOpsStrong problem-solving skills and a knack for optimizing data solutionsExcellent communication (oral and written) skillsFamiliarity with data visualization tools like Power BI, Tableau, or similarKnowledge of streaming technologies such as Kafka or Event HubsCompany OverviewNPS Prism offers a SaaS CX benchmarking platform that delivers Net Promoter Score and KPI insights on customer journeys across industries. It was founded in 2019, and is headquartered in Boston, Massachusetts, US, with a workforce of 201-500 employees. Its website is https://www.npsprism.com.Company H1B SponsorshipNPS Prism has a track record of offering H1B sponsorships, with 1 in 2025. Please note that this does not guarantee sponsorship for this specific role.