Associate Data Engineer

Job title: Associate Data Engineer (Spark)Department: EngineeringReporting to: Engineering ManagerLocation: Canada East (Remote)What you will be doingOwn and improve our big data pipelines in AWS Spark. Assemble large, complex data sets that meet business requirements, with engineering best practices in mind.Build scalable and resilient data infrastructure, as well as tools to extract and transform data used by stakeholders and customers.Work closely with our data scientists and our data engineers in the US East Coast to create and evolve products that measure market dynamics in the Telecommunication space that drive our customers short term marketing campaign tactics and their longer-term customer acquisition and retention strategies. Tech stackSpark, Scala, SQL, Redshift, Athena, S3, Airflow, EMRWe're looking for: 1+ years of experience with building and optimizing big data pipelines in Apache Spark1+ years of experience with ScalaAdvanced with relational SQL databases and SQL1+ years of experience with one of DB: MSSQL, Postgres, AWS Athena (Presto), Redshift1+ years of experience in writing unit testsExperience with AWS cloud services like EC2, S3, EMR or equivalentStrong analytic skills in working with unstructured datasets.Experience in root cause analysis of data when asked to answer specific business questionsExperience working with cross-functional teamsStrong communication and collaboration skillsBachelor’s degreeIt'd be nice to have:Python or Java coding experienceExperience with data pipeline / workflow tools i.e. Apache AirflowExperience in AWS solution architecture Experience in implementing complex clustering and classification models on large datasets to support new product developmentAbout UsOpensignal is the leading global provider of independent insight and data into network experience and market performance. Our user-centric approach allows communication providers to constantly improve their network and maximize commercial performance. Leading analysts, investors and financial institutions place a high value on our independent analysis and we are regular contributors to their reports.Real network experience is our focus and ultimately that’s what influences customer choice. Our mission is to advance connectivity for all and here at Opensignal, the team is leading the industry in enabling operators to link their network experience and market performance in a way that has never before been possible.With offices in London, Boston, and Victoria, British Columbia, we are truly global, with employees working across four continents and representing over 25 nationalities. We are an equal opportunity employer dedicated to building an inclusive and diverse workforce.BenefitsWe believe we are stronger when we not only celebrate our many differences, values, and voices but include them in everyday practice. Having a diverse and inclusive culture is essential, which is why we offer a flexible approach to work-life balance, operating in a remote-hybrid way. We’ll help you get set up with the essentials you need to work from home or the office. We also offer an attractive range of additional benefits, including: Competitive compensation packages including a long-term equity programComprehensive group benefits package and company sponsored retirement savings plan (details depend on your country of work)Professional development opportunities: education reimbursement, learning allowance, company-sponsored workshops, and more!Generous holiday allowance, sick leave, parental leave, flexibility including Flex Fridays, and the opportunity to work from abroadCharity matching and paid time off for community volunteering and DE&I program/committeesRegular virtual and in-person events and socialsOriginally posted on Himalayas

Apply Now