[Remote] Senior Data Engineer

Note: The job is a remote job and is open to candidates in USA. Tredence Inc. is seeking a Senior Data Engineer to manage end-to-end delivery of data solutions. The role involves developing data pipeline architecture, optimizing data processes, and ensuring data quality while collaborating with cross-functional teams.ResponsibilitiesManage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholdersFollow the Agile development methodology; think strategically and execute methodicallyDevelop and manage capacity and growth projection forecasts of the environment within budgetsCreate and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirementsDrive optimization, testing and tooling to improve quality of solutionsManage teams that build and operate high volume distributed systems in a SaaS environmentGreat at devising efficient processes that increase velocity and qualityUnderstanding business use cases and deriving codes as per requirementsPromote the data discovery, availability and quality capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goalsAccountable for operational effectiveness in performance, uptime, release management of the enterprise data platformResponsible for creating and validating end-to-end scalable data pipeline templatesResponsible on the migrating the streaming data from the S3 to Databricks layers (raw, processed, consumption) and applying required data quality checks and transformationsHandle slowly changing dimensions, change data capture, dimensions, facts and manage upsetsResponsible for handling adhoc data analysis requestsResponsible for handling client communicationResponsible for the data accuracy, data governance, file handling, error handling, data validationSkillsMaster's degree (or foreign equivalent) in Business Analytics, Information Systems, Data Science, or a related fieldOne (1) year of experience in the job offered or a related positionDemonstrable knowledge of Data Engineering PipelinesDemonstrable knowledge of Data WarehousingDemonstrable knowledge of Data ModelingDemonstrable knowledge of SQLDemonstrable knowledge of Cloud Technology (Google Cloud)Demonstrable knowledge of Data WranglingDemonstrable knowledge of Data AnalysisAbility to travel to unanticipated client locations throughout the U.S., approximately 30%, as requiredCompany OverviewTredence is a global data science solutions provider focused on solving the last mile problem in AI. It was founded in 2013, and is headquartered in San Jose, California, USA, with a workforce of 1001-5000 employees. Its website is http://tredence.com.