[Remote] Senior Data Engineer, SME

Note: The job is a remote job and is open to candidates in USA. Diverse Lynx is a company seeking a Senior Data Engineer, SME to join their Cloud Data Engineering team. The role involves using technical knowledge to solve business problems, evaluating technology effectiveness, and migrating existing data platforms to the cloud while developing new data pipelines.ResponsibilitiesAs a Senior Engineer, you will be responsible for using your technical knowledge to solve business problemsWe are looking for a talented individual that can serve as a subject matter expert in their area of focus and represent their department on complex assignmentsYou will be responsible for evaluating elements of technologies effectiveness through requirements gathering, testing, research and investigation and make recommendations for improvements that result in increased quality and effectivenessYou will be required to listen to and evaluate customer needs to determine and provide high quality solutions that align with customer expectationsIn this role on the Cloud Data Engineering team, you will be a part of a team responsible for migrating existing data platform solutions to the cloudYou will also collaborate with others to develop new data pipelinesAs a data engineer in the Cloud Data Engineering team, you will need to work in a data first mindsetYou will use Microsoft Azure Cloud PaaS technologies to engineer our data solutions in a way that allows for us to optimize our information, make better decisions, and meet our customer’s needsSkills10+ years experienceExperience with Databricks batch processing/data lake design experience3+ yrs hands on expertise in Databricks to design, build, and optimize high throughput batch data pipelines3+ yrs hands-on expertise in Databricks lakehouse architectures on cloud platforms (Azure/AWS)Experience with Microsoft Azure platform technologies like Databricks applications, Event Hub, Data Factory, Scala, Synapse Analytics, Delta Lake, Cosmos DB, or DevOpsMust have good troubleshooting and problem-solving skills, including debugging multi-threaded applicationsExperience with configuration management and build automation capabilities such as Git/JenkinsMust have good oral and written communication skills to effectively communicate with various IT teams and business representativesMust be able to both collaborate in a team-oriented environment and work independently with directionEducation: BachelorsExperience with Big Data solutions and no SQL DBMSsExperience with Azure, AWS, or other Public Cloud environmentsPrior experience leading large-scale projectsKnowledge and working experience with Agile methodologiesCompany OverviewDiverse Lynx is a WBENC- and NMSDC-certified partner, helping organizations turn diversity goals into measurable impact through staffing and contingent workforce solutions. It was founded in 2002, and is headquartered in Princeton, New Jersey, US, with a workforce of 1001-5000 employees. Its website is http://www.diverselynx.com.