Lead Big Data Engineer - PySpark

As a Lead Developer joining our Advanced Analytics practice, you'll be responsible for delivering client value and ensuring high client satisfaction. You'll be expected to be adept at recognizing, subscribing, and applying best practices, methodologies, tools, and techniques to meet client requirements, timelines, and budgets. Role Responsibilities • Perform data assessment, analysis, and data model design. • Develop CI/CD pipelines and other DataOps fundamentals. • Communicate at the appropriate level to both business and technology teams to understand business needs and pain points. • Be creative in meeting the client’s core needs with their technology. • Explain technical benefits and deficits to non-technical audiences. About the Team The Logic20/20 Advanced Analytics team is where skilled professionals in data engineering, data science, and visual analytics join forces to build simple solutions for complex data problems. We make it look like magic, but for us, it’s all in a day’s work. As part of our team, you’ll collaborate on projects that help clients spin their data into a high-performance asset, all while enjoying the company of kindred spirits who are as committed to your success as you are. And when you’re ready to level up in your career, you’ll have access to the training, the project opportunities, and the mentorship to get you where you want to go. “We build an environment where we really operate as one team, building up each other’s careers and capabilities.” – Adam Cornille, Senior Director, Advanced Analytics • 5-10+ years of data engineering experience using Python and Spark (PySpark). • 2+ years of experience leading the design and development of cloud ETL and data pipelines. • Experience working with fast streaming data. • Experience with Flink, Kafka, and Kubernetes. • Experience developing CI/CD pipelines. • Experience with Big Data Technologies (Hadoop, Spark/PySpark, MongoDB). • Experience working with Azure, AWS, and/or GCP. • Demonstrated ability to identify business and technical impacts of user requirements and incorporate them into the project schedule. • Ability to travel at least once per quarter. Preferred Qualifications • Extensive experience working with Palantir Foundry. • Java experience is highly preferred. • Consulting experience and/or experience working within the Utilities industry is highly preferred. At Logic20/20, we believe in recognizing and rewarding exceptional talent. Logic20/20 offers a competitive compensation package, with a target base salary range of $156,750 - $173,329 for this role. The final base salary offered is dependent on factors such as relevant experience, skills, qualifications, and location. Eligible employees may also qualify for performance-based bonuses and other incentives. All your information will be kept confidential according to EEO guidelines. Learn more about life at Logic20/20! Visit our Life at Logic page to explore our culture, benefits, and what makes Logic20/20 a great place to grow your career! Core Values At Logic20/20, we are guided by three core values: Drive toward Excellence, Act with Integrity & Foster a Culture of We. These values were generated and agreed upon by our employees—and they help us pursue our goal of being one of the best companies to work for and to work with. Learn more at Equal Opportunity Statement We believe that people should be celebrated: for their talents, ideas, and skills, but most of all, for what makes them unique. We prohibit harassment and/or discrimination based on age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status, or any other basis as protected by federal, state, or local law. To learn more about our DE&I initiatives, please visit: Privacy Policy During the recruitment and hiring process, we gather, process, and store some of your personal data. We consider data privacy a priority. For further information, please view our company privacy policy. Apply tot his job