Experienced Lead Data Engineer for Innovative Information Solutions – Full-Time Opportunity with arenaflex in San Francisco, USA

Introduction to arenaflex and the Industry arenaflex is a leading organization in the private sector, dedicated to providing innovative solutions and exceptional services to its clients and partners. As a key player in the industry, arenaflex recognizes the importance of data in driving business decisions, improving customer experiences, and fostering growth. Our Information and Investigation group for arenaflex Web-based features is committed to harnessing the power of data to inform product design, measure advertising effectiveness, and develop new business opportunities in emerging markets. Job Overview We are seeking a highly motivated and experienced Lead Data Engineer to join our Commitment and Maintenance Information Engineering team. As a Lead Data Engineer, you will play a crucial role in designing and developing cutting-edge data solutions, collaborating with cross-functional teams, and driving business growth through data-driven insights. If you are passionate about working with large datasets, building scalable data warehousing solutions, and driving business outcomes through data analysis, we encourage you to apply for this exciting opportunity. Key Responsibilities Contribute to the design and development of our data products and data warehouses, focusing on Engagement and Retention Analysis and Data Science Design and build scalable data warehousing solutions, creating ETL pipelines in large data environments (cloud, on-prem, hybrid) Work with our tech stack, including Hadoop, AWS, Snowflake, Spark, and languages such as Python, Scala Help engineer data solutions/architectures and define data models for the core data warehouse and data marts Collaborate with Data Product Managers, Data Modelers, and Data Architects to design, implement, and deliver successful data solutions Maintain detailed documentation of your work and changes to support data quality and data governance Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our clients (Data Science, Data Analysis teams) Be an active participant and advocate of agile/scrum practices to ensure safety and process improvements for your team Essential Qualifications To be successful in this role, you should have: A Bachelor's degree in a relevant field (Computer Science, Information Technology, or related) Strong SQL skills and ability to write queries to extract data and build performant datasets Hands-on experience with distributed systems like Spark, Hadoop (HDFS, Hive, Voila, PySpark) to query and process data Strong programming skills in Python, Java/Scala Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, BigQuery) Strong experience with data integration toolsets (e.g., Windstream) and writing and maintaining data pipelines Strong knowledge of data modeling techniques and data warehousing standard principles and practices Familiarity with Scrum and Agile approaches Preferred Qualifications While not required, the following qualifications are highly desirable: Experience with cloud technologies like AWS (S3, EMR, EC2) Knowledge of data governance and data quality best practices Experience working with large datasets and building scalable data solutions Strong problem-solving skills, with attention to detail and excellent analytical and communication skills Skills and Competencies To succeed in this role, you should possess: Strong technical skills, with the ability to learn and adapt to new technologies Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams Strong problem-solving skills, with the ability to analyze complex data sets and drive business outcomes Ability to work in a fast-paced environment, with multiple priorities and deadlines Career Growth Opportunities and Learning Benefits At arenaflex, we are committed to the growth and development of our employees. As a Lead Data Engineer, you will have access to: Opportunities for professional growth and advancement Training and development programs to enhance your technical and soft skills Collaboration with experienced professionals and thought leaders in the industry Access to cutting-edge technologies and tools Work Environment and Company Culture arenaflex is a dynamic and innovative organization, committed to fostering a positive and inclusive work environment. Our company culture is built on: Collaboration and teamwork Innovation and creativity Respect and inclusivity Continuous learning and growth Compensation, Perks, and Benefits arenaflex offers a competitive compensation package, including: A salary of $24/hour Comprehensive benefits package, including health, dental, and vision insurance Retirement savings plan Paid time off and holidays Opportunities for professional growth and advancement Conclusion If you are a motivated and experienced data professional, looking for a challenging and rewarding role, we encourage you to apply for this exciting opportunity. As a Lead Data Engineer at arenaflex, you will have the chance to work with cutting-edge technologies, collaborate with experienced professionals, and drive business growth through data-driven insights. Apply now to join our team and take your career to the next level! Apply for this job