Experienced Remote Big Data Lead Engineer – Cloud-Based Data Engineering Solutions Development and Implementation
Introduction to Workwarp and the Big Data Industry
Workwarp, in partnership with leading global banks like Citi, is at the forefront of the big data revolution, leveraging cutting-edge technologies to drive business growth and economic progress. As a trusted partner to clients worldwide, our mission is to provide responsible financial services that enable growth and prosperity. The big data industry is rapidly evolving, with an increasing demand for skilled professionals who can design, develop, and implement innovative data engineering solutions. If you're passionate about big data and cloud technologies, and you're looking for a challenging and rewarding career opportunity, we invite you to join our team as a Big Data Lead Engineer.
Job Highlights and Responsibilities
As a Big Data Lead Engineer at Workwarp, you will play a critical role in designing and developing big data solutions using next-generation data techniques. You will work closely with domain experts, product managers, analysts, and data scientists to develop big data pipelines in Hadoop or Snowflake, and deliver data as a service framework. Your responsibilities will include:
Partnering with cross-functional teams to develop big data pipelines and analytics platforms
Designing, developing, and optimizing large-scale data processing systems and analytics platforms
Working with data scientists to build client pipelines using heterogeneous sources and providing engineering services for data science applications
Ensuring automation through CI/CD across platforms, both in cloud and on-premises
Researching and assessing open-source technologies and components to recommend and integrate into the design and implementation
Mentoring other team members on big data and cloud tech stacks
Defining needs around maintainability, testability, performance, security, quality, and usability for data platforms
Driving implementation, consistent patterns, reusable components, and coding standards for data engineering processes
Tuning big data applications on Hadoop and non-Hadoop platforms for optimal performance
Evaluating new IT developments and evolving business requirements, and recommending appropriate systems alternatives and/or enhancements to current systems
Essential and Preferred Qualifications
To be successful in this role, you should have:
8+ years of experience in Hadoop/big data technologies
2-4 years of experience in Kafka streaming development, including design, development, implementation, and validation of real-time data streaming solutions
2-4 years of experience in API and microservices development, designing, building, and maintaining scalable, secure, and high-performance microservices architecture and API solutions
2-4 years of experience as a Python developer, with expertise in automation testing, designing, developing, and automating robust software solutions and testing frameworks
Experience in managing and implementing successful projects
Subject Matter Expert (SME) in at least one area of Applications Development
Ability to adjust priorities quickly as circumstances dictate
Demonstrated leadership and project management skills
Consistently demonstrates clear and concise written and verbal communication
Preferred qualifications include a Master's degree in a relevant field and experience working in a cloud-based environment.
Skills and Competencies
To excel in this role, you should possess:
Strong technical skills in big data technologies, including Hadoop, Kafka, and Spark
Experience with cloud-based platforms, such as AWS or Azure
Excellent problem-solving and analytical skills
Strong communication and collaboration skills
Ability to work in a fast-paced environment and adapt to changing priorities
Strong leadership and mentoring skills
Experience with agile development methodologies and version control systems, such as Git
Career Growth Opportunities and Learning Benefits
At Workwarp, we're committed to helping our employees grow and develop their careers. As a Big Data Lead Engineer, you'll have access to:
Opportunities to work on challenging and complex projects, using cutting-edge technologies
Professional development and training programs, to help you enhance your skills and knowledge
Mentorship and coaching from experienced professionals in the field
Opportunities to collaborate with cross-functional teams and contribute to the development of innovative solutions
A culture that encourages innovation, creativity, and experimentation
Work Environment and Company Culture
At Workwarp, we're proud of our diverse and inclusive culture, which values and respects the contributions of all employees. Our work environment is dynamic and fast-paced, with a focus on collaboration, innovation, and teamwork. We offer a range of benefits and perks, including:
Competitive salary and bonus structure
Comprehensive health and wellness programs
401(k) and retirement savings plans
Paid time off and vacation days
Opportunities for professional development and growth
Compensation, Perks, and Benefits
We offer a competitive compensation package, including a salary range of $125,760 - $188,640 per year, depending on experience. In addition to salary, we offer a range of benefits and perks, including medical, dental, and vision coverage, life insurance, and a 401(k) plan. We also offer paid time off, vacation days, and opportunities for professional development and growth.
Conclusion and Call to Action
If you're a motivated and experienced big data professional, looking for a challenging and rewarding career opportunity, we encourage you to apply for the Big Data Lead Engineer position at Workwarp. With your skills and experience, you'll play a critical role in driving business growth and innovation, and contributing to the development of cutting-edge big data solutions. Don't miss this opportunity to join our team and take your career to the next level. Apply today!
Apply Now
Workwarp, in partnership with leading global banks like Citi, is at the forefront of the big data revolution, leveraging cutting-edge technologies to drive business growth and economic progress. As a trusted partner to clients worldwide, our mission is to provide responsible financial services that enable growth and prosperity. The big data industry is rapidly evolving, with an increasing demand for skilled professionals who can design, develop, and implement innovative data engineering solutions. If you're passionate about big data and cloud technologies, and you're looking for a challenging and rewarding career opportunity, we invite you to join our team as a Big Data Lead Engineer.
Job Highlights and Responsibilities
As a Big Data Lead Engineer at Workwarp, you will play a critical role in designing and developing big data solutions using next-generation data techniques. You will work closely with domain experts, product managers, analysts, and data scientists to develop big data pipelines in Hadoop or Snowflake, and deliver data as a service framework. Your responsibilities will include:
Partnering with cross-functional teams to develop big data pipelines and analytics platforms
Designing, developing, and optimizing large-scale data processing systems and analytics platforms
Working with data scientists to build client pipelines using heterogeneous sources and providing engineering services for data science applications
Ensuring automation through CI/CD across platforms, both in cloud and on-premises
Researching and assessing open-source technologies and components to recommend and integrate into the design and implementation
Mentoring other team members on big data and cloud tech stacks
Defining needs around maintainability, testability, performance, security, quality, and usability for data platforms
Driving implementation, consistent patterns, reusable components, and coding standards for data engineering processes
Tuning big data applications on Hadoop and non-Hadoop platforms for optimal performance
Evaluating new IT developments and evolving business requirements, and recommending appropriate systems alternatives and/or enhancements to current systems
Essential and Preferred Qualifications
To be successful in this role, you should have:
8+ years of experience in Hadoop/big data technologies
2-4 years of experience in Kafka streaming development, including design, development, implementation, and validation of real-time data streaming solutions
2-4 years of experience in API and microservices development, designing, building, and maintaining scalable, secure, and high-performance microservices architecture and API solutions
2-4 years of experience as a Python developer, with expertise in automation testing, designing, developing, and automating robust software solutions and testing frameworks
Experience in managing and implementing successful projects
Subject Matter Expert (SME) in at least one area of Applications Development
Ability to adjust priorities quickly as circumstances dictate
Demonstrated leadership and project management skills
Consistently demonstrates clear and concise written and verbal communication
Preferred qualifications include a Master's degree in a relevant field and experience working in a cloud-based environment.
Skills and Competencies
To excel in this role, you should possess:
Strong technical skills in big data technologies, including Hadoop, Kafka, and Spark
Experience with cloud-based platforms, such as AWS or Azure
Excellent problem-solving and analytical skills
Strong communication and collaboration skills
Ability to work in a fast-paced environment and adapt to changing priorities
Strong leadership and mentoring skills
Experience with agile development methodologies and version control systems, such as Git
Career Growth Opportunities and Learning Benefits
At Workwarp, we're committed to helping our employees grow and develop their careers. As a Big Data Lead Engineer, you'll have access to:
Opportunities to work on challenging and complex projects, using cutting-edge technologies
Professional development and training programs, to help you enhance your skills and knowledge
Mentorship and coaching from experienced professionals in the field
Opportunities to collaborate with cross-functional teams and contribute to the development of innovative solutions
A culture that encourages innovation, creativity, and experimentation
Work Environment and Company Culture
At Workwarp, we're proud of our diverse and inclusive culture, which values and respects the contributions of all employees. Our work environment is dynamic and fast-paced, with a focus on collaboration, innovation, and teamwork. We offer a range of benefits and perks, including:
Competitive salary and bonus structure
Comprehensive health and wellness programs
401(k) and retirement savings plans
Paid time off and vacation days
Opportunities for professional development and growth
Compensation, Perks, and Benefits
We offer a competitive compensation package, including a salary range of $125,760 - $188,640 per year, depending on experience. In addition to salary, we offer a range of benefits and perks, including medical, dental, and vision coverage, life insurance, and a 401(k) plan. We also offer paid time off, vacation days, and opportunities for professional development and growth.
Conclusion and Call to Action
If you're a motivated and experienced big data professional, looking for a challenging and rewarding career opportunity, we encourage you to apply for the Big Data Lead Engineer position at Workwarp. With your skills and experience, you'll play a critical role in driving business growth and innovation, and contributing to the development of cutting-edge big data solutions. Don't miss this opportunity to join our team and take your career to the next level. Apply today!
Apply Now