Data Engineer
About YLD:
Everything we do is to empower our clients to move forward. Great technology companies are built on incredible design, engineering and strategy, working in unison, operating at the very heart of an organisation and its audience. Enabling organisations to become great technology companies is our mission, and our promise to our clients. We aim to leave them with the mindset, tools, skills and expertise they need to go beyond their own expectations, revolutionise their sectors, and for us to be proud of the change we create with them and their customers.
Our Mission:
Our purpose is to help our clients develop the capabilities they need to outperform their competitors. Our success is a consequence of ensuring our clients are successful. Our company is built on extraordinary people; we aim to attract, inspire, develop and retain them. YLD is a software engineering and design consultancy; we create digital capabilities for our clients that last beyond our engagement. We have offices in London, Lisbon, Porto.
Tasks
About the role:
As a Data Engineer in this role, you will be responsible for building core infrastructure software (pipelines, APIs, data modelling, tracking events) as part of our client's data platform team. Your work will include instrumenting systems for performance, and enhancement throughout. You will work on ensuring these data offerings are to various internal & external stakeholders using secure authentication patterns.
Your role will include choosing and implementing the appropriate technologies for scaling data access patterns, batch processing, handling data from third-party suppliers, supporting documentation, and supplying data to researchers—all while considering the unique domain knowledge of the client's business. As a senior collaborator on the team, you will coach and mentor other engineers to support the growth of their technical expertise.
Requirements
Technical competencies:
Proven experience writing highly maintainable and performant Python/PySpark code
Good understanding of Cloud environments, particularly Microsoft Azure and data orchestration systems such as Dagster or Apache Airflow
Good understanding of containerisation platforms such as Docker and container orchestration systems such as Kubernetes
Experience working with data lakes; experience with Spark or Databricks
Understanding of common data transformation and storage formats, e.g. Apache Parquet
Familiar with version control systems such as Git and GitHub
Experience with VCL and BCL would be a plus, but not required
Non-Technical competencies:
Problem-solving skills that balance innovation with pragmatic technology choices to solve business needs
Comfortable working in a dynamic production environment and taking care of client expectations effectively
Distinct customer focus and quality mindset
Experience working closely with engineering leadership and architects to deliver high-quality solutions
Experience maintaining a high-degree of ownership and transparency in deliverables
An exemplar of YLD’s brand and safeguarder of our reputation
Exceptional communication skills, able to communicate complex ideas in a simple fashion
Benefits
As well as the chance to work with a forward-thinking, ethical, and fun group of people, you’ll also get:
Company Private Health care
Enhanced fully paid maternity and paternity leave for up to 6 months
Company’s Pension Scheme
25 days annual holiday (excluding Public Holidays)
£2000 annual allowance for Training/Conferences
£300 annual allowance for additional hardware
Mental Health support: access to Spill app
Meditation/Sleep support: Headspace or Calm app subscription
Bonus (depending on Company performance and results)
Company laptop
Generous referral schemes
Our typical Recruitment Process looks like this:
1st Interview with someone from the Talent team (30/45 mins)
Technical Interview with our Developers (1h30)
We live and breathe our values, and know you will too:
Growing every day
Including everyone
Relationships built on honesty and ethics
Inspiring solutions
Winning together
We’re an equal opportunity employer and value diversity of all kinds. We don’t discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, pregnancy or maternity, age, marital status, or disability status. We also believe in work-life balance and offer flexible working around our core hours.About the companyWe're a software engineering and design consultancy, helping your team succeed by fostering a progressive culture of learning.
Apply Now
Everything we do is to empower our clients to move forward. Great technology companies are built on incredible design, engineering and strategy, working in unison, operating at the very heart of an organisation and its audience. Enabling organisations to become great technology companies is our mission, and our promise to our clients. We aim to leave them with the mindset, tools, skills and expertise they need to go beyond their own expectations, revolutionise their sectors, and for us to be proud of the change we create with them and their customers.
Our Mission:
Our purpose is to help our clients develop the capabilities they need to outperform their competitors. Our success is a consequence of ensuring our clients are successful. Our company is built on extraordinary people; we aim to attract, inspire, develop and retain them. YLD is a software engineering and design consultancy; we create digital capabilities for our clients that last beyond our engagement. We have offices in London, Lisbon, Porto.
Tasks
About the role:
As a Data Engineer in this role, you will be responsible for building core infrastructure software (pipelines, APIs, data modelling, tracking events) as part of our client's data platform team. Your work will include instrumenting systems for performance, and enhancement throughout. You will work on ensuring these data offerings are to various internal & external stakeholders using secure authentication patterns.
Your role will include choosing and implementing the appropriate technologies for scaling data access patterns, batch processing, handling data from third-party suppliers, supporting documentation, and supplying data to researchers—all while considering the unique domain knowledge of the client's business. As a senior collaborator on the team, you will coach and mentor other engineers to support the growth of their technical expertise.
Requirements
Technical competencies:
Proven experience writing highly maintainable and performant Python/PySpark code
Good understanding of Cloud environments, particularly Microsoft Azure and data orchestration systems such as Dagster or Apache Airflow
Good understanding of containerisation platforms such as Docker and container orchestration systems such as Kubernetes
Experience working with data lakes; experience with Spark or Databricks
Understanding of common data transformation and storage formats, e.g. Apache Parquet
Familiar with version control systems such as Git and GitHub
Experience with VCL and BCL would be a plus, but not required
Non-Technical competencies:
Problem-solving skills that balance innovation with pragmatic technology choices to solve business needs
Comfortable working in a dynamic production environment and taking care of client expectations effectively
Distinct customer focus and quality mindset
Experience working closely with engineering leadership and architects to deliver high-quality solutions
Experience maintaining a high-degree of ownership and transparency in deliverables
An exemplar of YLD’s brand and safeguarder of our reputation
Exceptional communication skills, able to communicate complex ideas in a simple fashion
Benefits
As well as the chance to work with a forward-thinking, ethical, and fun group of people, you’ll also get:
Company Private Health care
Enhanced fully paid maternity and paternity leave for up to 6 months
Company’s Pension Scheme
25 days annual holiday (excluding Public Holidays)
£2000 annual allowance for Training/Conferences
£300 annual allowance for additional hardware
Mental Health support: access to Spill app
Meditation/Sleep support: Headspace or Calm app subscription
Bonus (depending on Company performance and results)
Company laptop
Generous referral schemes
Our typical Recruitment Process looks like this:
1st Interview with someone from the Talent team (30/45 mins)
Technical Interview with our Developers (1h30)
We live and breathe our values, and know you will too:
Growing every day
Including everyone
Relationships built on honesty and ethics
Inspiring solutions
Winning together
We’re an equal opportunity employer and value diversity of all kinds. We don’t discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, pregnancy or maternity, age, marital status, or disability status. We also believe in work-life balance and offer flexible working around our core hours.About the companyWe're a software engineering and design consultancy, helping your team succeed by fostering a progressive culture of learning.
Apply Now