Sr, D, A?t? N
Description:
Wizard is revolutionizing the shopping experience using generative AI and messaging technologies.
Seeking a Senior Data Engineer to enhance data collection, storage, and analysis capabilities.
This position is critical for strengthening data infrastructure for data-driven decision making and growth initiatives.
Develop and maintain scalable data infrastructure for batch and real-time data processing.
Build and optimize ETL pipelines for efficient data flow and accessibility.
Collaborate with data scientists and cross-functional teams for accurate monitoring and analysis.
Design backend data solutions for microservices architecture, ensuring seamless integration.
Implement and manage integrations with third-party e-commerce platforms.
Requirements:
5+ years of professional experience in software development with a strong focus on data engineering.
Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
Proficiency in Python with experience implementing software engineering best practices.
Strong expertise in building ETL pipelines using tools such as Apache Spark, Databricks, or Hadoop (Spark experience is required).
Solid understanding of distributed computing and data modeling for scalable systems.
Hands-on experience with NoSQL databases like MongoDB, Cassandra, DynamoDB, or CosmosDB.
Proficiency in real-time stream processing systems such as Kafka, AWS Kinesis, or GCP Data Flow.
Experience with Delta Lake, Parquet files, and cloud platforms (AWS, GCP, or Azure).
Familiarity with caching and search technologies such as Redis, Elasticsearch, or Solr.
Knowledge of message queuing systems like RabbitMQ, AWS SQS, or GCP Cloud Tasks.
Advocate for Test-Driven Development (TDD) and experienced in using version control tools like GitHub or Bitbucket.
Benefits:
Apply Now
Wizard is revolutionizing the shopping experience using generative AI and messaging technologies.
Seeking a Senior Data Engineer to enhance data collection, storage, and analysis capabilities.
This position is critical for strengthening data infrastructure for data-driven decision making and growth initiatives.
Develop and maintain scalable data infrastructure for batch and real-time data processing.
Build and optimize ETL pipelines for efficient data flow and accessibility.
Collaborate with data scientists and cross-functional teams for accurate monitoring and analysis.
Design backend data solutions for microservices architecture, ensuring seamless integration.
Implement and manage integrations with third-party e-commerce platforms.
Requirements:
5+ years of professional experience in software development with a strong focus on data engineering.
Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
Proficiency in Python with experience implementing software engineering best practices.
Strong expertise in building ETL pipelines using tools such as Apache Spark, Databricks, or Hadoop (Spark experience is required).
Solid understanding of distributed computing and data modeling for scalable systems.
Hands-on experience with NoSQL databases like MongoDB, Cassandra, DynamoDB, or CosmosDB.
Proficiency in real-time stream processing systems such as Kafka, AWS Kinesis, or GCP Data Flow.
Experience with Delta Lake, Parquet files, and cloud platforms (AWS, GCP, or Azure).
Familiarity with caching and search technologies such as Redis, Elasticsearch, or Solr.
Knowledge of message queuing systems like RabbitMQ, AWS SQS, or GCP Cloud Tasks.
Advocate for Test-Driven Development (TDD) and experienced in using version control tools like GitHub or Bitbucket.
Benefits:
Apply Now