[Remote] Senior Data Engineer

Note: The job is a remote job and is open to candidates in USA. Consensys is the leading blockchain and web3 software company, pioneering technological developments within the web3 ecosystem. The Senior Data Engineer will design, build, and maintain robust data pipelines, ensuring data quality, security, and governance while collaborating with various stakeholders across the organization.ResponsibilitiesDesign, build, and maintain robust data pipelines that integrate sources across the businessCollaborate closely with analysts, business stakeholders, and other engineering teams to gather requirements, align timelines, discuss architecture, and ensure successful deliveryDocument data pipelines, best practices, and processes to support onboarding and knowledge sharing within the teamDevelop and optimize data models to deliver trusted, structured, and business-ready dataEnsure data quality, security, and governance are embedded in all pipelines and systemsOrchestrate and monitor pipeline execution to ensure reliability and scalabilityDeploy and manage infrastructure as codeBuild and tune big data pipelines using SQL, Python, and distributed processing frameworksWork with cloud data warehouses to enable insights and analyticsMaintain and update reporting solutions and user dashboardsAutomate workflows and improve CI/CD pipelines to reduce manual processesSkillsDesign, build, and maintain robust data pipelines that integrate sources across the businessCollaborate closely with analysts, business stakeholders, and other engineering teams to gather requirements, align timelines, discuss architecture, and ensure successful deliveryDocument data pipelines, best practices, and processes to support onboarding and knowledge sharing within the teamDevelop and optimize data models to deliver trusted, structured, and business-ready dataEnsure data quality, security, and governance are embedded in all pipelines and systemsOrchestrate and monitor pipeline execution to ensure reliability and scalabilityDeploy and manage infrastructure as codeBuild and tune big data pipelines using SQL, Python, and distributed processing frameworksWork with cloud data warehouses to enable insights and analyticsMaintain and update reporting solutions and user dashboardsAutomate workflows and improve CI/CD pipelines to reduce manual processesOver 6 years of experience as a Data EngineerUse Trusted Execution Environments (TEEs) to securely process sensitive user data, ensuring it remains protected and only aggregated insights are releasedStrong SQL skills and experience with cloud warehouses (e.g.: Snowflake, BigQuery, Redshift)Hands-on experience with transformation and orchestration tools (e.g.: dbt, Airflow, Dagster)Comfort with Python or other scripting languages for ETL and automationFamiliarity with data governance and metadata management (e.g.: DataHub)Experience deploying and managing infrastructure as code (e.g.: Terraform, Pulumi)Exposure to data integration and ingestion tools (e.g.: Airbyte, Segment)Experience with big data and distributed processing (e.g.: Apache Spark, AWS EMR, S3)Exposure to open source projectsExperience maintaining and improving reporting solutions and dashboards (e.g.: Preset/Superset, Cube.dev)Familiarity with CI/CD practices and automation (e.g.: GitHub Actions)A collaborative mindset and eagerness to work with both technical and non-technical colleaguesCompany OverviewConsenSys builds Ethereum blockchain infrastructure and applications ranging from developer tools to enterprise solutions. It was founded in 2014, and is headquartered in Brooklyn, New York, USA, with a workforce of 501-1000 employees. Its website is https://consensys.io.Company H1B SponsorshipConsensys has a track record of offering H1B sponsorships, with 1 in 2022, 1 in 2021, 4 in 2020. Please note that this does not guarantee sponsorship for this specific role.