[Remote] Security Data Engineer

Note: The job is a remote job and is open to candidates in USA. Dice is seeking a Security Data Engineer to join their team in Costa Mesa, California, potentially in a permanent role. The position focuses on enhancing a data lake environment by improving the data ingestion layer and ensuring the reliable movement of security-relevant data.ResponsibilitiesTake ownership of the data ingestion layer for an existing data lake, ensuring steady performance and dependable delivery of incoming datasetsReduce a defined backlog of pipeline work during the first 90 days by building and activating prioritized ingestion workflowsAssume responsibility for pipeline components transitioned from the lead engineer and continue their operational support without disrupting established foundationsSupport and improve current ETL processes by monitoring health, resolving failures, and extending coverage where neededIntegrate new source systems, including platforms such as Rippling and Workday, into the broader data ecosystemCoordinate with internal application and system owners to identify data sources, secure appropriate access, and obtain logs or source records required for ingestionApply data cleaning and analysis practices to improve data quality and maintain consistency across inbound datasetsContribute to infrastructure and deployment workflows using AWS, AWS CDK, Infrastructure as Code, and CI/CD practices to support scalable pipeline operationsSkillsExperience building and supporting data pipelines in a data lake or large-scale data engineering environmentStrong programming skills in Python and hands-on experience with Apache Spark, Apache Hadoop, Apache Kafka, and ETL developmentPractical knowledge of Amazon Web Services (AWS) and infrastructure automation tools such as AWS CDK and Infrastructure as Code frameworksExperience maintaining pipeline reliability, troubleshooting ingestion issues, and improving operational stability in production environmentsAbility to work directly with internal stakeholders to locate source data, obtain access, and move integrations forwardFamiliarity with data analysis and data cleaning techniques that improve downstream usability and trust in datasetsExposure to CI/CD practices and deployment automation for data engineering workflowsAdditional programming experience in Rust or Go is preferredBenefitsBenefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance.Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan.Company OverviewDice is the go-to career marketplace for tech professionals. It was founded in 2010, and is headquartered in Drachten, Friesland, NLD, with a workforce of 201-500 employees. Its website is https://www.or-quest.nl/.