[Remote] Senior Data Engineer

Note: The job is a remote job and is open to candidates in USA. LanceSoft, Inc. is seeking a Senior Data Engineer to support their data engineering initiatives. The role involves defining testing scopes, designing testing strategies, and collaborating with cross-functional teams to ensure high-quality data deliverables.ResponsibilitiesDefine the end-to-end testing scope based on solution architecture and project documentationDesign and implement a comprehensive testing strategy and plan aligned with organizational QA standardsDevelop and maintain test scripts and frameworks for the Redshift serverless platformPerform testing across key technologies, including: AWS Redshift, AWS DMS (Data Migration Service), AWS Glue, PySpark Deequ, Event Bridge, Data Lakes, Python-based data pipelines, Apache Airflow, dbt (data build tool)Build and implement automated testing solutions to ensure: End-to-end data validation, Data ingestion accuracy, Transformation logic integrity, Data pipeline reliabilityConduct test coverage analysis and ensure adequate validation across all data engineering workflowsPrepare and manage test dataReview and provide feedback on: Solution architecture, Data models, Design and technical documentationCollaborate with cross-functional teams (Data Engineering, BI, DevOps, Product) to: Identify testing impacts, Mitigate risks, Ensure high-quality deliverablesSkillsProven experience in data engineering testing / data QA / ETL validationStrong hands-on experience with AWS data services (Redshift, Glue, DMS)Proficiency in Python for test automation and validationExperience with Airflow and orchestration testingHands-on experience with dbt and data transformation validationFamiliarity with CDK for infrastructure validationExperience in BI testing in Quicksuite will be highly beneficialExperience with data quality tools such as PySpark Deequ or similarStrong understanding of: Data warehousing concepts, ETL/ELT pipelines, Data validation techniques (schema, reconciliation, anomaly detection)Experience designing enterprise-level test strategies for data platformsKnowledge of CI/CD pipelines for data and test automationExperience working in Agile / Scrum environmentsFamiliarity with data observability frameworksCompany OverviewEstablished in 2000, LanceSoft is a pioneer in delivering top-notch Global Workforce Solutions and IT Services to a diverse clientele. It was founded in 2000, and is headquartered in Herndon, Virginia, USA, with a workforce of 5001-10000 employees. Its website is http://www.lancesoft.com/.