[Remote] Data Engineer

Note: The job is a remote job and is open to candidates in USA. Brooksource is seeking a hands-on, mid-level Data Engineer to support a security-focused data lake initiative. The role involves building reliable API ingestion pipelines, creating structured SQL datasets, and preparing data for downstream analytics and future AI use cases.ResponsibilitiesBuild and own API-based ingestion pipelines pulling data from third-party systemsHandle authentication, pagination, retries, failures, and schema changesIngest, transform, and structure raw data into SQL-based datasetsValidate incoming data for accuracy, completeness, and consistencyCreate and maintain clear documentation for datasets, fields, and ingestion logicManage and support datasets across multiple data sources (approx. 14 total)Prepare clean, well-structured data for downstream analytics and AI consumptionOperate independently and take ownership of deliverables with minimal hand-holdingSkills2+ years of hands-on experience writing and maintaining API ingestion pipelines in a big data environment, managing datasets across 14 known data sources and supporting datasets with 10–15K+ fields3–6 years of hands-on experience as a Data Engineer or similar roleStrong experience building API-based ingestion pipelinesProficiency with SQL / SQL Server and relational data modelingExperience working in AWS (S3, Lambda, EC2, RDS, or similar)Ability to validate and QA large, complex datasetsComfortable working with large field counts and evolving schemasStrong documentation and communication skillsExposure to security, device, endpoint, or asset dataExperience with tools such as Qualys, CrowdStrike, Intune, JAMF, Wiz, or SCCMFamiliarity with data lake concepts (raw vs curated layers)Experience supporting analytics or AI teams (data prep only, not model building)BenefitsBrooksource offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs.We offer a 401k plan that includes a company match and is fully vested after you become eligiblePaid time off, and sick time.Paid company holidays are subject to hour requirements and completion of the new hire period (13 weeks).We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.Company OverviewBrooksource is a single source for project and supplemental support through contract employment, contract-to-hire labor employment. It was founded in 2000, and is headquartered in Indianapolis, Indiana, USA, with a workforce of 1001-5000 employees. Its website is http://www.brooksource.com.