[Remote] Big Data Engineer

Note: The job is a remote job and is open to candidates in USA. Clear Fracture is building AI-driven data integration systems that enable organizations to connect, transform, and reason over complex data using agentic workflows. The Data Engineer will design schemas, implement data services, and develop real use cases on the platform, playing a key role in building the core data layer that powers the agentic platform.ResponsibilitiesDesign and implement logical and physical data models for complex, evolving datasetsDefine schemas and access patterns that support multi-tenant usage and application-level workflowsBalance normalization, performance, and flexibility across different storage systemsPartner with product and engineering teams to translate requirements into scalable data designsDevelop real-world data use cases on top of the platform to validate and extend its capabilitiesDesign and build data interfaces and abstractions that help users understand and work with dataContribute to systems such as: Data glossaries, Semantic layers, Metadata and schema discovery toolsHelp define how users explore, model, and interact with data within the platformTranslate complex data structures into intuitive, usable representationsBuild backend services and APIs that expose and operate on data modelsImplement data access layers that are reliable, maintainable, and performantContribute to core application architecture where data and services intersectWrite clean, testable, production-grade codeDesign and implement pipelines for ingesting, transforming, and validating dataSupport both batch and near-real-time processing workflowsBuild systems that handle structured, semi-structured, and unstructured dataEnable data flows that support AI-driven and agent-based workflowsWork with embeddings, context retrieval, and data representations used in modern AI systemsHelp design systems that make data accessible and useful for autonomous agentsImplement validation, monitoring, and testing for data systemsEnsure correctness, consistency, and observability of data pipelines and servicesDiagnose and resolve data-related issues in production environmentsSkillsBachelor's degree in Computer Science, Engineering, or related field, or equivalent practical experience6+ years of professional experience in software engineering and/or data engineering rolesDue to the nature of the work, U.S. Citizenship and the ability to obtain a Secret Clearance are requiredStrong programming skills in Python (or similar backend language)Experience designing and implementing data models for production systems, with advanced knowledge of dimensional modeling topics like slowly changing dimensions and entity relationship diagramsProficiency in SQL and experience with relational databases (e.g., PostgreSQL)Experience building backend services or APIs that interact with data systemsExperience designing and operating data pipelines (ETL/ELT)Familiarity with NoSQL databases and different data storage paradigmsExperience working with large datasets and performance optimizationExperience with Docker and containerized development workflowsFamiliarity with Kubernetes-based environmentsStrong understanding of software engineering fundamentals (testing, version control, system design)Experience building multi-tenant data systemsFamiliarity with semantic layers, data catalogs, or data discovery systemsExperience designing data-facing user interfaces or developer toolingExperience with streaming systems (e.g., Kafka or similar)Experience with orchestration tools (e.g., Airflow, Dagster, Prefect)Experience working with AI/ML data pipelines or agent-based systemsExperience supporting on-prem or hybrid deploymentsExposure to data governance, access control, and metadata systemsExperience with cloud platforms (AWS, Azure, GCP)Familiarity with vector databases (e.g., Pinecone, ChromaDB) and embedding-based retrievalCompany OverviewClear Fracture is a software company that offers data integration and analytics solutions. It was founded in 2007, and is headquartered in Vienna, Virginia, USA, with a workforce of 11-50 employees. Its website is https://clearfracture.ai.