[Remote] Data Engineer
Note: The job is a remote job and is open to candidates in USA. Artlogic is a leading technology platform for the art world, empowering galleries and art professionals to streamline their operations. The Junior Data Engineer will be responsible for building and executing ETL pipelines to facilitate client data migration and ensure data integrity during the onboarding process.ResponsibilitiesExecute End-to-End Migrations: Learn to navigate the full migration lifecycle, moving data from diverse client environments into ArtlogicExtraction: Use scripts and tools to pull data from external platforms (e.g., FileMaker, legacy SQL databases)Transformation: Write clean, maintainable code to map, clean, and transform "messy" legacy data to fit the Artlogic schemaQA & Validation: Perform rigorous data validation and unit testing to ensure 100% accuracy and data integrity before go-liveCode Contribution: Assist in developing and maintaining our internal migration frameworks and R&D toolsPipeline Optimization: Identify repetitive tasks in your daily workflow and work with senior engineers to automate themSystems Analysis: Research unknown database structures to determine the most efficient extraction methodsCross-functional Teamwork: Partner with Client Liaison Project Managers to understand client-specific data nuancesDocumentation: Document migration mappings and technical edge cases to ensure knowledge is shared across the teamIterative Delivery: Adapt migration scripts quickly as project requirements evolve during the onboarding phaseAI Recommendation Verification and Data Mapping: Review and verify AI (Claude) recommendations for column mappings during cloud data migration, including confirming that columns fit perfectly or identifying where data requires manipulation or concatenationData Transformation and Cloud Push: Perform final data transformation steps using basic Python, Pandas, and Reax code to prepare and push relational data from Excel into the cloud environmentSkillsProficiency in at least one object-oriented language—Python is preferred, but we also value strong logic in C#Solid understanding of relational databases (Joins, Keys, Indexes) and how to manipulate data structuresAbility to explain technical data hurdles to non-technical Project ManagersAn obsession with data accuracy; you catch the 'edge case' before it becomes a bugEnjoy the 'detective work' of figuring out how a legacy system was built and how to extract its valueExperience with ETL tools, pandas (Python), or regular expressions (Regex)Familiarity with REST APIs and how to handle JSON/XML dataPrevious exposure to FileMaker (Claris) or NoSQL environmentsA high-level understanding of how back-end data interacts with front-end UIsCompany OverviewArtlogic specialized in website and database integration, CRM, and built-in sales management tools services. It was founded in 1995, and is headquartered in London, England, GBR, with a workforce of 51-200 employees. Its website is https://artlogic.net.