[Remote] Sr. Software and Data Engineer (API)
Note: The job is a remote job and is open to candidates in USA. Affinity Solutions is the leading consumer purchase insights company, providing a complete view of U.S. and U.K. consumer spending. They are seeking a Senior Data and Software Engineer to architect, build, and maintain high-performance RESTful APIs for their data integration ecosystem.ResponsibilitiesDesign, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latencyStay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworksImplement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliabilityIntegrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperabilityDevelop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutionsDesign and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scaleUphold data governance standards and practices, ensuring compliance with data quality standardsImplement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial dataLeverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)Design highly performant data structures to ensure optimal storage and retrieval of dataUtilize advanced database technologies to enhance data storage and processing capabilitiesParticipate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deploymentsLead and manage integration projects, including: LiveRamp XMI Integration and Salesforce integration, Additional clean rooms (AWS/AMC) modeling integration, CAPI integrations with walled gardens on behalf of brands, MadConnect integration pipes and buildout, Opening new integration channels based on client demandSkillsExtensive experience building production-grade RESTful APIs with proven expertise in API design patterns, versioning strategies, and backward compatibilityDeep understanding of API performance optimization techniques, including query optimization, connection pooling, request batching, and response compressionStrong knowledge of modern API technologies and standards, including OpenAPI/Swagger specifications, OAuth 2.0, JWT, GraphQL, and API gateway patternsDemonstrated success integrating with external API vendors and managing complex API ecosystems with multiple third-party dependenciesExperience with API testing frameworks, contract testing, and implementing comprehensive API monitoring and alerting systems6 or more years of experience as a back-end data/software engineer working on various data technologies, with proficiency in SQL, Python, and Javascript (Node.js)2 or more years of hands-on experience with Snowflake ecosystem, including expert knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored proceduresMinimum 3 years' experience with various AWS cloud technologies and data lake management such as S3, Lambda, Airflow, Redshift, Athena, and GlueDemonstratable knowledge of data clean room technologies (e.g., creating secure data shares using RBAC). Knowledge of Snowflake Native apps (v6+) preferredKnowledge of all aspects of the SDLC as well as experience with Jenkins and setting up CI/CD processesExperience with security concepts such as CCPA, GDPR, SSO, and JWTProficiency in data access controls, including aggregation constraints, projection policies, row access policies, column masking, and differential privacy; knowledge of data controls including semantic models, dbt, honeydew, Iceberg tables, various catalogs (glue, rest, nessie, hadoop etc), and catalog syncing conceptsExperience with cloud environments such as SNOWFLAKE, AWS, DATABRICKS, LIVERAMP, and GCPFamiliarity with BI tools such as Thoughtspot, Sigma, Domo, Looker, Quicksights, Tableau; detailed knowledge of AI concepts such as Generative AI chatbots, cortex analyst, agent training, various LLMs, and prompt engineeringExperience in modeling: Snowpark ML, TensorFlowExpert-level experience building, maintaining, and scaling APIs using Node.js, Express, Fastify, or similar frameworks; proficiency with Swagger/OpenAPI specifications, API documentation tools, Next.js, and modern API development practicesBenefitsBenefits for full-time employees of Affinity Solutions begin on the first of the month following your date of hire with a generous employer contribution for medical, dental, and visionCompany paid holidaysWellness time offOther wellness benefitsEmployee discountsEmployer paid life insuranceOption to enroll into an employer-matched 401K PlanUnlimited vacation days, available starting 90 days from your hire date as a team memberCompany OverviewAffinity Solutions offers technology, analytics, data processing, and business services for customers. It was founded in 2005, and is headquartered in New York, New York, USA, with a workforce of 51-200 employees. Its website is https://www.affinity.solutions.Company H1B SponsorshipAffinity Solutions has a track record of offering H1B sponsorships, with 4 in 2026, 11 in 2025, 22 in 2024, 6 in 2023, 6 in 2022, 9 in 2021, 4 in 2020. Please note that this does not guarantee sponsorship for this specific role.