SQL Data Integration Developer
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Data Engineer
Type: Contract
Compensation: $70ā$95/hour
Location: Remote
Role Responsibilities
ā¢ Drive technical implementation and testing of complex data pipeline features within the SPECTRA platform, ensuring robust end-to-end functionality and meeting project release timelines.
ā¢ Design and develop data processing pipelines using SQL and Python to handle large-scale data collection, transformation, and quality monitoring workflows.
ā¢ Build and maintain dashboards and visualization tools to provide visibility into data quality, rater performance, and platform metrics for stakeholders across multiple teams.
ā¢ Create comprehensive end-to-end tests and monitoring alerts to ensure platform reliability, data integrity, and proactive identification of issues in the data collection workflow.
ā¢ Debug and troubleshoot complex data flow issues across the SPECTRA platform, identifying root causes and implementing solutions to maintain high system availability.
ā¢ Collaborate closely with Technical Leads and engineering teams to implement backend data processing logic and ensure adherence to development standards and best practices.
Qualifications
Must-Have
ā¢ Experience in SQL development writing complex queries, data transformations, and working with large datasets in production environments.
ā¢ Proficient in Python with experience in data processing, automation, and pipeline development using object-oriented programming principles.
ā¢ Experience with data engineering pipelines including ETL processes, data modeling, and building scalable data processing workflows.
ā¢ Hands-on experience with data visualization and dashboard tools such as Tableau or similar platforms for creating actionable insights from large datasets.
ā¢ Strong analytical and problem-solving skills with demonstrated ability to debug complex data issues and implement effective solutions.
ā¢ Experience with data quality monitoring and automated testing frameworks to ensure data accuracy, completeness, and reliability.
Preferred
ā¢ Degree in Computer Science or related field.
ā¢ Machine Learning experience with understanding of ML model training data requirements, feature engineering, and model evaluation metrics.
ā¢ Experience building and scaling large products or systems.
ā¢ Experience with building privacy and ads-related products is a big plus.
ā¢ Experience working with human labeling and annotation systems including workflow design, quality assurance, and vendor management in data collection operations.
ā¢ Prior experience working with the company or its internal tools is a plus.
Compensation & Legal
ā¢ Hourly contractor, Paid weekly via Stripe Connect.
Application Process (Takes 20ā30 mins to complete)
ā¢ Upload resume
ā¢ AI interview based on your resume
ā¢ Submit form
Resources & Support
ā¢ For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
ā¢ For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Apply tot his job
Apply To this Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Data Engineer
Type: Contract
Compensation: $70ā$95/hour
Location: Remote
Role Responsibilities
ā¢ Drive technical implementation and testing of complex data pipeline features within the SPECTRA platform, ensuring robust end-to-end functionality and meeting project release timelines.
ā¢ Design and develop data processing pipelines using SQL and Python to handle large-scale data collection, transformation, and quality monitoring workflows.
ā¢ Build and maintain dashboards and visualization tools to provide visibility into data quality, rater performance, and platform metrics for stakeholders across multiple teams.
ā¢ Create comprehensive end-to-end tests and monitoring alerts to ensure platform reliability, data integrity, and proactive identification of issues in the data collection workflow.
ā¢ Debug and troubleshoot complex data flow issues across the SPECTRA platform, identifying root causes and implementing solutions to maintain high system availability.
ā¢ Collaborate closely with Technical Leads and engineering teams to implement backend data processing logic and ensure adherence to development standards and best practices.
Qualifications
Must-Have
ā¢ Experience in SQL development writing complex queries, data transformations, and working with large datasets in production environments.
ā¢ Proficient in Python with experience in data processing, automation, and pipeline development using object-oriented programming principles.
ā¢ Experience with data engineering pipelines including ETL processes, data modeling, and building scalable data processing workflows.
ā¢ Hands-on experience with data visualization and dashboard tools such as Tableau or similar platforms for creating actionable insights from large datasets.
ā¢ Strong analytical and problem-solving skills with demonstrated ability to debug complex data issues and implement effective solutions.
ā¢ Experience with data quality monitoring and automated testing frameworks to ensure data accuracy, completeness, and reliability.
Preferred
ā¢ Degree in Computer Science or related field.
ā¢ Machine Learning experience with understanding of ML model training data requirements, feature engineering, and model evaluation metrics.
ā¢ Experience building and scaling large products or systems.
ā¢ Experience with building privacy and ads-related products is a big plus.
ā¢ Experience working with human labeling and annotation systems including workflow design, quality assurance, and vendor management in data collection operations.
ā¢ Prior experience working with the company or its internal tools is a plus.
Compensation & Legal
ā¢ Hourly contractor, Paid weekly via Stripe Connect.
Application Process (Takes 20ā30 mins to complete)
ā¢ Upload resume
ā¢ AI interview based on your resume
ā¢ Submit form
Resources & Support
ā¢ For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
ā¢ For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Apply tot his job
Apply To this Job