Data Pipeline Engineer – SQL Specialist

About this role

About The Job
Mercor
connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
Benchmark
,
General Catalyst
,
Peter Thiel
,
Adam D'Angelo
,
Larry Summers
, and
Jack Dorsey
.


Position:
Software Engineer II


Type:
Full-Time
Compensation:
$70–$95/hour
Location:
Remote
Role Responsibilities

• Drive technical implementation and testing of complex data pipeline features within the SPECTRA platform. Ensure robust end-to-end functionality and meet project release timelines.
• Design and develop data processing pipelines using SQL and Python. Handle large-scale data collection, transformation, and quality monitoring workflows.
• Build and maintain dashboards and visualization tools. Provide visibility into data quality, rater performance, and platform metrics for stakeholders across multiple teams.
• Create comprehensive end-to-end tests and monitoring alerts. Ensure platform reliability, data integrity, and proactive identification of issues in the data collection workflow.
• Debug and troubleshoot complex data flow issues across the SPECTRA platform. Identify root causes and implement solutions to maintain high system availability.
• Collaborate closely with Technical Leads and engineering teams. Implement backend data processing logic and ensure adherence to development standards and best practices.

Qualifications
Must-Have

• Experience in SQL development writing complex queries, data transformations, and working with large datasets in production environments.
• Proficient in Python with experience in data processing, automation, and pipeline development using object-oriented programming principles.
• Experience with data engineering pipelines including ETL processes, data modeling, and building scalable data processing workflows.
• Hands-on experience with data visualization and dashboard tools such as Tableau or si...