Data Pipeline Engineer – SQL Expert

About this role

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Software Engineer II
Type: Full-Time
Compensation: $70–$95/hour
Location: Remote

Role Responsibilities

• Drive technical implementation and testing of complex data pipeline features within the **SPECTRA** platform. Ensure robust end-to-end functionality and meet project release timelines.
• Design and develop data processing pipelines using **SQL** and **Python**. Handle large-scale data collection, transformation, and quality monitoring workflows.
• Build and maintain dashboards and visualization tools. Provide visibility into data quality, rater performance, and platform metrics for stakeholders across multiple teams.
• Create comprehensive end-to-end tests and monitoring alerts. Ensure platform reliability, data integrity, and proactive identification of issues in the data collection workflow.
• Debug and troubleshoot complex data flow issues across the **SPECTRA** platform. Identify root causes and implement solutions to maintain high system availability.
• Collaborate closely with Technical Leads and engineering teams. Implement backend data processing logic and ensure adherence to development standards and best practices.

Qualifications

Must-Have

• Experience in **SQL** development writing complex queries, data transformations, and working with large datasets in production environments.
• Proficient in **Python** with experience in data processing, automation, and pipeline development using object-oriented programming principles.
• Experience with data engineering pipelines including **ETL** processes, data modeling, and building scalable data processing workflows.
• Hands-on experience with data visualization and dashboard tools s...