Senior Data Engineer
Company: Sightly Enterprises, Inc.
Location: New York, New York, United States
Work arrangement: Fully remote
Employment type: Full-time
Experience: 5-10 years
Posted: 2026-11-18
Responsibilities
The Senior Data Engineer will own and optimize API ingestion pipelines and the Snowflake platform to ensure reliable, fast, and cost-efficient data processing. They will collaborate directly with business users to gather requirements and iterate on data solutions to support reporting and billing.
Requirements
Candidates must have 5+ years of data engineering experience with strong proficiency in Python, SQL, and Airflow. The role requires experience managing Snowflake, integrating third-party REST APIs, and working directly with business stakeholders to deliver data-driven solutions.
Skills
- Python
- SQL
- Airflow
- Snowflake
- Data Engineering
- API Integration
- Google Cloud Platform
- dbt
- Apache Iceberg
- OpenSearch
- CI/CD
- Git
- Data Pipelines
- Cloud Composer
- Data Modeling
- Cost Management
About this role
ABOUT THE COMPANY
Sightly is a growing technology company leading the revolution in real-time marketing and brand intelligence. Join us as we pursue our disruptive mission to empower businesses everywhere to make the most authentic + profitable decisions in real time.
Our AI-driven Brand Mentality® platform enables any brand (or agency) to leverage an ever-changing ocean of news, social, media and audience data to make more intelligent decisions at the speed of culture. At Sightly, we're passionate about our product, our customers, our impact on the world, and most importantly, our team.
We are a small company with a strong collaborative ethic, so there will be opportunities to get involved with projects that will help expand your skillset and knowledge. Professionals who take the initiative, can work without a lot of supervision, can begin projects independently, and have good communication skills will excel in this position.
WHY THIS ROLE EXISTS
Everything Sightly sells runs on data our pipelines collect every day: YouTube videos and channels, TikTok trends, social posts, news, and campaign performance from the ad platforms our clients buy on. That data lands in Snowflake and powers Brand Mentality, SmartLists, client reporting and automated billing. We need a senior data engineer to own those ingestion pipelines and the Snowflake platform underneath them, and to keep them reliable, fast and cost-efficient as volume grows.
Just as important, this person works directly with the people who use our data (account managers, sales, strategy and clients) to gather requirements and iterate quickly. AI has raised the bar for what one engineer can do, and we want someone who uses it to move fast and stretch beyond a traditional data engineering lane.
Note: This is a full-time position based remotely, reporting to our Director of Data.
WHAT YOU'LL DO
* Own API ingestion pipelines: build and run Python pipelines and Airflow DAGs that pull from YouTube, TikTok, Meta, Google Ads, DV360, social and news sources, handling quotas, rate limits, retries and credential rotation.
* Run our Snowflake platform: manage warehouses, roles and access, partner data sharing, and cost. Tune schedules and storage (including our Iceberg migration) so we pay only for what we use.
* Keep reporting and billing data trustworthy: maintain the ad-platform performance pipelines that feed client reports, our Reporting API and automated billing.
* Lead on reliability and design: own alerting, data freshness and pipeline health, lead the response when something breaks, and shape how our data platform evolves as volume and use cases grow.
* Work directly with users: sit with account managers, sales and strategy to understand what they need, turn requests into clear requirements, and ship iterations in days, not weeks. Partner with analytics and product engineers on dbt models and on serving data to the app (Postgres, OpenSearch).
* Make it easy for others to contribute: document pipelines, tables and runbooks, and help build safe, AI-assisted paths (sandboxed environments, tests, CI/CD guardrails) so PMs and account managers can contribute to production data workflows.
WHAT YOU BRING (MUST-HAVES)
* 5+ years of data engineering experience running production pipelines, including owning systems end to end and making architecture decisions.
* Experience working directly with business users or clients: gathering requirements, explaining tradeoffs, and iterating quickly on feedback.
* Strong Python and SQL.
* Deep experience with Airflow (or a similar orchestrator) in production.
* Experience with Snowflake (or BigQuery or Redshift), including administration: warehouses, access control, cost management.
* A track record of integrating third-party REST APIs at volume, with their quotas, pagination and failures.
* Experience on a major cloud platform, ideally GCP.
* At least working familiarity with Elasticsearch or OpenSearch; deep expertise is a big plus.
* Uses AI coding tools (such as Claude) as a core part of how you build, not an afterthought.
* Comfortable with Git, code review and CI/CD.
NICE TO HAVE
* Hands-on dbt experience, ideally on Snowflake: building and testing models, and keeping build times and warehouse costs down.
* GCP data services: Cloud Composer, Dataflow, Cloud Storage.
* Apache Iceberg.
* Experience with ad platform APIs (Google Ads, DV360, Meta, TikTok) or YouTube data.
* High-performance data processing in Python.
OUR STACK
Python, Airflow on Cloud Composer, Snowflake, dbt, Apache Iceberg, Dataflow, Cloud Storage, Postgres, OpenSearch, GitLab, all on Google Cloud.
ADDITIONAL QUALITIES WE'RE LOOKING FOR
* Knowledge of or experience in the digital advertising and/or marketing field
* Self-starter who seeks out unfamiliar, uncomfortable problems and learns fast
* Client-minded communicator who enjoys working with non-technical people and can explain data in plain terms
* Collaborative mentality, with a habit of mentoring teammates and raising the bar on code and design
* Comfortable working in a fast-paced and dynamic environment
LOCATION
* This is a remote position.
About Sightly Enterprises, Inc.
Marketing Services · 51-200 employees · headquartered in New York, New York · founded 2013