Back end Software Engineer (web scraping/data acquisition)

About this role

100% Remote

Compensation: $170K-$200K base + 10%

Client: Sports and ticket data leader

Size: late stage startup, 400 employees, heavily revenue positive

As a member of our data ingestion team, you will envision, create, test, and maintain code for several highly transactional services. Your role will involve designing robust and scalable data acquisition strategies, ensuring the efficient and reliable flow of data from diverse sources into our systems.

Technical Qualifications

● Must have 10 years of Software Development experience

● Must have 2+ years of experience with
TypeScript/NodeJS
and deep understanding of writing well-typed, object-oriented code

● Must have experience running container based applications
(Docker, Docker Compose)

● Must have 2+ years experience leveraging HTTP knowledge and client skills, e.g. got, cURL, axios ● Must be highly proficient in unit testing methodologies, e.g. with Jest or Vitest

● Must have hands on experience coding applications that run and reside on AWS hosted solutions

Related Qualifications

● Experience with Dependency Injection/DI containers

● Knowledge about best practices relative to end-to-end testing with
e.g. Playwright, Puppeteer, Cypress, Selenium

● Experience with
Redis/Elasticache

● Experience with
DynamoDB

● Broad Linux knowledge

● Hands on experience setting up Monitoring/observability platforms, e.g.
Datadog, New Relic

● Must be familiar with using LLMs to increase engineering velocity while still maintaining high coding standards and developer-friendly code

Nice to haves

● Experience with man-in-the-middle techniques (Proxyman, HTTP Toolkit, Wireshark), reverse engineering, understanding decompiled code

● Understanding of fingerprinting techniques (browser, OS, networking stack, etc.) ● Work experience running applications on ECS/EKS

● Has utilized and written Serverless functions (Lambda)

● Knowledgeable about Queueing systems, e.g. SQS, BullMQ

...