Senior Software Engineer, Data & AI Engineering (US) Job at Scrunch Ai, United States

WDJuMGVtK3lyZVM3MGlIVG9Rdy94TllJdHc9PQ==
  • Scrunch Ai
  • United States

Job Description

The Scrunch product involves acquiring and processing a lot of data, both using LLMs and more traditional analytics methods. In this role you will play a huge part in successfully delivering our roadmap and ultimately in giving our customers the tools they need to succeed in the AI era.

Because we are a small organization, this is a full stack role. While most of your work will be focused on building features related to our data pipelines, usage of LLMs, analytics APIs, etc., you'll need to do whatever is necessary to deliver value to our customers. This can include some light React work but also work creating notifications, alert emails, scheduled reports, connectors into third party systems, etc.

This role is open to candidates located in and legally authorized to work in the US. Scrunch is a remote organization, but in-office or hybrid work is possible for candidates based in the NYC or Salt Lake City metro areas (and we love to jam in person from time to time!)

For this role, we'd like to see candidates that:

  • Have extensive experience building & using web APIs, including handling authentication, authorization, caching, rate limiting, etc.

    • Experience building API for external customers is a big plus.

  • Experience with relational (transactional) databases, particularly PostgreSQL.

  • Experience with analytics tools and technologies, such as:

    • Analytical SQL, maybe with a modern analytical data platform like Snowflake, Google BigQuery, DuckDB, Spark SQL, etc.

    • Experience with analytics packages like Pandas or Polars is a plus.

    • Experience with streaming analytics is a plus.

  • Experience writing batch and streaming/interactive data processing pipelines. This could mean any of:

    • Big data tools like Flink, Beam (GCP Dataflow), Spark, etc.

    • Job queues and task processing frameworks (Celery, Resque, or cloud-based options like Google Cloud Tasks)

    • Multi-step durable execution frameworks like Temporal or Inngest

    • In-house or home-rolled versions of any of the above you've used at previous companies.

  • The ability to quickly understand source data and validate output data quality

  • Experience using LLMs and/or traditional ML techniques to build classifiers, data extractors, summarizers, etc.

    • Not required but a big plus: experience building evals for LLM-based tools to assess and improve accuracy at these kinds of tasks

Scrunch AI is an equal opportunity employer. We welcome people of all backgrounds, experiences, perspectives, and identities. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Job Tags

Remote job, Full time, Work at office,

Similar Jobs

University of California - Los Angeles (UCLA)

CGI - Administrator of Strategic Partnerships and Engagement Job at University of California - Los Angeles (UCLA)

CGI - Administrator of Strategic Partnerships and Engagement Recruit, retain, and sustain strategic partnerships focused on the teaching and learning of mathematics (early childhood-elementary/span) with public and private local education agencies, school districts, individual... 

Sodexo

Executive Chef 2 Job at Sodexo

 ...healthcare sites play a crucial role in enhancing patient experience and well-being What You'll Do: implement and standardize all culinary systems and procedures for hospital be responsible for Food and Physical Safety and annual training for all hourly associates... 

Lovelace Medical Center

Registered Nurse / RN ICU Job at Lovelace Medical Center

 ...bonus of up to $20,000. You may also be eligible for relocation assistance. Join our team as a day or night shift, full-time, Intensive Care Unit (ICU) Registered Nurse in Albuquerque, NM. Why Join Us? Thrive in a People-First Environment and Make Healthcare Better... 

Fresh Express

Stand Up Forklift Operator 1st Shift Job at Fresh Express

 ...Stand Up Forklift Operator 1st Shift Stand Up Forklift Operator - 1st Shift 7am to 4pm Job Responsibilities: Receivers will unload live and drop trailers and transfer items to the various stockrooms around the warehouse to be racked. Inventory control forklift... 

University of California - San Francisco

Network Security Engineer Flexible, Impactful Enterprise Security (San Francisco) Job at University of California - San Francisco

 ...A leading research university in San Francisco is seeking a Network Security Engineer to enhance the security framework and integrity of its IT infrastructure. The role involves managing various network security solutions, troubleshooting issues, and collaborating with...