W

AI Automation Engineer

WSC Sports
Full-time
Remote
Israel, Israel

WSC Sports AI based products are used for automatic content creation that impacts millions of sport fans around the globe. Our AI teams create innovative algorithms using cutting edge technologies.

We are looking for an automation engineer to lead the evaluation and quality efforts of our ML algorithms and services. As part of the role you will design and implement both automatic and manual tests for evaluating the quality of our data and ml algorithms.

What You Will Do

  • Set, design and implement quality standards and processes.
  • Design and implement automated tests and visualisations to run periodically and/or upon updates
  • Define and conduct tests to ensure the quality of algorithms services in terms of run time, integration, error handling and scale under different environments and constant changes.
  • Define and conduct tests to ensure the accuracy of algorithms in production.
  • Identify weak spots and monitor algorithms’ stability in order to ensure the service hits its objectives for a wider range of systems and longer periods of time as data drifts.
  • Adopting and incorporating third-party open source libraries e.g. for evaluating LLMs.
  • Monitor our production systems and be the POC for issues.

Required Skills

  • B.Sc in computer science / relevant engineering
  • 2+ years of experience in Python development
  • Understanding of statistics (Advantage)
  • Independent, proficient, autodidact
  • Experience with developing and maintaining tests framework
  • Experience with relational SQL database
  • Understanding of QA processes: test case planning, feature ownership, automation reporting and triage, bug reporting, regression & isolation

Example for concrete Tasks

  • Magicrop / Audio Piracy / Auto-Press / Recap new systems or ongoing data evaluation tool
  • Run a regression test for every new version of a model (e.g. S2T, Subtitle)
  • Create an automation to run a stress test for any new model
  • Facilitate the evaluation of the recap service (with operations)

This job is closed.