Computer Vision

A service for quick deploying and using dockerized Computer Vision models

Inferoxy

Inferoxy is a service for quick deploying and using dockerized Computer Vision models. It’s a core of EORA’s Computer Vision platform Vision Hub that runs on top of AWS EKS.

Why use it?

You should use it if:

  • You want to simplify deploying Computer Vision models with an appropriate Data Science stack to production:
    all you need to do is to build a Docker image
    with your model including any pre- and post-processing steps and push it into an accessible registry
  • You have only one machine or cluster for inference (CPU/GPU)
  • You want automatic batching for multi-GPU/multi-node setup
  • Model versioning

Architecture

inferoxy-general

Inferoxy is built using message broker pattern.