Simple example of FastAPI + Celery + Triton for benchmarking
You can see the previous work from:
with Triton Server
without Triton Server
Benchmark Results
Preparation
1. Setup packages
Install Anaconda and execute the following commands:
$ make env # create a conda environment (need only once)
$ source init.sh # activate the env
$ make setup # setup packages (need only once)
2. Train a CNN model (Recommended on GPU)
3. Check the model repository