INT8 Quantization Service
Kenosis is Core Epoch's quantizer for ONNX computer vision models. It converts a model to 8-bit integers (INT8) without retraining, and the same file runs on ONNX Runtime and OpenVINO. The models below are free to download, and we quantize customers' models as a service.
Every model below was quantized with Kenosis by Core Epoch, with no retraining, and keeps 94.9% to 99.96% of its original accuracy. Speeds are ONNX Runtime on one thread, measured on a CPU with AVX-VNNI.