Performance Across Systems
We run each generated benchmark across 8 systems. We then perform analysis to determine the lower bound latency for each system. The results are shown bellow for each model.
ArcFace Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
BVLC AlexNet Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
BVLC CaffeNet Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
BVLC GoogleNet Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
BVLC RCNN ILSVRC13 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
DenseNet-121 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
DUC Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
Emotion-FerPlus Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
Inception-v1 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
Inception-v2 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
MNIST Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
MobileNet-v2 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet018-v1 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet018-v2 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet034-v1 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet034-v2 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet050-v1 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet050-v2 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet101-v1 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet101-v2 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet152-v1 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
ResNet152-v2 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
Shufflenet Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
Squeezenet-v1.1 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
Tiny YOLO-v2 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
VGG16 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
VGG16-BN Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
VGG19 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
VGG19-BN Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
Zfnet512 Model
Parallel Recall
Serial Recall
Serial Recall using CUDNN Advised Algorithm
