Task type

Topology name

Framework

Input blob sizes

Batch size

CPU: Intel(R) Core(TM) i3-8100 CPU @ 3.60GHz, CPU family: x86_64, GPU: Intel(R) Gen9 HD Graphics, RAM size: 32807376 kB, OS family: Linux, OS version: Linux-5.0.0-32-generic-x86_64-with-Ubuntu-18.04-bionic, Python version: 3.6.8

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

GPU

FP32
Latency Mode

FP16
Latency Mode

CPU: Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz, CPU family: x86_64, GPU: Intel(R) Gen9 HD Graphics, RAM size: 65826404 kB, OS family: Linux, OS version: Linux-5.0.0-32-generic-x86_64-with-debian-buster-sid, Python version: 3.7.3

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

GPU

FP32
Latency Mode

FP16
Latency Mode

CPU: Intel(R) Core(TM) i5-8600K CPU @ 3.60GHz, CPU family: x86_64, GPU: Intel(R) Gen9 HD Graphics, RAM size: 32789776 kB, OS family: Linux, OS version: Linux-4.15.0-66-generic-x86_64-with-Ubuntu-16.04-xenial, Python version: 3.5.2

OpenVINO DLDT

CPU

FP32
Latency Mode	Throughput Mode

INT8
Latency Mode	Throughput Mode

GPU

FP32
Latency Mode

FP16
Latency Mode

MYRIAD

FP16
Throughput Mode

Classification

alexnet

caffenet

densenet-121

densenet-161

densenet-169

densenet-201

googlenet-v1

googlenet-v2

googlenet-v3

googlenet-v4

inception-resnet-v2

mobilenet-v1-0.25-128

mobilenet-v1-0.50-160

mobilenet-v1-0.50-224

mobilenet-v1-1.0-224

mobilenet-v2

resnet-50

resnet-101

resnet-152

se-inception

se-resnet-50

se-resnet-101

se-resnet-152

se-resnext-50

se-resnext-101

squeezenet1.0

squeezenet1.1

vgg16

vgg19

Caffe

TensorFlow

Caffe

1x3x227x227

1x3x224x224

1x3x299x299

1x3x128x128

1x3x160x160

1x3x224x224

1x3x227x227

1x3x224x224

86.673

107.441

174.001

183.993

230.904

215.273

236.469

215.749

N/A

121.662

175.864

200.689

201.923

156.05

269.036

300.7

321.497

88.785

112.75

182.765

193.775

245.869

230.108

252.083

230.975

N/A

123.297

181.037

206.927

208.02

157.527

275.111

307.804

330.133

58.87

54.853

44.154

45.769

41.535

45.544

41.193

45.552

N/A

31.343

35.829

36.578

36.942

42.33

42.341

44.292

44.72

20.459

19.851

17.165

17.657

16.676

17.707

16.624

17.742

N/A

13.03

13.567

14.242

14.346

18.429

18.297

19.053

19.105

47.756

45.39

36.211

36.969

33.494

36.725

33.186

36.788

N/A

24.002

28.693

29.893

30.213

31.252

34.716

36.482

36.829

37.332

34.958

26.776

27.622

25.037

27.553

24.842

27.594

N/A

18.216

21.799

22.761

23.001

23.616

27.259

28.506

28.618

104.808

98.803

110.967

101.941

110.449

102.664

110.62

102.842

N/A

72.004

83.854

86.366

86.855

92.762

116.379

126.35

130.096

87.476

83.015

94.485

86.021

94.282

86.699

94.454

86.833

N/A

61.694

67.705

70.726

71.226

92.602

93.018

116.511

120.473

32.591

30.385

34.194

30.86

34.273

30.992

34.338

31.028

N/A

21.712

22.577

22.482

22.226

33.171

31.692

40.36

40.035

15.682

14.267

16.155

14.409

16.214

14.475

16.232

14.483

N/A

10.413

10.129

9.996

9.959

17.585

14.644

21.328

20.314

14.439

13.336

15.296

13.431

15.418

13.529

15.451

13.538

N/A

9.696

9.24

9.126

9.042

16.169

13.715

19.655

18.448

3167.903

4331.294

5077.85

4988.237

4752.079

5036.667

4547.364

5081.238

N/A

464.28

840.573

2444.411

2537.233

436.998

597.596

1864.342

1924.31

1166.38

1224.777

1543.726

1464.174

1375.689

1487.532

1375.041

1507.441

N/A

257.62

689.853

729.924

739.702

343.965

600.409

636.577

640.042

691.844

673.893

756.361

777.206

728.783

799.454

730.664

801.545

N/A

153.298

367.45

385.35

389.376

241.274

306.299

315.662

317.274

262.308

252.511

275.757

255.28

279.111

256.467

280.89

257.068

N/A

175.906

141.835

145.927

146.608

160.088

137.054

24.625

20.292

289.402

287.299

330.257

310.433

322.304

315.587

324.284

317.93

N/A

63.681

129.996

134.468

135.103

86.586

95.93

15.588

13.896

51.527

47.858

55.986

49.487

56.601

49.801

56.861

49.88

N/A

37.389

38.487

39.976

40.285

67.8

53.492

75.045

78.207

25.966

23.905

27.946

24.52

28.255

24.663

28.357

24.642

N/A

18.571

19.205

19.99

20.186

34.267

28.576

37.291

38.848

17.475

15.967

18.622

16.311

18.831

16.411

18.909

16.42

N/A

12.396

12.789

13.328

13.461

22.974

19.406

24.75

25.788

77.273

74.143

78.117

74.515

74.815

75.071

74.512

75.276

N/A

55.225

60.147

62.435

62.851

79.462

81.86

77.257

73.773

37.404

34.028

34.008

34.03

33.515

34.358

33.5

34.49

N/A

27.838

27.516

27.719

27.898

46.204

38.217

52.112

52.1

19.934

18.505

18.774

18.396

18.473

18.566

18.477

18.604

N/A

14.698

14.853

14.832

14.954

24.67

21.897

28.431

28.987

13.728

12.606

12.742

12.475

12.505

12.601

12.507

12.622

N/A

9.896

10.049

9.99

10.074

16.698

15.026

19.267

19.801

29.818

27.273

27.259

27.076

27.02

27.178

27.008

27.204

N/A

13.938

15.294

15.549

15.638

17.417

19.583

3.228

N/A

17.556

16.047

16.359

15.774

16.164

15.854

15.861

15.865

N/A

7.293

8.246

8.415

8.464

9.352

11.052

N/A

202.761

182.712

194.886

187.403

191.714

188.123

191.773

188.388

N/A

134.132

140.441

144.11

144.871

172.095

202.06

219.23

N/A

407.293

371.252

383.05

391.023

371.061

392.618

370.779

393.629

N/A

198.453

269.101

281.022

283.661

138.838

300.581

392.091

N/A

11.296

11.178

13.117

11.89

13.586

12.057

13.612

12.065

N/A

10.01

11.122

11.372

11.398

22.703

18.009

18.317

N/A

9.259

8.96

10.474

9.393

10.77

9.503

10.78

9.512

N/A

7.973

8.833

9.012

9.032

19.243

14.494

14.74

N/A

104.307

130.175

268.554

314.284

360.224

415.423

372.09

424.983

N/A

134.991

200.108

226.745

229.879

182.742

303.077

343.231

365.832

106.091

130.323

278.243

323.337

379.68

435.265

394.691

439.887

N/A

137.635

204.474

233.935

237.484

183.928

307.63

352.723

374.877

86.603

100.172

69.404

66.388

59.253

63.594

57.292

63.308

N/A

35.364

40.855

41.46

41.866

47.497

47.293

49.347

49.82

31.693

34.104

26.437

27.414

24.317

27.644

23.987

27.726

N/A

14.996

16.196

16.405

16.434

21.176

21.174

21.497

21.476

68.705

83.084

57.553

53.34

47.567

50.908

45.792

50.78

N/A

27.064

32.982

33.851

34.256

35.106

38.871

40.689

41.067

53.375

65.232

42.361

38.608

34.933

37.487

33.881

37.448

N/A

20.733

25.052

25.786

26.097

26.928

30.521

31.882

31.979

156.802

182.335

177.4

189.619

171.291

193.514

170.436

194.429

N/A

82.614

95.457

98.019

98.509

104.748

130.338

147.852

148.131

130.323

149.247

150.243

155.685

146.518

158.197

145.426

159.355

N/A

69.614

77.309

80.601

81.055

104.289

103.623

132.578

137.19

50.575

55.197

53.963

56.1

53.237

57.266

53.238

57.764

N/A

24.674

25.582

25.31

24.999

37.116

35.337

45.668

45.228

24.43

26.302

25.499

26.246

25.387

26.838

25.387

27.126

N/A

11.909

11.487

11.297

11.193

19.883

16.387

24.223

23.186

22.286

24.232

24.277

24.373

23.996

25.024

24.117

25.298

N/A

11.168

10.585

10.153

10.065

18.341

15.319

21.719

21.159

3339.414

5652.434

7760.044

9726.777

8019.702

7973.408

6194.712

7015.295

N/A

500.723

1384.202

2743.448

2845.978

451.924

1779.415

2043.603

2127.578

1671.037

2063.745

2393.155

2595.545

1995.18

2204.775

1917.355

2235.218

N/A

278.506

778.29

819.725

827.131

377.101

659.78

706.376

712.233

1093.121

1301.525

1208.515

1197.05

1007.671

1136.877

988.995

1155.06

N/A

161.028

416.272

434.442

438.44

260.986

338.399

350.319

351.135

374.759

449.203

429.156

452.634

411.969

477.027

415.794

488.34

N/A

191.024

160.78

164.969

165.833

279.434

152.128

27.569

24.707

411.832

483.046

494.036

478.485

451.737

483.256

443.166

488.289

N/A

181.768

147.896

151.647

152.425

187.824

107.232

17.135

15.517

76.844

85.984

87.708

90.167

87.659

92.694

87.777

94.292

N/A

42.534

43.649

45.375

45.769

76.506

59.858

85.169

88.767

39.153

43.386

44.375

44.72

44.327

45.82

44.326

46.516

N/A

20.971

21.668

22.708

22.957

38.526

32.158

42.414

44.16

26.353

29.158

29.67

29.724

29.606

30.418

29.626

30.838

N/A

13.965

14.44

15.147

15.307

25.919

21.881

28.161

29.325

114.028

135.495

129.815

128.637

113.013

128.138

110.413

128.652

N/A

62.55

68.562

71.032

71.439

88.712

91.516

93.357

88.301

57.031

59.457

51.378

53.052

47.926

54.07

47.388

54.499

N/A

31.994

31.213

31.286

31.514

52.186

42.711

59.403

61.14

30.573

34.049

29.54

30.158

27.012

30.571

26.723

30.848

N/A

16.688

16.812

16.748

16.887

27.884

24.639

32.312

33.505

21.02

23.65

20.234

20.514

18.368

20.706

18.148

20.796

N/A

11.238

11.388

11.279

11.362

18.892

16.918

21.898

22.735

46.198

48.508

41.517

42.774

39.607

43.965

39.308

44.498

N/A

15.61

17.08

17.342

17.432

19.365

21.676

3.73

N/A

26.843

30.311

25.817

25.688

23.991

26.487

23.837

26.825

N/A

8.141

9.237

9.385

9.424

10.433

12.268

N/A

331.435

333.385

308.372

315.73

284.732

322.216

282.012

324.295

N/A

150.113

158.528

161.74

162.693

229.636

223.132

246.183

N/A

663.446

675.104

601.841

608.134

535.498

608.617

524.042

617.202

N/A

266.085

304.52

314.203

317.487

145.107

328.036

458.403

N/A

16.96

19.133

20.795

22.137

21.56

22.773

21.65

22.902

N/A

11.345

12.684

12.961

13.004

25.945

20.292

20.679

N/A

14.077

15.583

16.633

17.469

17.115

17.943

17.179

18.062

N/A

9.035

10.083

10.277

10.306

21.913

16.351

16.642

N/A

90.545

104.145

222.701

246.217

323.368

302.64

339.425

308.869

N/A

123.253

183.65

214.25

217.48

163.597

284.232

356.022

350.426

57.638

60.596

61.092

N/A

92.288

107.821

232.021

259.516

342.738

325.429

360.037

332.729

N/A

124.395

189.628

221.767

225.198

165.176

289.862

367.527

360.788

56.787

59.615

60.043

N/A

80.388

79.46

56.449

53.675

49.76

50.941

48.809

50.565

N/A

33.655

34.177

33.974

34.309

44.917

52.593

54.936

55.647

37.328

35.062

33.445

N/A

28.296

27.556

21.884

21.614

20.704

21.191

20.582

21.194

N/A

14.316

12.922

13.142

13.19

19.834

22.417

22.905

23.038

10.585

10.633

11.412

N/A

64.027

65.172

46.734

43.73

39.918

40.803

39.063

40.548

N/A

25.764

27.553

28.066

28.33

33.105

42.152

44.265

44.79

27.146

26.36

26.281

N/A

49.696

51.277

33.709

31.781

29.419

30.169

28.914

30.018

N/A

19.887

21.004

21.516

21.773

25.509

32.518

33.962

34.347

19.463

18.981

18.901

N/A

143.882

134.095

160.747

143.738

155.997

143.874

155.74

143.79

N/A

75.591

85.935

87.445

87.818

99.109

129.521

145.995

139.375

88.022

80.812

78.462

N/A

120.177

112.326

138.254

123.247

135.238

122.863

135.146

122.173

N/A

65.998

69.708

71.838

72.389

95.564

106.497

135.496

128.827

74.26

72.585

70.055

N/A

46.721

44.134

49.633

44.44

49.672

43.988

49.262

44.243

N/A

23.478

24.227

23.879

23.66

36.925

33.45

45.131

42.863

20.028

20.411

20.113

N/A

22.806

20.837

23.81

20.92

23.909

20.591

23.961

20.744

N/A

11.324

10.962

10.742

10.624

18.809

15.588

23.753

22.146

10.498

10.204

9.151

N/A

21.009

19.428

22.479

19.642

22.712

19.355

22.906

19.554

N/A

10.696

10.064

9.703

9.528

17.316

14.376

20.911

20.397

7.559

7.615

7.132

N/A

3218.959

3949.219

6325.654

6389.271

5593.104

5704.239

5131.236

5341.607

N/A

808.151

1881.592

2308.427

2409.827

1182.994

2054.898

2503.595

2631.978

327.307

544.348

586.33

N/A

1377.892

1413.691

1977.279

1840.477

1667.684

1717.747

1622.403

1764.14

N/A

544.573

663.82

721.438

729.099

N/A

717.312

790.53

802.606

256.012

309.77

313.494

N/A

870.368

869.666

984.145

912.255

849.512

915.016

843.198

911.348

N/A

365.135

338.554

357.478

361.438

486.071

422.983

446.977

447.688

183.477

195.024

195.4

N/A

330.286

339.046

377.29

355.819

378.042

356.007

382.079

356.371

N/A

172.336

129.136

132.474

133.247

255.454

183.415

29.655

24.394

111.856

115.508

116.791

N/A

365.357

391.78

424.004

387.423

392.982

389.9

389.392

387.615

N/A

166.918

122.909

126.785

127.743

N/A

144.849

16.349

14.71

70.876

73.093

73.011

N/A

71.142

67.363

80.402

72.026

81.838

71.078

82.383

71.677

N/A

40.044

35.507

30.953

31.178

68.318

59.112

84.805

83.131

35.188

35.66

32.046

N/A

36.417

35.124

41.352

36.095

42.033

35.468

41.853

35.782

N/A

17.691

15.95

16.114

35.449

31.757

42.49

41.352

16.516

16.597

16.241

N/A

24.676

23.777

27.851

24.118

28.278

23.572

28.373

23.823

N/A

13.371

11.812

10.863

10.965

23.97

21.597

28.285

27.479

10.943

11.029

10.672

N/A

104.046

102.022

111.913

100.992

97.996

97.731

96.642

97.185

N/A

59.279

62.548

64.423

64.991

N/A

88.209

92.168

80.503

39.816

40.83

40.909

N/A

51.306

45.861

42.775

42.843

40.723

41.988

40.599

42.218

N/A

30.362

27.885

25.39

25.534

48.268

36.929

58.438

55.506

16.485

16.478

16.204

N/A

27.446

26.162

24.741

23.996

23.217

23.541

23.086

23.65

N/A

15.995

15.121

14.15

14.272

26.161

21.249

31.916

30.655

8.489

8.472

8.434

N/A

19.075

18.138

16.973

16.309

15.808

15.987

15.703

16.071

N/A

10.816

10.268

9.693

9.762

17.705

14.604

21.662

20.881

5.852

5.599

5.641

N/A

40.674

37.039

34.729

34.032

33.786

33.821

33.749

33.909

N/A

13.277

14.548

12.815

12.88

17.301

20.689

3.438

N/A

13.369

12.092

12.179

N/A

23.826

23.094

21.636

20.405

20.668

20.297

20.605

20.298

N/A

7.112

7.987

7.508

7.535

9.554

11.572

N/A

7.33

6.827

6.481

N/A

295.561

246.38

269.952

247.688

251.587

246.16

250.462

245.72

N/A

136.627

149.949

155.352

156.509

208.693

208.715

242.223

N/A

155.763

162.297

164.832

N/A

553.923

492.389

500.521

482.838

454.495

476.782

448.985

478.593

N/A

246.463

267.57

285.611

289.917

350.988

335.776

412.376

N/A

233.518

283.594

286.729

N/A

15.212

14.965

19.401

17.151

20.358

17.906

20.473

18.009

N/A

10.765

11.937

12.219

12.271

25.214

20.537

20.972

N/A

9.166

8.547

8.38

N/A

12.742

12.173

15.592

13.656

16.197

14.143

16.276

14.285

N/A

8.604

9.511

9.721

9.746

21.056

16.407

16.723

N/A

6.905

6.831

6.772

N/A

Segmentation

deeplabv3

road-segmentation-adas-0001

semantic-segmentation-adas-0001

TensorFlow

OpenVINO DLDT

1x3x513x513

1x3x512x896

1x3x1024x2048

15.824

15.433

15.269

15.463

N/A

6.769

7.241

N/A

27.216

26.82

23.193

24.05

22.875

24.109

22.871

24.13

N/A

14.075

13.323

13.426

13.335

21.015

11.133

N/A

3.816

3.945

3.804

3.901

3.826

N/A

3.778

N/A

3.663

3.67

N/A

24.388

23.731

21.792

23.785

21.602

N/A

8.641

8.418

N/A

39.731

36.476

26.76

26.506

25.548

26.373

25.586

26.372

N/A

15.86

14.814

14.984

14.973

24.602

12.267

N/A

5.248

5.583

5.151

5.514

5.081

5.508

5.047

N/A

4.204

4.275

N/A

20.622

19.255

18.847

19.003

18.805

N/A

7.362

7.53

N/A

2.775

2.8

N/A

29.349

29.856

20.534

22.991

20.172

22.754

20.188

22.755

N/A

13.851

12.631

12.753

12.786

20.484

14.874

N/A

4.449

N/A

4.406

4.81

4.419

0.405

4.379

N/A

3.8

3.833

N/A

Object detection

ssd300

ssd512

mobilenet-ssd

ssd_mobilenet_v1_coco

ssd_mobilenet_v1_fpn_coco

ssd_mobilenet_v2_coco

pedestrian-and-vehicle-detector-adas-0001

vehicle-detection-adas-0002

person-vehicle-bike-detection-crossroad-0078

person-vehicle-bike-detection-crossroad-1016

vehicle-license-plate-detection-barrier-0106

face-detection-adas-0001

face-detection-retail-0004

face-detection-retail-0005

person-detection-retail-0013

pedestrian-detection-adas-0002

Caffe

TensorFlow

OpenVINO DLDT

1x3x300x300

1x3x512x512

1x3x300x300

1x3x640x640

1x3x300x300

1x3x384x672

1x3x1024x1024

1x3x512x512

1x3x300x300

1x3x384x672

1x3x300x300

1x3x320x544

1x3x384x672

6.442

5.768

6.447

5.775

6.45

5.774

6.446

5.772

N/A

4.787

4.957

4.911

4.895

N/A

2.232

1.996

2.223

1.994

2.222

1.993

2.223

N/A

1.81

1.829

N/A

136.578

130.75

138.406

131.339

140.142

131.949

140.465

132.169

N/A

85.446

75.743

76.188

76.023

81.984

77.394

78.851

N/A

117.621

115.697

117.267

116.215

118.257

116.568

118.669

117.444

N/A

68.118

65.514

65.976

66.069

80.166

68.021

69.549

N/A

3.105

2.873

3.086

2.867

3.095

2.874

3.097

2.874

N/A

2.246

2.318

2.285

N/A

75.718

76.746

81.453

78.825

81.578

79.707

81.88

79.873

N/A

43.039

47.967

48.857

48.852

64.431

50.195

51.286

N/A

72.98

69.457

67.58

69.576

66.679

69.408

66.64

69.903

N/A

40.628

36.4

36.957

36.902

67.675

34.976

35.37

35.427

97.571

94.8

90.244

95.249

91.069

94.968

90.297

95.565

N/A

52.143

45.396

45.948

45.997

68.805

42.513

43.043

43.125

33.239

33.957

31.051

32.602

30.592

32.551

30.633

32.644

N/A

17.741

18.827

18.807

19.002

24.319

17.859

17.507

17.965

70.227

66.996

64.099

68.052

63.606

67.999

63.736

68.268

N/A

40.663

32.181

32.47

32.522

63.982

23.778

23.953

23.975

373.891

405.042

361.555

375.893

347.582

369.202

344.482

366.293

N/A

92.31

173.184

179.404

180.661

114.48

128.703

132.955

133.556

98.181

96.177

91.823

95.162

92.349

94.957

91.827

95.228

N/A

48.688

46.14

46.745

46.722

76.86

42.503

43.038

43.137

254.354

264.763

258.533

281.625

250.956

280.922

249.796

281.478

N/A

88.456

171.068

176.696

177.743

74.297

201.028

203.742

204.82

269.004

243.549

259.555

255.973

250.783

255.927

251.615

256.629

N/A

74.996

99.231

99.235

99.124

94.592

88.733

89.824

90.388

101.668

90.603

77.819

79.454

74.35

79.756

74.081

79.648

N/A

34.321

33.601

34.31

34.413

44.881

35.508

36.259

36.416

96.27

93.245

87.685

93.542

88.615

93.624

86.701

94.021

N/A

50.027

44.943

45.469

45.485

66.283

41.72

42.255

42.319

11.226

10.707

11.143

10.978

11.155

11.1

11.164

11.159

N/A

5.474

5.677

5.591

5.588

N/A

3.86

3.769

3.829

3.817

3.838

3.872

3.843

3.874

N/A

2.06

2.084

N/A

203.469

218.769

213.825

219.069

214.534

229.966

216.669

235.439

N/A

96.571

86.391

87.496

87.77

85.093

85.906

87.389

N/A

180.09

189.251

174.372

186.343

173.773

196.705

174.418

194.753

N/A

76.448

74.756

75.606

75.768

83.619

75.56

77.138

N/A

5.366

5.263

5.244

5.376

5.249

5.412

5.262

5.424

N/A

2.571

2.624

N/A

116.765

126.309

128.374

138.347

125.33

141.711

124.469

145.704

N/A

49.366

54.544

55.623

55.694

72.241

56.014

57.352

N/A

118.49

113.004

92.04

94.65

94.132

92.916

94.746

94.614

N/A

47.738

42.971

43.602

43.703

77.874

39.153

39.492

39.634

154.997

148.837

124.156

129.441

124.711

127.371

124.754

129.183

N/A

61.207

53.456

54.272

54.338

77.186

47.435

47.965

48.088

50.831

51.563

41.195

44.811

39.269

44.55

39.137

44.427

N/A

20.255

21.062

21.317

21.32

28.126

19.72

19.876

20.146

112.273

101.858

90.309

96.177

86.799

99.067

86.164

99.556

N/A

46.799

37.312

37.817

37.846

72.856

26.503

26.668

26.739

542.671

535.501

466.267

444.788

415.039

413.064

406.277

406.43

N/A

94.213

193.232

200.945

202.006

121.366

142.162

147.025

147.721

149.07

151.581

119.919

126.481

121.176

127.113

120.967

125.572

N/A

58.216

54.376

55.082

55.156

69.232

47.413

47.967

48.114

402.756

435.005

393.605

416.086

360.659

416.621

347.819

424.034

N/A

156.574

197.316

199.764

200.944

76.491

225.453

228.759

230.726

401.753

421.39

381.543

363.781

346.721

356.866

339.467

361.573

N/A

82.345

112.116

111.562

111.156

125.125

98.741

100.137

100.645

168.412

150.982

105.344

91.565

87.799

88.948

86.455

89.026

N/A

38.432

37.314

38.032

38.272

51.181

39.704

39.936

40.235

145.34

147.592

119.057

125.7

119.128

125.792

119.067

124.745

N/A

58.629

52.688

53.507

53.638

68.158

46.645

47.238

47.355

8.733

8.392

8.757

8.467

8.767

8.608

8.77

8.665

N/A

5.19

5.378

5.338

5.328

N/A

3.029

2.883

3.022

2.955

3.019

2.992

3.02

3.003

N/A

1.953

1.974

N/A

176.811

170.778

156.73

179.427

161.211

176.271

162.378

177.814

N/A

91.764

77.199

78.344

78.893

137.672

92.249

94.007

N/A

147.796

148.499

133.129

153.402

136.45

153.106

137.907

153.418

N/A

79.376

71.538

72.301

72.461

N/A

84.957

86.892

N/A

4.245

4.2

4.082

4.158

4.093

4.264

4.094

4.285

N/A

2.562

2.573

N/A

97.234

100.501

100.582

107.964

97.986

108.375

98.208

108.408

N/A

49.73

50.823

51.743

51.735

75.114

63.46

65.092

N/A

100.136

91.101

75.911

86.547

77.284

87.16

77.759

88.578

N/A

43.517

38.379

38.93

38.857

67.464

45.713

46.186

46.018

N/A

127.108

116.001

101.931

111.989

103.481

111.379

103.832

112.538

N/A

54.507

47.526

48.191

48.201

82.805

55.634

56.184

56.013

N/A

40.54

42.231

34.541

36.686

33.457

36.334

33.477

36.447

N/A

18.213

18.891

19.403

19.288

25.284

22.981

23.647

23.525

N/A

90.924

86.451

76.204

82.293

75.127

81.067

75.226

81.326

N/A

43.217

31.36

31.508

31.507

67.699

36.056

36.077

36.132

N/A

405.129

422.525

369.815

373.34

347.877

354.811

339.818

349.65

N/A

203.449

164.216

170.313

171.274

231.423

179.066

187.343

188.194

N/A

129.542

123.021

98.39

111.96

99.992

112.73

100.412

113.593

N/A

51.265

48.209

48.984

48.859

80.652

55.889

56.603

56.376

N/A

333.782

345.813

322.971

360.961

299.83

344.627

296.446

344.183

N/A

143.444

178.303

183.052

182.244

178.394

230.807

234.432

233.328

N/A

334.287

329.489

320.057

318.362

294.607

299.595

291.029

299.055

N/A

76.695

99.981

100.171

99.459

115.209

109.836

111.598

111.51

N/A

143.872

120.962

82.582

79.364

73.41

77.817

72.983

77.834

N/A

34.805

34.649

35.404

35.413

46.053

41.554

42.066

42.072

N/A

123.235

119.809

97.478

110.79

99.24

112.112

99.753

112.358

N/A

52.696

46.923

47.592

47.478

80.554

54.718

55.326

55.067

N/A

Object recognition

age-gender-recognition-retail-0013

landmarks-regression-retail-0009

facial-landmarks-35-adas-0002

person-attributes-recognition-crossroad-0230

head-pose-estimation-adas-0001

OpenVINO DLDT

1x3x62x62

1x3x48x48

1x3x60x60

1x3x160x80

1x3x256x456

1806.332

1866.731

2649.906

2537.075

2838.244

2869.298

2876.783

2916.652

N/A

397.263

1772.46

2020.21

2073.421

522.264

1955.159

3698.987

3913.681

6721.641

9715.064

13831.176

11356.833

14008.739

12176.055

13269.833

12823.277

N/A

909.63

2208.691

7922.657

8246.105

873.449

2072.925

8252.189

11315.409

663.026

1452.469

2408.962

3129.247

3871.181

3926.498

4334.918

4132.832

N/A

112.072

547.434

1904.622

2129.08

117.366

554.335

2126.525

3638.273

1039.996

1171.13

1495.029

1339.518

1231.395

1169.858

1090.392

1136.097

N/A

138.6

672.858

768.341

790.488

161.103

678.663

804.393

831.252

1885.928

1904.808

2726.451

2458.755

2924.643

2788.904

2955.752

2838.989

N/A

303.079

1382.947

1602.399

1665.904

324.901

1503.065

2789.403

2954.255

2949.581

3250.753

4259.798

4192.533

4132.128

4518.896

4169.774

4614.796

N/A

461.979

2055.276

2255.988

2295.488

584.817

2694.919

4153.933

4336.809

6808.935

12132.575

20177.049

19896.582

23852.449

20903.486

22675.744

20429.993

N/A

977.01

2421.828

9078.58

9539.623

913.792

2282.77

11587.475

12917.35

708.378

1261.466

2667.708

4873.133

5144.61

6903.215

6098.45

7410.092

N/A

117.52

569.153

2135.916

2375.44

125.687

574.71

2212.076

4046.115

1173.56

1891.003

2334.871

2430.28

2134.268

1718.115

1666.949

1513.379

N/A

151.244

732.582

857.802

877.96

173.025

740.986

899.571

923.973

2912.711

3084.315

4490.089

4312.458

4455.656

4485.63

4458.246

4573.133

N/A

334.394

1532.306

1803.88

1849.289

356.932

1695.182

3149.062

3336.654

2288.218

2498.32

3243.855

3250.315

3568.861

3604.472

3614.708

3746.761

N/A

685.12

1732.557

1973.007

2058.538

1187.179

2312.026

3991.249

4052.284

N/A

7013.886

10376.316

17905.247

15604.862

19993.703

16067.799

17659.066

16026.372

N/A

1948.121

5988.655

7394.916

7650.785

1839.607

6733.781

10634.898

12068.312

N/A

634.347

1223.315

2412.252

3612.645

4527.347

5245.46

5228.074

5599.058

N/A

197.467

1195.746

1988.558

2223.151

N/A

1313.079

3369.553

3760.285

N/A

1123.575

1404.316

1974.022

1868.901

1648.522

1391.785

1322.564

1264.421

N/A

324.662

661.497

771.89

796.535

388.002

741.748

907.238

935.011

N/A

2514.571

2491.074

3668.755

3401.801

3899.298

3808.347

3979.003

3853.917

N/A

767.204

1341.909

1574.762

1635.052

971.129

1626.527

3084.827

3129.311

N/A