Skip to main content

Table 4 Comparison of 8 IQA indices on three benchmark datasets

From: Image decomposition-based structural similarity index for image quality assessment

  

VIF

GSM

PSNR

VSNR

SSIM

MSSSIM

IWSSIM

RFSIM

FSIM

FSIMc

SFF

IDSSIM

IDSSIMc

TID 2013

SROC

0.6769

0.7946

0.6862

0.6812

0.7417

0.7859

0.7779

0.7744

0.8015

0.8510

0.8513

0.8304

0.8608

 

KROC

0.5147

0.6255

0.5043

0.5084

0.5588

0.6047

0.5977

0.5951

0.6289

0.6665

0.6588

0.6451

0.6781

 

PLCC

0.7720

0.8464

0.6902

0.7402

0.7895

0.8329

0.8319

0.8333

0.8589

0.8769

0.8706

0.8584

0.8813

 

RMSE

0.7880

0.6603

0.8976

0.8392

0.7608

0.6861

0.6880

0.6852

0.6349

0.5959

0.6099

0.6358

0.5859

TID 2008

SROC

0.7491

0.8504

0.5245

0.7046

0.7749

0.8542

0.8559

0.8680

0.8805

0.8840

0.8767

0.8736

0.8852

 

KROC

0.5860

0.6596

0.3696

0.5340

0.5768

0.6568

0.6636

0.6780

0.6946

0.6991

0.6882

0.6827

0.7023

 

PLCC

0.8084

0.8422

0.5309

0.6820

0.7732

0.8451

0.8579

0.8645

0.8738

0.8762

0.8817

0.8646

0.8741

 

RMSE

0.7899

0.7235

1.1372

0.9815

0.8511

0.7173

0.6895

0.6746

0.6525

0.6468

0.6333

0.6742

0.6518

CSIQ

SROC

0.9195

0.9108

0.8057

0.8106

0.8756

0.9133

0.9213

0.9295

0.9242

0.9310

0.9627

0.9451

0.9419

 

KROC

0.7537

0.7374

0.6080

0.6247

0.6907

0.7393

0.7529

0.7645

0.7567

0.7690

0.8281

0.7947

0.7875

 

PLCC

0.9277

0.8964

0.8001

0.8002

0.8613

0.8991

0.9144

0.9179

0.9120

0.9192

0.9643

0.9317

0.9335

 

RMSE

0.0980

0.1164

0.1575

0.1575

0.1334

0.1449

0.1063

0.1042

0.1022

0.1034

0.0695

0.0953

0.0941

LIVE

SROC

0.9636

0.9561

0.8755

0.9274

0.9479

0.9513

0.9567

0.9401

0.9634

0.9645

0.9649

0.9516

0.9555

 

KROC

0.8282

0.8150

0.6864

0.7616

0.7963

0.8045

0.8175

0.7816

0.8337

0.8363

0.8365

0.8063

0.8095

 

PLCC

0.9604

0.9512

0.8721

0.9231

0.9449

0.9489

0.9522

0.9354

0.9597

0.9613

0.9632

0.9473

0.9501

 

RMSE

7.6137

8.4327

13.368

10.506

8.9455

8.6188

8.3473

9.6642

7.6780

7.5269

7.3460

8.7514

8.5221

A57

SROC

0.6223

0.9018

0.6189

0.9355

0.8066

0.8394

0.8706

0.8215

0.9181

0.9285

 

KROC

0.4589

0.8724

0.4309

0.8031

0.6058

0.6478

0.6848

0.6324

0.7639

0.7741

 

PLCC

0.6158

0.7231

0.6587

0.9472

0.8017

0.8504

0.9035

0.8475

0.9252

0.9282

 

RMSE

0.1936

0.1206

0.1849

0.0781

0.1469

0.1293

0.1052

0.1305

0.0933

0.0900

  1. The top 3 indices are highlighted in italics