Defense Acquisition Research Journal Issue 95

January 2021

TABLE 14. PARAMETRIC T-TEST AND NONPARAMETRIC MANN–WHITNEY TEST II Less Info vs. More Info T-Test P -value MW P -value Less Info vs. Live Experiment T-Test P -value MW P -value More Info vs. Live Experiment T-Test P -value MW P -value

VAR15; VAR115 VAR16; VAR116 VAR17; VAR117 VAR18; VAR118 VAR19; VAR119 VAR20; VAR120 VAR21; VAR121 VAR22; VAR122 VAR23; VAR123 VAR24; VAR124 VAR28; VAR128 VAR29; VAR129 VAR31; VAR131 VAR35; VAR135 VAR38; VAR138 VAR43; VAR143

VAR15; VAR415 VAR16; VAR416 VAR17; VAR417 VAR18; VAR418 VAR19; VAR419 VAR20; VAR420 VAR21; VAR421 VAR22; VAR422 VAR23; VAR423 VAR24; VAR424 VAR28; VAR428 VAR29; VAR429 VAR31; VAR431 VAR35; VAR435 VAR38; VAR438 VAR43; VAR443

VAR115; VAR415 VAR116; VAR416 VAR117; VAR417 VAR118; VAR418 VAR119; VAR419 VAR120; VAR420 VAR121; VAR421 VAR122; VAR422 VAR123; VAR423 VAR124; VAR424 VAR128; VAR428 VAR129; VAR429 VAR131; VAR431 VAR135; VAR435 VAR138; VAR438 VAR143; VAR443

0.0000 0.0000

0.0000 0.0001

0.2858 0.2593

0.0000 0.0000

0.0000 0.0000

0.3564 0.4038

0.0000 0.0000

0.0000 0.0000

0.2419 0.2438

0.0000 0.0000

0.0000 0.0000

0.2298 0.4038

0.0037 0.0043

0.0005 0.0010

0.0968 0.1094

0.0000 0.0004

0.0000 0.0010

0.4280 0.1704

0.0000 0.0002

0.0000 0.0005

0.3632 0.3711

0.0000 0.0000

0.0000 0.0000

0.4853 0.4227

0.0489

0.0012 0.0003

0.0000 0.0000

0.1156

0.0000 0.0000

0.0000 0.0000

0.0518 0.0610

0.0148 0.0388

0.0078 0.0055

0.0271

0.1005

0.0102 0.0192

0.0059 0.0022

0.1867 0.0515

0.0016 0.0017

0.0362 0.0254

0.1438 0.1420

0.0383

0.0032 0.0016

0.0142

0.0771

0.0617

0.0130 0.0395

0.0986 0.0883

0.0948 0.1769

0.0085 0.0123

0.0484 0.0486

0.1612 0.1650

We conclude that: • Within each experimentation stage, the three systems are indeed perceived to be different. ° Direct-Control vs. Autonomous shows the most amount of difference, regardless of the experimental stage. ° A majority of the Direct-Control vs. Remote Control and Remote-Control vs. Autonomous systems also showed differences, although less than the Direct-Control vs. Autonomous systems. • Between the three levels of experimentation (Less Info, More Info, live experiments), each subsection of the technology is considered statistically different.

27

Defense ARJ, January 2021, Vol. 28 No. 1 : 2-39