de.mpg.escidoc.pubman.appbase.FacesBean
English
 
Help Guide Disclaimer Contact us Login
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Conference Paper

Reliable and valid measures of threat detection performance in X-ray screening

MPS-Authors
http://pubman.mpdl.mpg.de/cone/persons/resource/persons84420

Schwaninger,  A
Department Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society;

Locator
There are no locators available
Fulltext (public)
There are no public fulltexts available
Supplementary Material (public)
There is no public supplementary material available
Citation

Hofer, F., & Schwaninger, A. (2004). Reliable and valid measures of threat detection performance in X-ray screening. Proceedings of the 38th Annual International Carnahan Conference on Security Technology (CCST‘04), 303-308.


Cite as: http://hdl.handle.net/11858/00-001M-0000-0013-D7A7-5
Abstract
Over the last decades, airport security technology has evolved remarkably. This is especially evident when state-of-the-art detection systems are concerned. However, such systems are only as effective as the personnel who operate them. Reliable and valid measures of screener detection performance are important for risk analysis, screener certification and competency assessment, as well as for measuring quality performance and effectiveness of training systems. In many of these applications the hit rate is used in order to measure detection performance. However, measures based on signal detection theory have gained popularity in recent years, for example in the analysis of data from threat image projection (TIP) or computer based training (CBT) systems. In this study, computer-based tests were used to measure detection performance for improvised explosive devices (IEDs). These tests were conducted before and after training with an individually adaptive CBT system. The following measures were calculated: pHit, d’, Δm, Az, A’, p(c)max. All measures correlated well, but ROC curve analysis suggests that “nonparametric” measures are more valid to measure detection performance for IEDs. More specifically, we found systematic deviations in the ROC curves that are consistent with two-state low threshold theory of [9]. These results have to be further studied and the question rises if similar results could be obtained for other X-ray screening data. In any case, it is recommended to use A’ in addition to d’ in practical applications such as certification, threat image projection and CBT rather than the hit rate alone.