Abstract
The critical decision method is a semi-structured retrospective interview used mainly in researching professional decision making within the naturalistic decision making paradigm. There are currently, two main methods of performing analysis: ETA - Emergent Themes Analysis and the structured approach (Wong, 2004). The structured approach consists of five steps: 1. decision chart, 2. incident summary, 3. decision analysis tables, 4. identification of items of interest and 5. collation and comparison of common items of interest across incidents. Naturalistic decision making can be time-consuming, involve high stakes, poorly-structured problems, uncertain dynamic environments and ill-defined or competing goals. For this reason we will demonstrate how to the structured approach to perform an analysis using the example of a decision making situation in emergency medicine.
References
Adamovová, L., & Halama, P. (2013). Emócie a emočná sebaregulácia v práci zdravotníckych záchranárov: kvalitatívny prístup [Emotions and emotional self-regulation in the work of paramedics: A qualitative approach]. In J. Gurňáková et al. (Ed.), Rozhodovanie profesionálov: Sebaregulácia, stres a osobnosť (pp. 247-276). Bratislava: Ústav experimentálnej psychológie SAV.Search in Google Scholar
Blandford, A., & Wong, B. L. W. (2004). Situation awareness in emergency medical dispatch. International Journal of Human Computer Studies, 61(4), 421-452.10.1016/j.ijhcs.2003.12.012Search in Google Scholar
Crandall, B., & Calderwood, R. (1989). Clinical assessment skills of experienced neonatal intensive care nurses. Yellow Springs, OH.Search in Google Scholar
Crandall, B., Klein, G., & Hoffman, R. R. (2006). Working minds: A practitioner’s guide to cognitive task analysis. Cambridge, MA: MIT Press.10.7551/mitpress/7304.001.0001Search in Google Scholar
Gamer, M., Lemon, J., Fellows, I., & Singh, P. (2012). irr: Various coefficients of interrater reliability and agreement. R package version 0.84. Retrieved from http://cran.r-project.org/package=irr Search in Google Scholar
Harenčárová, H. (2013). Sonda do problémov zdravotníckych záchranárov súvisiacich s rozhodovaním v náročných situáciách a s výkonom ich profesie [Insight into the problems paramedics have in relation to decision making in difficult situations and in performing their duties]. In J. Gurňáková et al. (Ed.), Rozhodovanie profesionálov: Sebaregulácia, stres a osobnosť (pp. 217-245). Bratislava: Ústav experimentálnej psychológie SAV.Search in Google Scholar
Harenčárová, H. (in press). Managing uncertainty in paramedics’ decision making. In International Conference on Naturalistic Decision Making 2015. McLean, VA.10.1177/1555343416674814Search in Google Scholar
Hayes, A. F., & Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1(1), 77-89.10.1080/19312450709336664Search in Google Scholar
Hoffman, R. R., Crandall, B., & Klein, G. (2008). Protocols for cognitive task analysis. Pensacola, FL.Search in Google Scholar
Hoffman, R. R., Crandall, B., & Shadbolt, N. R. (1998). Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. Human Factors, 40(2), 254-276.10.1518/001872098779480442Search in Google Scholar
Horberry, T., & Cooke, T. (2010). Using the critical decision method for incident analysis in mining. Journal of Health & Safety Research & Practice, 2(2), 11-22.Search in Google Scholar
Hutchins, S. G., Pirolli, P. L., & Card, S. K. (2007). What makes intelligence analysis difficult? A cognitive task analysis. In R. R. Hoffman (Ed.), Expertise out of Context: Proceedings of the Sixth International Conference on Naturalistic Decision Making (pp. 281-316). New York: Lawrence Erlbaum Associates.Search in Google Scholar
Klein, G. (2008). Naturalistic decision making. Human Factors, 50(3), 456-460.10.1518/001872008X288385Search in Google Scholar
Klein, G. A., Calderwood, R., & MacGregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19(3), 462-472.10.1109/21.31053Search in Google Scholar
Krippendorff, K. (2004). Reliability in content analysis: Some common misconceptions and recommendations. Human Communication Research, 30(3), 411-433.10.1093/hcr/30.3.411Search in Google Scholar
Lipshitz, R., Klein, G., Orasanu, J., & Salas, E. (2001). Taking stock of naturalistic decision making. Journal of Behavioral Decision Making, 14(5), 331-352.10.1002/bdm.381Search in Google Scholar
Lipshitz, R., Omodei, M., McClellan, J., & Wearing, A. (2007). What’s burning? The RAWFS heuristic on the fire ground. In R. R. Hoffman (Ed.), Expertise out of context: Proceedings of the Sixth International Conference on Naturalistic Decision Making (pp. 97-111). Lawrence Erlbaum Associates.Search in Google Scholar
Lipshitz, R., & Strauss, O. (1997). Coping with uncertainty: A naturalistic decision-making analysis. Organizational Behavior and Human Decision Processes, 69(2), 149-163.10.1006/obhd.1997.2679Search in Google Scholar
Okoli, J. O., Weller, G., Watt, J., & Wong, B. L. W. (2013). Decision making strategies used by experts and the potential for training intuitive skills: A preliminary study. In H. Chaudet, L. Pellegrin, & N. Bonnardel (Eds.), Proceedings of the 11th International Conference on Naturalistic Decision Making (NDM 2013), Marseille, France, 21-24 May 2013 (pp. 227-232). Paris: Arpege Science Publishing.Search in Google Scholar
Orasanu, J., & Connolly, T. (1993). The reinvention of decision making. In G. A. Klein, J. Orasanu, R. Calderwood, & C. E. Zsambok (Eds.), Decision making in action: models and methods (pp. 3-20). Norwood, NJ: Ablex Publishing.Search in Google Scholar
R Core Team. (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved from http://www.r-project.org/ Search in Google Scholar
Weitzenfeld, J. S., Freeman, J. T., Riedl, T. R., & Klein, G. A. (1990). The critical decision method (CDM): A knowledge-mapping technique. In Proceedings of Behavioral Sciences Days ´90. AT&T.Search in Google Scholar
Wong, B. L. W. (2004). Critical decision method data analysis. In D. Diaper & N. A. Stanton (Eds.), The handbook of task analysis for human-computer interaction (pp. 327-346). Mahwah, NJ: Lawrence Erlbaum Associates.Search in Google Scholar
Wong, B. L. W., & Blandford, A. (2002). Analysing ambulance dispatcher decision making: Trialing emergent themes analysis. In F. Vetere, L. Johnson, & R. Kushinsky (Eds.), Proceedings of the HF2002 Human Factors Conference: Design for the whole person: integrating physical, cognitive and social aspects. Canberra, Australia: Ergonomics Society of Australia.Search in Google Scholar
Wong, B. L. W., O’Hare, D., & Sallis, P. J. (1996). A goal-oriented approach for designing decision support displays in dynamic environments. In Proceedings Sixth Australian Conference on Computer Human Interaction (pp. 1-8).10.1109/OZCHI.1996.559991Search in Google Scholar
Wong, B. L. W., Sallis, J. P., & O’Hare, D. (1997). Eliciting information portrayal requirements: Experiences with the critical decision method. Chart, 97, 397-415.10.1007/978-1-4471-3601-9_23Search in Google Scholar
Zannier, C., Chiasson, M., & Maurer, F. (2007). A model of design decision making based on empirical results of interviews with software designers. Information and Software Technology, 49(6), 637-653.10.1016/j.infsof.2007.02.010Search in Google Scholar
CMapTools [Computer software]. (2015). Retrieved from http://cmap.ihmc.us Search in Google Scholar
XMind 6 [Computer software]. (2014). Retrieved from http://www.xmind.net Search in Google Scholar
Institute for Research in Social Communication, Slovak Academy of Sciences
