A Variant Q-Sorting Methodology for Building Diagnostic Trees

Abstract

Diagnostic theories are fundamental to information system (IS) practice and are represented as trees. While there are approaches for validating diagnostic trees, these validate the overall performance of the tree rather than identifying ways incorrect diagnoses can occur. It is important to fully validate diagnostic trees because even if the tree gives the correct decision “most of the time,” it is possible for incorrect decisions traveling down little-used branches of the tree to result in catastrophic decisions. In this article, we describe the process of using a variant of q-sorting to validate diagnostic trees. In this methodology, diagnostic trees that independent experts develop are transformed into a quantitative form, and that quantitative form is tested to determine the inter-rater reliability of the individual branches in the tree. The trees are then successively transformed to incrementally test if they branch in the same way. The results help researchers not only identify quality items for use in a diagnostic tree but also facilitate diagnoses of problems with those items and facilitate the reconciliation of discrepant trees by experts. The methodology validates not only the whole tree but also its subparts.

Department(s)

Business and Information Technology

Publication Status

Early Access

Comments

Published online: 02 Jun 2021

Keywords and Phrases

Clustering Algorithms; Correlation; Diagnostic Theories; Diagnostic-tree; Inter-rater Reliability; Multimedia Web Sites; Q-sorting; Social Networking (online); Tools; Transforms; Tree; Vegetation

International Standard Serial Number (ISSN)

0018-9391; 1558-0040

Document Type

Article - Journal

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2021 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.

Publication Date

02 Jun 2021

Link to Full Text

Share

 
COinS