Multisource Causal Data Mining

Abstract

Analysts are faced with mountains of data, and finding that relevant piece of information is the proverbial needle in a haystack, only with dozens of haystacks. Analysis tools that facilitate identifying causal relationships across multiple data sets are sorely needed. 21st Century Systems, Inc. (21CSi) has initiated research called Causal-View, a causal datamining visualization tool, to address this challenge. Causal-View is built on an agent-enabled framework. Much of the processing that Causal-View will do is in the background. When a user requests information, Data Extraction Agents launch to gather information. This initial search is a raw, Monte Carlo type search designed to gather everything available that may have relevance to an individual, location, associations, and more. This data is then processed by Data-Mining Agents. The Data-Mining Agents are driven by user supplied feature parameters. If the analyst is looking to see if the individual frequents a known haven for insurgents he may request information on his last known locations. Or, if the analyst is trying to see if there is a pattern in the individual's contacts, the mining agent can be instructed with the type and relevance of the information fields to look at. The same data is extracted from the database, but the Data Mining Agents customize the feature set to determine causal relationships the user is interested in. At this point, a Hypothesis Generation and Data Reasoning Agents take over to form conditional hypotheses about the data and pare the data, respectively. The newly formed information is then published to the agent communication backbone of Causal-View to be displayed. Causal-View provides causal analysis tools to fill the gaps in the causal chain. We present here the Causal-View concept, the initial research into data mining tools that assist in forming the causal relationships, and our initial findings.

Meeting Name

Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2014 (2014: May 6-7, Baltimore, MD)

Department(s)

Electrical and Computer Engineering

Second Department

Computer Science

Keywords and Phrases

Causal Data Mining; Causal Data Relationships; Data Mining and Clustering; Evidence Reasoning; Information Fusion; Intelligent Agent Software; Knowledge Based Systems; Mahalanobis Taguchi System

International Standard Book Number (ISBN)

978-081949085-8

International Standard Serial Number (ISSN)

0277-786X; 1996-756X

Document Type

Article - Conference proceedings

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2012 SPIE, All rights reserved.

Publication Date

01 May 2012

Link to Full Text

Share

 
COinS