Knowledge Elicitation & Reasoning with Bayesian Networks for Policy Analysis Under Uncertainty
Virginia Tech Applied Research Center — Arlington
Ballston Room, 900 N Glebe Rd, Arlington, VA 22203
December 3, 2018, 2 p.m. – 5 p.m.
- Please note that this is not a webinar. You will need to be physically present in the classroom to participate in this workshop.
- Please bring your WiFi-enabled laptop computer or tablet to participate in the knowledge elicitation exercise.
In this workshop, we demonstrate how to elicit human knowledge for developing a high-dimensional computational model of an underlying problem domain in the form of a Bayesian network. This type of "Artificial Intelligence" allows us reason formally—and quantitatively, despite the absence of numerical data—about the given issue.
As our case study topic, we examine a hypothetical—but quite realistic—geopolitical conflict. More specifically, we utilize the web-based Bayesia Expert Knowledge Elicitation Environment (BEKEE) and develop a Bayesian network model for simulating the outcomes of potential economic, diplomatic, and military interventions in this particular situation.
No Data = No Model = No Science?
In this day and age of "Big Data," we may be led to believe that truth can only be established from data, especially in the context of a scientific inquiry. This is a misconception. Even without data, humans do possess knowledge, qualitative or quantitative, tacit or explicit, about many aspects of the world. We believe that a useful amount of knowledge exists regarding the conflict under study. Also, there is one particular type of knowledge that data on its own can never yield, and that is causality. For that, we always have to rely on human expertise.
The Wisdom of Crowds
Although there may not be a single expert among our seminar participants who can fully comprehend all the complexities of our case study topic, there may be several individuals who are more or less knowledgeable about different aspects of the conflict. It is our objective to break down the overall problem into numerous simpler questions, which are perhaps more easily "knowable," at least to some.
So, we are not looking for a single authoritative opinion. Rather, we are looking to collect and consolidate the full spectrum of thought, including causal relationships, from the seminar's participants. This is where the idea of the "wisdom of crowds" comes into play. We want attendees to provide their individual and independent assessments of different elements and relationships within the problem domain.
Knowledge Elicitation with the Bayesia Expert Knowledge Elicitation Environment
While the objective of collecting multiple opinions is straightforward, there are many technical and practical challenges in terms of implementing such a process. In the early days of the Cold War, the RAND Corporation proposed the so-called Delphi Method, which facilitated expert knowledge elicitation by iteratively querying stakeholders through a series of questionnaires that were distributed and collected by mail. After each round of questioning, the aggregated results were circulated for review and discussion, and all participating experts could further adjust their assessments based on the collective feedback. Needless to say, prior to the availability of electronic means of communication, such a process was tedious, bordering on the impractical.
Reinventing the Delphi Method
Today, we propose an entirely new, web-based approach, the Bayesia Expert Knowledge Elicitation Environment (BEKEE), which has the same objective as the original Delphi Method. In this seminar, we plan to use BEKEE for collecting the opinions of the participants in real-time from their own devices via a convenient web interface.
We shall see that systematically eliciting and encoding numerous pieces of (admittedly imperfect) knowledge into a Bayesian network can produce a remarkably useful approximation of the underlying domain, which provides us with a common framework for reasoning about policy options and evaluating their consequences.
Reasoning Under Uncertainty
Furthermore, by using a Bayesian network model, we can preserve all the uncertainty that exists in our collective knowledge and perform inference by consciously taking into account all the uncertainty. Thus, we manage to avoid two common and problematic extremes in reasoning, i.e., (i) suppressing uncertainty by calculating with the fake precision of single-point estimates, or (ii) being overwhelmed by uncertainty and abandoning quantitative reasoning altogether. A Bayesian network, however, can explicitly represent the uncertainty from the diversity of opinions captured via BEKEE.
On the basis of the newly-generated Bayesian network, we can use BayesiaLab to reason probabilistically about the implications of various hypothetical interventions and simulate the outcomes of different policies.
Who Should Attend?
This seminar is intended primarily for the intelligence community, members of the military, defense contractors and consultants, e.g.:
- Intelligence analysts
- J2/G2 officers
- Policy analysts
- Strategy analysts
- Knowledge managers
- Risk analysts
- Research investigators
- Decision scientists
- Operations Research analysts
- Counterterrorism analysts
- Wargaming, modeling/simulation analysts
Students and teachers in related fields are welcome to join.
About the Presenter
Stefan Conrady has over 20 years of experience in decision support, market intelligence, marketing communications, and product strategy with leading brands, such as Mercedes-Benz, BMW, and Rolls-Royce. Stefan is a native of Ulm, Germany, but his career has spanned the globe, having lived and worked in Chicago, New York, Munich, and Singapore, just to name a few.
Today, in his role as Managing Partner of Bayesia USA and Bayesia Singapore, he is recognized as a thought leader in applying Bayesian networks for research, analytics, and reasoning. His quest for reasoning with Bayesian networks emerged directly out of his decision support role with major strategic initiatives in the auto industry. Given his real-world business experience, Stefan's papers and lectures are now among the most frequently cited educational materials on applied research with Bayesian networks. In this context, Stefan has recently co-authored a book with Lionel Jouffe, Bayesian Networks & BayesiaLab — A Practical Introduction for Researchers.