Assessment Report

This report is generated from the contextual menu of the expert icon in the status bar. It contains two parts. The first part is a global summary analysis of the assessment:

It shows the list of experts: their name, credibility, comment and the number of assessments done like in the expert editor. The last column shows the average assessment time used by each expert to make assessment. This time is computed only when an online session is used.
After that, two tables are displayed:

• The first table is the list of the nodes with assessment. The first column is node name, the next column is the comment of the node (depending on the settings) and the last one is the global disagreement of the assessments. This percentage represents the average deviation of each assessment with respect to the mean of each cell. It takes into account the confidence associated with each assessment. If an assessment has a confidence equal to zero, it won't be taken into account in the global disagreement. The nodes are sorted according to the global disagreement.

• The second table is also the list of the nodes with assessment. The first column is node name, the next column is the comment of the node (depending on the settings) and the last one is the maximum disagreement of the assessments. This percentage represents the maximum deviation of all assess- ments in the whole table. If an assessment has a confidence equal to zero, it won't be taken into account in the maximum disagreement. The nodes are sorted according to the maximum disagreement.

The global and maximum disagreements between the experts allow us to easily find on which nodes the knowledge of the experts is not the same and the knowledge elicitation should be verified.
The second part of the report details the assessment for each variable:

For each node with assessment, a table contains:

• The number of rows in the conditional probability table that have assessments associated with compared to the total number of rows

• The total number of assessments done on this node

• The number of experts involved compared to the total number of experts

• The global disagreement of the node

• The maximum disagreement in the conditional probability table

• The global assessment time which is the sum of all assessment times

• The mean assessment time by row of the conditional probability table

• The mean expert assessment time for this node