Causal DAGs

Causal DAGs

We need to understand some important properties before encoding our causal knowledge in a DAG. We learned in Chapter 2 that Bayesian networks use DAGs for the qualitative description of the Joint Probability Distribution.

In the causal context, however, the arcs in a DAG explicitly state causality instead of only representing direct probabilistic dependencies in a Bayesian network. We now designate a DAG with a causal semantic as a Causal DAG (CDAG) to highlight this distinction.

Structures Within a DAG

A DAG has three basic configurations in which nodes can be connected. Graphs of any size and complexity can be broken down into these basic graph structures. While these basic structures show direct dependencies/causes explicitly, there are more statements contained in them, albeit implicitly. In fact, we can read all marginal and conditional associations that exist between the nodes.

Why are we even interested in associations? Isnโ€™t all this about understanding causal effects? It is essential to understand all associations in a system because, in non-experimental data, all we can do is observe associations, some of which represent non-causal relationships. Our objective is to identify causal effects from associations.

Indirect Connection

This DAG represents an indirect connection of A on B via C.

  • A Directed Arc represents a potential causal effect. The arc direction indicates the assumed causal direction, i.e., โ€œA โ†’ C โ€ means โ€œA causes C .โ€

  • A Missing Arc encodes the definitive absence of a direct causal effect, i.e., no arc between A and B means no direct causal relationship exists between A and B and vice versa. As such, a missing arc represents an assumption.

Implication for Causality

A has a potential causal effect on B intermediated by C.

Implication for Association

Marginally (or unconditionally), A and B are dependent. This means that without knowing the exact value of C, learning about A informs us about B and vice versa, i.e., the path between the nodes is unblocked, and information can flow in both directions.

Conditionally on C, i.e., by setting Hard Evidence on (or observing) C, A, and B become independent. In other words, by โ€œhardโ€-conditioning on C, we block the path from A to B and from B to A. Thus, A and B are conditionally independent, given C:

AโŠฅB,AโŠฅBโˆฃCA\cancel{ \bot }B,A \bot B|C

Hard Evidence means that there is no uncertainty regarding the value of the observation or evidence. If uncertainty remains regarding the value of C, the path will not be entirely blocked, and an association will remain between A and B.

Common Parent

The second configuration has C as the common parent of A and B.

Implication for Causality

C is the common cause of both A and B.

Implication for Association

In terms of association, this structure is absolutely equivalent to the Indirect Connection. Thus, A and B are marginally dependent but conditionally independent given C (by setting Hard Evidence on C):

AโŠฅB,AโŠฅBโˆฃCA\cancel{ \bot }B,A \bot B|C

Common Child (Collider)

The final structure has a common child C, with A and B being its parents. This structure is called a โ€œV-Structure.โ€ In this configuration, the common child C is also known as a โ€œcollider.โ€

Implication for Causality

A and B are the direct causes of C.

Implication for Association

Marginally (or unconditionally), A and B are independent, i.e., there is no information flow between A and B. Conditionally on C โ€” with any kind of evidence โ€” A and B become dependent. If we condition on the collider C, information can flow between A and B, i.e., conditioning on C opens the information flow between A and B:

AโŠฅB,AโŠฅBโˆฃCA \bot B,A\cancel{ \bot }B|C

Even introducing a minor change in the distribution of C, e.g., from no observation (โ€œcolor unknownโ€) to a very vague observation (โ€œit could be anything, but it is probably not purpleโ€), opens the information flow.

For purposes of formal reasoning, this type of connection is of special significance. Conditioning on C facilitates inter-causal reasoning, often referred to as the ability to โ€œexplain awayโ€ the other cause, given that the common effect is observed (see Inter-Causal Reasoning in Chapter 4).

Creating a CDAG Representing Simpsonโ€™s Paradox

To begin the encoding of our causal knowledge in the form of a CDAG, we draw three nodes, which represent X (Treatment), Y (Outcome), and Z (Gender). For now, we are only using the qualitative part of the network, i.e., we are not considering probabilities.

The absence of further nodes means that we assume that there are no additional variables in the Data-Generating Process (DGP), either observable or unobservable. Unfortunately, this is a very strong assumption that cannot be tested. We need to have a justification purely on theoretical grounds to make such an assumption.

In the next step, we must encode our causal assumptions regarding this domain. Given our background knowledge of this domain, we state that Z causes X and Y and that X causes Y.

This means that we believe that gender is a cause of taking the treatment and has a causal effect on the outcome, too. We also assume that the treatment has a potential causal effect on the outcome.

Having accepted these causal assumptions, we now wish to identify the causal effect of X on Y. The question is whether this is possible on the basis of this causal graph and the available observational data for these three variables. Before we can answer this question, we need to think about what this CDAG specifically implies. Recall the types of structures that can exist in a DAG (see Structures Within a DAG). As it turns out, we can find all three of the basic structures in this example:

  • Indirect Connection: Z causes Y via X

  • Common Parent: Z causes X and Y

  • Common Child: Z and X cause Y

Last updated


Bayesia USA

Bayesia S.A.S.

Bayesia Singapore

Copyright ยฉ 2024 Bayesia S.A.S., Bayesia USA, LLC, and Bayesia Singapore Pte. Ltd. All Rights Reserved.