可忽略性

来自集智百科 - 复杂系统|人工智能|复杂科学|复杂网络|自组织
Shlay讨论 | 贡献2021年6月4日 (五) 11:30的版本
跳到导航 跳到搜索

此词条暂由彩云小译翻译,翻译字数共687,未经人工整理和审校,带来阅读不便,请见谅。

In statistics, ignorability is a feature of an experiment design whereby the method of data collection (and the nature of missing data) do not depend on the missing data. A missing data mechanism such as a treatment assignment or survey sampling strategy is "ignorable" if the missing data matrix, which indicates which variables are observed or missing, is independent of the missing data conditional on the observed data.

统计学中,可忽略性是一种实验设计特征,即数据收集方法(以及缺失数据的性质)不依赖于缺失数据。若显示哪些变量已观测或缺失的缺失数据矩阵与已观测数据为条件的缺失数据相互独立,则称该数据缺失机制(例如处理分配或抽样调查策略)是“可忽略的”。


This idea is part of the Rubin Causal Inference Model, developed by Donald Rubin in collaboration with Paul Rosenbaum in the early 1970s. The exact definition differs between their articles in that period. In one of Rubins articles from 1978 Rubin discuss ignorable assignment mechanisms,[1] which can be understood as the way individuals are assigned to treatment groups is irrelevant for the data analysis, given everything that is recorded about that individual. Later, in 1983 [2] Rubin and Rosenbaum rather define strongly ignorable treatment assignment which is a stronger condition, mathematically formulated as [math]\displaystyle{ (r_1,r_0) \perp \!\!\!\perp z \mid v ,\quad 0\lt \operatorname{pr}(z=1)\lt 1 \quad \forall v }[/math], where [math]\displaystyle{ r_t }[/math] is a potential outcome given treatment [math]\displaystyle{ t }[/math], [math]\displaystyle{ v }[/math] is some covariates and [math]\displaystyle{ z }[/math] is the actual treatment.

这个想法是20世纪70年代早期Donald RubinPaul Rosenbaum 合作提出的鲁宾因果推理模型的一部分。但那时,他们文章中可忽略性的确切定义不同。1978年鲁宾在一篇文章中讨论了可忽略的分配机制,[1] 其可理解为将个体分配到处理组的方式与数据分析无关,因为已经记录了有关该个体的所有信息。后来,在 1983 年,Rubin 和 Rosenbaum 更确切地定义了“处理分配的强可忽略性”, [3],这是一个更强的假设条件,数学公式为[math]\displaystyle{ (r_1,r_0) \perp \!\!\!\perp z \mid v ,\quad 0\lt \operatorname{pr}(z=1)\lt 1 \quad \forall v }[/math],其中[math]\displaystyle{ r_t }[/math]是给定处理状态 [math]\displaystyle{ t }[/math]下的潜在结果,[math]\displaystyle{ v }[/math] 是协变量,[math]\displaystyle{ z }[/math] 是实际的处理状态。


Pearl [2000] devised a simple graphical criterion, called back-door, that entails ignorability and identifies sets of covariates that achieve this condition.

Pearl [2000]设计了一个简单的图形标准,称为“后门”(back-door) ,它需要可忽略性并确定达到这种条件的协变量集。


Ignorability (better called exogeneity) simply means we can ignore how one ended up in one vs. the other group (‘treated’ Tx = 1, or ‘control’ Tx = 0) when it comes to the potential outcome (say Y). It was also called unconfoundedness, selection on the observables, or no omitted variable bias.[4]

可忽略性(称为外生性更好)其简明含义是,当涉及到潜在结果(Y)时,一个人是怎样最终处于一个群体中而非另一个群体中(“处理组”Tx = 1,或“控制组”Tx = 0)我们是可忽略的。它也被称为非混淆性,基于可观测变量的选择选择的可观察的,或无遗漏变量偏差[5]


Formally it has been written as [Yi1, Yi0] ⊥ Txi, or in words the potential Y outcome of person i had they been treated or not does not depend on whether they have really been (observable) treated or not. We can ignore in other words how people ended up in one vs. the other condition, and treat their potential outcomes as exchangeable. While this seems thick, it becomes clear if we add subscripts for the ‘realized’ and superscripts for the ‘ideal’ (potential) worlds (notation suggested by David Freedman; a visual can help here: potential outcomes simplified).

其数学形式可记为[Yi1, Yi0] ⊥ Txi ,或者用文字表述为,个体“i”是否接受处理的潜在结果Y并不取决于他们是否真的(可观测到的)接受处理。换句话说,个体最终是通过什么方式处于一种与另一种处理状态我们是可忽略的,并将其潜在结果视为等价可交换的。 虽然这看起来很复杂,但如果我们为“已实现”的真实处理结果添加下标,为“理想”(潜在)世界的处理结果添加上标,就会变得很清楚。 换句话说,我们可以忽略人们是如何在一种情况下和另一种情况下结束生命的,而把他们的潜在结果看作是可以交换的。虽然这看起来很厚,但是如果我们为“理想”(潜在)世界添加“已实现”的下标和上标就变得很清楚了(符号的提出可参考David Freedman; 可视化帮助可参考:potential outcomes simplified).

So: Y11/*Y01 are potential Y outcomes had the person been treated (superscript 1), when in reality they have actually been (Y11, subscript 1), or not (*Y01: the * signals this quantity can never be realized or observed, or is fully contrary-to-fact or counterfactual, CF).

所以:Y11/*Y01是潜在结果Y,如果个体被处理(上角标为 1) ,那么实际上它们是(Y11, 下角标也为 1) ,而不是(*Y01:: * 表示这个值是无法实现或不可观测的,即完全与事实相反或称为反事实(counterfactual, CF))。


Similarly, *Y10/Y00 are potential Y outcomes had the person not been treated (superscript 0), when in reality they have been (*Y10, subscript 1), or not actually (Y00).

同样,*Y10/Y00是个体未被处理 (上角标为 0)的潜在结果Y,当现实中它们是(*Y10, 下角标为 1),或实际上不是 (Y00).


Only one of each potential outcome (PO) can be realized, the other cannot, for the same assignment to condition, so when we try to estimate treatment effects, we need something to replace the fully contrary-to-fact ones with observables (or estimate them). When ignorability/exogeneity holds, like when people are randomized to be treated or not, we can ‘replace’ *Y01 with its observable counterpart Y11, and *Y10 with its observable counterpart Y00, not at the individual level Yi’s, but when it comes to averages like E[Yi1Yi0], which is exactly the causal treatment effect (TE) one tries to recover.


对于相同的条件分配,每个潜在结果(PO)中只有一个是实际发生的,而另一个不会发生,因此当我们试图估计治疗效果时,我们需要用可观测值(或估计值)来代替完全相反的结果。当可忽略性/外生性成立时,如人们被随机分配治疗与否,我们可以用可观察到的*Y01’替换‘Y11,而 *Y10 与其对应的Y00,不在 Yi的个体水平,而是 E[Yi1Yi0]平均层面而言在 ,这样的平均值时,正是因果治疗效应(TE)试图恢复的结果。


Because of the ‘consistency rule’, the potential outcomes are the values actually realized, so we can write Yi0 = Yi00 and Yi1 = Yi11 (“the consistency rule states that an individual’s potential outcome under a hypothetical condition that happened to materialize is precisely the outcome experienced by that individual”,[6] p. 872). Hence TE = E[Yi1 – Yi0] = E[Yi11 – Yi00].


由于“一致性规则”,潜在的结果是实际实现的价值,因此我们可以写 Yi0 = Yi00 and Yi1 = Yi11("一致性规则指出,假设个体在某种条件下实现的潜在结果恰恰是该个体所经历的结果",[7] p. 872).因此,TE = E[Yi1 – Yi0] = E[Yi11 – Yi00].

Now, by simply adding and subtracting the same fully counterfactual quantity *Y10 we get:

现在,通过简单的加减相同的完全反事实量 *Y10 我们得到:

E[Yi11 – Yi00] = E[Yi11 –*Y10 +*Y10 - Yi00] = E[Yi11 –*Y10] + E[*Y10 - Yi00] = ATT + {Selection Bias},

E[Yi11 – Yi00] = E[Yi11 –*Y10 +*Y10 - Yi00] = E[Yi11 –*Y10] + E[*Y10 - Yi00] = ATT + {Selection Bias},

where ATT = average treatment effect on the treated [8] and the second term is the bias introduced when people have the choice to belong to either the ‘treated’ or the ‘control’ group.


其中 ATT = 处理组的平均处理效应,第二项是个体选择属于处理组或对照组时引入的偏差。

Ignorability, either plain or conditional on some other variables, implies that such selection bias can be ignored, so one can recover (or estimate) the causal effect.


可忽略性,无论是普通的还是条件性的,都意味着这种选择偏差可以被忽略,因此人们可以恢复(或估计)因果效应。


See also


参考文献

模板:参考列表


推荐阅读

  • Gelman, Andrew; Carlin, John B.; Stern, Hal S.; Rubin, Donald B. (2004). Bayesian Data Analysis. New York: Chapman & Hall/CRC. 
  • Jaeger, Manfred (2011). "Ignorability in Statistical and Probabilistic Inference". Journal of Artificial Intelligence Research. 24: 889–917. arXiv:1109.2143. Bibcode:2011arXiv1109.2143J. doi:10.1613/jair.1657.

Category:Design of experiments

类别: 实验设计

Category:Causal inference

类别: 因果推理


This page was moved from wikipedia:en:Ignorability. Its edit history can be viewed at 可忽略性/edithistory

  1. 1.0 1.1 Rubin, Donald (1978). "Bayesian Inference for Causal Effects: The Role of Randomization". The Annals of Statistics. 6 (1): 34–58. doi:10.1214/aos/1176344064.
  2. Rubin, Donald B.; Rosenbaum, Paul R. (1983). "The Central Role of the Propensity Score in Observational Studies for Causal Effects". Biometrika. 70 (1): 41–55. doi:10.2307/2335942. JSTOR 2335942.
  3. Rubin, Donald B.; Rosenbaum, Paul R. (1983). "The Central Role of the Propensity Score in Observational Studies for Causal Effects". Biometrika. 70 (1): 41–55. doi:10.2307/2335942. JSTOR 2335942.
  4. Yamamoto, Teppei (2012). "Understanding the Past: Statistical Analysis of Causal Attribution". Journal of Political Science. 56 (1): 237–256. doi:10.1111/j.1540-5907.2011.00539.x. hdl:1721.1/85887.
  5. Yamamoto, Teppei (2012). "Understanding the Past: Statistical Analysis of Causal Attribution". Journal of Political Science. 56 (1): 237–256. doi:10.1111/j.1540-5907.2011.00539.x. hdl:1721.1/85887.
  6. Pearl, Judea (2010). "On the consistency rule in causal inference: axiom, definition, assumption, or theorem?". Epidemiology. 21 (6): 872–875. doi:10.1097/EDE.0b013e3181f5d3fd. PMID 20864888.
  7. Pearl, Judea (2010). "On the consistency rule in causal inference: axiom, definition, assumption, or theorem?". Epidemiology. 21 (6): 872–875. doi:10.1097/EDE.0b013e3181f5d3fd. PMID 20864888.
  8. Imai, Kosuke (2006). "Misunderstandings between experimentalists and observationalists about causal inference". Journal of the Royal Statistical Society, Series A (Statistics in Society). 171 (2): 481–502. doi:10.1111/j.1467-985X.2007.00527.x.