Event Calendar

Tuesday, March 5, 2024

What would it take to Change your Inference? Informing Discourse about Causal Inferences in the Educational Ecosystem

Start Date: 3/5/2024 12:00 PM EST
End Date: 3/5/2024 3:00 PM EST


Organization Name: AEFP

Contact:
AEFP
Email: info@aefpweb.org
Phone: (602) 644-1521

Ken Frank, Michigan State University Foundation Professor will be leading this workshop.
 

Abstract: Statistical inferences are often challenged because of uncontrolled bias.  There may be bias due to uncontrolled confounding variables or non-random selection into a sample.  We will turn concerns about potential bias into questions about how much bias there must be to invalidate an inference. For example, challenges such as “But the inference of a treatment effect might not be valid because of pre-existing differences between the treatment groups” are transformed to questions such as “How much bias must there have been due to uncontrolled pre-existing differences to make the inference invalid?”

By reframing challenges about bias in terms of specific quantities, this course will contribute to scientific discourse about uncertainty of causal inferences.  Critically, while there are other approaches to quantifying the sensitivity of inferences(e.g., Robins and Rotnitzky, 1995; Rosenbaum and Rubin 1983, Rosenbaum, 2000), the approaches presented in this workshop based on correlations of omitted variables (Frank, 2000) and the replacement of cases (Frank and Min, 2007; Frank et al, 2013) have greater intuitive appeal.  In this sense the techniques inform a conversation among a broad set of stakeholders in the educational ecosystem, helping the educational community apply evidence to practice.