Login/Sign up

World Association of International Studies

PAX, LUX ET VERITAS SINCE 1965
Post More on Statistical Methods: Selection Bias
Created by John Eipper on 08/15/15 4:59 AM

Previous posts in this discussion:

Post

More on Statistical Methods: Selection Bias (Francisco Ramirez, USA, 08/15/15 4:59 am)

Imagine that you go to the doctor and she prescribes medication to lower your bad cholesterol. You have the audacity to ask how she knows this medicine causes the bad cholesterol to get lower. She responds that there are studies that show that people who take this medication show decreases in their bad cholesterol more so than those who do not. You, a budding scientist, then ask but how do we know that the medicine takers did not also change their diets and increase their exercise. Furthermore, how do we know that the medicine takers did not differ from the others in other important respects to start with, e.g. better educated. That is, how do we know that the medicine is really the cause of the reduction? The doctor smiling responds that subjects were randomly assigned to the experimental condition where they got the medication or the control condition where they did not (maybe they got an alternative treatment). And you can read all about this in the New England Journal of Medicine! Your confidence increases and with good reason.

The problem with many studies that simply compare homeschoolers with non-homeschoolers on a number of outcomes is that there is no way of knowing whether the difference is due to the homeschooling experience or to other factors that may have given homeschoolers a selection advantage. So, if in the studies the parents of the home schoolers were better educated and had access to more resources than the parents of the schooled, these differences may be what truly results in better outcomes. It is the diet and the exercise and not the medication that lowered the cholesterol.

In more personal terms, I have no way of seriously knowing whether it is my mentoring that leads my advisees to educational and occupational success. These advisees were not randomly assigned to me. They were selected with less than 7 percent of the applicants offered entry. And, they were given more generous fellowships than in most other universities. So, how can I assert that my mentoring causes the favorable outcomes. I can point you to testimonials and to my mentoring awards. I can believe in myself and my judgments. But I know the problems with assuming that my mentoring is like the medication in an experimental study. I understand selection bias.

Therein lies one of the problems with all the studies that have been cited in favor of the thesis that homeschooling is on average better than other schooling. It may indeed work for the daughters of Enrique Torner. But our skepticism regarding the claim that on average homeschooling works better is based on our understanding of the uses and misuses of statistical analysis in social science research. Selection bias is a problem in a lot of research. On the other hand, selection bias is my best friend at Stanford!

JE comments:  This is an excellent explanation of selection bias.  Since they can benefit from his wisdom, Francisco Ramírez's students are truly the Select!


SHARE:
Rate this post
Informational value 
Insight 
Fairness 
Reader Ratings (1)
93%
Informational value100%
Insight100%
Fairness80%

Visits: 102

Comments/Replies

Please login/register to reply or comment: Login/Sign up

Trending Now



All Forums with Published Content (45708 posts)

- Unassigned

Culture & Language

American Indians Art Awards Bestiary of Insults Books Conspiracy Theories Culture Ethics Film Food Futurology Gender Issues Humor Intellectuals Jews Language Literature Media Coverage Movies Music Newspapers Numismatics Philosophy Plagiarism Prisons Racial Issues Sports Tattoos Western Civilization World Communications

Economics

Capitalism Economics International Finance World Bank World Economy

Education

Education Hoover Institution Journal Publications Libraries Universities World Bibliography Series

History

Biographies Conspiracies Crime Decline of West German Holocaust Historical Figures History Holocausts Individuals Japanese Holocaust Leaders Learning Biographies Learning History Russian Holocaust Turkish Holocaust

Nations

Afghanistan Africa Albania Algeria Argentina Asia Australia Austria Bangladesh Belgium Belize Bolivia Brazil Canada Central America Chechnya Chile China Colombia Costa Rica Croatia Cuba Cyprus Czech Republic Denmark East Europe East Timor Ecuador Egypt El Salvador England Estonia Ethiopia Europe European Union Finland France French Guiana Germany Greece Guatemala Haiti Hungary Iceland India Indonesia Iran (Persia) Iraq Ireland Israel/Palestine Italy Japan Jordan Kenya Korea Kosovo Kuwait Kyrgyzstan Latin America Liberia Libya Mali Mexico Middle East Mongolia Morocco Namibia Nations Compared Netherlands New Zealand Nicaragua Niger Nigeria North America Norway Pacific Islands Pakistan Palestine Paraguay Peru Philippines Poland Polombia Portugal Romania Saudi Arabia Scandinavia Scotland Serbia Singapore Slovakia South Africa South America Southeast Asia Spain Sudan Sweden Switzerland Syria Thailand The Pacific Tunisia Turkey Turkmenistan UK (United Kingdom) Ukraine USA (America) USSR/Russia Uzbekistan Venezuela Vietnam West Europe Yemen Yugoslavia Zaire

Politics

Balkanization Communism Constitutions Democracy Dictators Diplomacy Floism Global Issues Hegemony Homeland Security Human Rights Immigration International Events Law Nationalism NATO Organizations Peace Politics Terrorism United Nations US Elections 2008 US Elections 2012 US Elections 2016 US Elections 2020 Violence War War Crimes Within the US

Religion

Christianity Hinduism Islam Judaism Liberation Theology Religion

Science & Technology

Alcohol Anthropology Automotives Biological Weapons Design and Architecture Drugs Energy Environment Internet Landmines Mathematics Medicine Natural Disasters Psychology Recycling Research Science and Humanities Sexuality Space Technology World Wide Web (Internet)

Travel

Geography Maps Tourism Transportation

WAIS

1-TRIBUTES TO PROFESSOR HILTON 2001 Conference on Globalizations Academic WAR Forums Ask WAIS Experts Benefactors Chairman General News Member Information Member Nomination PAIS Research News Ronald Hilton Quotes Seasonal Messages Tributes to Prof. Hilton Varia Various Topics WAIS WAIS 2006 Conference WAIS Board Members WAIS History WAIS Interviews WAIS NEWS waisworld.org launch WAR Forums on Media & Research Who's Who