Survey design

README.md

@@ -73,8 +73,8 @@ Thu, Feb 8 | [Qualitative data analysis](pages/feb08-coding.md) | [slides](slide
 Tue, Feb 13 | [In-class activity: qualitative coding & thematic analysis](pages/feb12-coding-hands-on.md) | [slides](slides/08-qualitative-coding-recitation.pdf)
 Thu, Feb 15 | [Qualitative analysis in the age of LLMs](pages/feb15-coding-with-llms.md) | [slides](slides/09-qualitative-coding-llms.pdf)
 Tue, Feb 20 | [Project proposal presentations](pages/feb20-proposals.md) | [slides](slides/10-proposals.pdf)
-Thu, Feb 22 | [Types of errors in probability survey research](pages) | 
-Tue, Feb 27 | [Questionnaire design and multi-item scales](pages) | 
+Thu, Feb 22 | [Types of errors in probability survey research](pages) | [slides](slides/11-survey-design-pt1.pdf)
+Tue, Feb 27 | [Questionnaire design and multi-item scales](pages) | [slides](slides/12-survey-design-pt2.pdf)
 Thu, Feb 29 | Experimental design | 
 ~~Tue, Mar 5~~ | ~~Spring break, no class~~ |
 ~~Thu, Mar 7~~ | ~~Spring break, no class~~ |

pages/feb22-surveys-pt1.md

@@ -0,0 +1,23 @@
+## L11: Types of Errors in Probability Survey Research ([pdf](../slides/11-survey-design-pt1.pdf))
+
+[![Lecture11-Survey-Design](../assets/images/11-surveys-pt1.jpg)](../slides/11-survey-design-pt1.pdf)
+
+In this lecture series we talk about how to conduct effective probability sample surveys. We discuss the fundamental requirements that must be met if one wants to generalize results with statistical confidence from the few who are surveyed to the many they are selected to represent. 
+
+In particular, we cover four main types of error that surveyors need to try to minimize in order to improve the survey estimates:
+
+- Coverage Error occurs when the list from which sample members are drawn does not accurately represent the population on the characteristic(s) one wants to estimate with the survey data
+- Sampling Error exists anytime we decide to survey only some, rather than all, members of the sample frame.
+- Nonresponse Error occurs when those who do not respond are different from those who do respond in a way that influences the estimate.
+- Measurement Error occurs when respondents are unable or unwilling to provide accurate answers, which can be due to poor question design, survey mode effects, interviewer and respondent behavior, or data collection mistakes.
+
+
+### Readings
+
+> Dillman, D., Smyth, J. D., & Christian, L. M. (2014). [Internet, Phone, Mail and Mixed-Mode Surveys: The Tailored Design Method (4th ed.)](https://www.google.com/books/edition/Internet_Phone_Mail_and_Mixed_Mode_Surve/fhQNBAAAQBAJ?hl=en&gbpv=1&dq=Internet,+Phone,+Mail+and+Mixed-Mode+Surveys:+The+Tailored+Design+Method&pg=PR11&printsec=frontcover). Hoboken, NJ: Wiley.
+
+- Chapter 1: Sample Surveys in our Electronic World
+- Chapter 2: Reducing People's Reluctance to Respond to Surveys 
+- Chapter 4: The Fundamentals of Writing Questions
+- Chapter 5: How to Write Open and Closed Ended Questions
+

pages/feb27-surveys-pt2.md

@@ -0,0 +1,32 @@
+## L12: Questionnaire Design and Multi-Item Scales ([pdf](../slides/12-survey-design-pt2.pdf))
+
+[![Lecture12-Survey-Design](../assets/images/12-surveys-pt2.jpg)](../slides/12-survey-design-pt2.pdf)
+
+We continue our discussion of survey design, focusing on Lickert scales and factor analysis. We also go over an example applying factor analysis to burnout survey data following [this tutorial](https://rpubs.com/kiffercard/Essentials-for-Analyzing-Survey-Data-Using-R).
+
+
+### Readings
+
+> Dillman, D., Smyth, J. D., & Christian, L. M. (2014). [Internet, Phone, Mail and Mixed-Mode Surveys: The Tailored Design Method (4th ed.)](https://www.google.com/books/edition/Internet_Phone_Mail_and_Mixed_Mode_Surve/fhQNBAAAQBAJ?hl=en&gbpv=1&dq=Internet,+Phone,+Mail+and+Mixed-Mode+Surveys:+The+Tailored+Design+Method&pg=PR11&printsec=frontcover). Hoboken, NJ: Wiley.
+
+- Chapter 1: Sample Surveys in our Electronic World
+- Chapter 2: Reducing People's Reluctance to Respond to Surveys 
+- Chapter 4: The Fundamentals of Writing Questions
+- Chapter 5: How to Write Open and Closed Ended Questions
+
+---
+> Hof, M. (2012). [Questionnaire Evaluation with Factor Analysis and Cronbach’s Alpha](http://www.let.rug.nl/nerbonne/teach/rema-stats-meth-seminar/student-papers/MHof-QuestionnaireEvaluation-2012-Cronbach-FactAnalysis.pdf). Student project. Seminar in Methodology and Statistics. University of Groningen
+
+> Yong, A. G., & Pearce, S. (2013). [A beginner’s guide to factor analysis: Focusing on exploratory factor analysis](https://sites.ualberta.ca/~lkgray/uploads/7/3/6/2/7362679/exploratoryfactoranalysis.pdf). Tutorials in quantitative methods for psychology, 9(2), 79-94.
+
+Good examples of how to assess the reliability and validity of a survey scale (factor analysis, Cronbach's Alpha).
+
+---
+> Cairns, P. (2019). [Doing better statistics in human-computer interaction](https://www.google.com/books/edition/Doing_Better_Statistics_in_Human_Compute/-5CFDwAAQBAJ?hl=en&gbpv=1&dq=Doing+better+statistics+in+human-computer+interaction&pg=PR11&printsec=frontcover). Cambridge University Press.
+
+- Chapter 15: What Makes a Good Likert Item?
+- Chapter 16: The Meaning of Factors
+- Chapter 17: Unreliable Reliability: The Problem of Cronbach’s Alpha 
+- Ch18: Tests for Questionnaires
+
+Lots of detail on Likert items and scales. Examples of what can go wrong when questions are worded or answers options are given even slightly differently.