1. Which of the following statements is not true? [TY3.1]
- Psychological measurement can involve the measurement of phenomena believed to be related to a given psychological state or process.
- Psychological measurement can involve the measurement of behaviour believed to result from a given psychological state or process.
- Psychological measurement can involve self-reports of behaviour believed to be related to a given psychological state or process.
- Psychological measurement can involve the self-reports of a sample drawn from a particular sub-population.
- Psychological measurement can involve direct examination of psychological states and processes.
2. A researcher conducts an experiment that tests the hypothesis that ‘anxiety has an adverse effect on students’ exam performance’. Which of the following statements is true? [TY3.2]
- Anxiety is the dependent variable, exam performance is the independent variable.
- Anxiety is the dependent variable, students are the independent variable.
- Anxiety is the independent variable, students are the dependent variable.
- Anxiety is the independent variable, exam performance is the dependent variable.
- Students are the dependent variable, exam performance is the independent variable.
3. An experimenter conducts a study in which she wants to look at the effects of altitude on psychological well-being. To do this she randomly allocates people to two groups and takes one group up in a plane to a height of 1000 metres and leaves the other group in the airport terminal as a control group. When the plane is in the air she seeks to establish the psychological well-being of both groups. Which of the following is a potential confound, threatening the internal validity of the study? [TY3.3]
- The reliability of the questionnaire that she uses to establish psychological health.
- The size of the space in which the participants are confined.
- The susceptibility of the experimental group to altitude sickness.
- The susceptibility of the control group to altitude sickness.
- The age of people in experimental and control groups.
4. What distinguishes the experimental method from the quasi-experimental method? [TY3.4]
- The scientific status of the research.
- The existence of an independent variable.
- The existence of different levels of an independent variable.
- The sensitivity of the dependent variable.
- The random assignment of participants to conditions.
5. Which of the following is not an advantage of the survey/correlational method? [TY3.5]
- It allows researchers to examine a number of different variables at the same time.
- It allows researchers to examine the relationship between variables in natural settings.
- It allows researchers to make predictions based on observed relationships between variables.
- It allows researchers to explain observed relationships between variables.
- It is often more convenient than experimental methods.
6. Which of the following statements is true? [TY3.6]
- Case studies have played no role in the development of psychological theory.
- Case studies have all of the weaknesses and none of the strengths of larger studies.
- Case studies have none of the weaknesses and all of the strengths of larger studies.
- Case studies should only be conducted if every other option has been ruled out.
- None of the above.
7. An experimenter, Tom, conducts an experiment to see whether accuracy of responding and reaction time are affected by consumption of alcohol. To do this, Tom conducts a study in which students at university A react to pairs of symbols by saying ‘same’ or ‘different’ after consuming two glasses of water and students at university B react to pairs of symbols by saying ‘same’ or ‘different’ after consuming two glasses of wine. Tom predicts that reaction times will be slower and that there will be more errors in the responses of students who have consumed alcohol. Which of the following statements is not true? [TY3.7]
- The university attended by participants is a confound.
- The experiment has two dependent variables.
- Reaction time is the independent variable.
- Tom’s ability to draw firm conclusions about the impact of alcohol on reaction time would be improved by assigning participants randomly to experimental conditions.
- This study is actually a quasi-experiment.
8. What is an extraneous variable? [TY3.8]
- A variable that can never be manipulated.
- A variable that can never be controlled.
- A variable that can never be measured.
- A variable that clouds the interpretation of results.
- None of the above.
9. Which of the following statements is true? [TY3.9]
- The appropriateness of any research method is always determined by the research question and the research environment.
- Good experiments all involve a large number of participants.
- Experiments should be conducted in laboratories in order to improve experimental control.
- Surveys have no place in good psychological research.
- Case studies are usually carried out when researchers are too lazy to find enough participants.
10. A piece of research that is conducted in a natural (non-artificial) setting is called: [TY3.10]
- A case study.
- A field study.
- A quasi-experiment.
- A survey.
- An observational study.
11. “Measures designed to gain insight into particular psychological states or processes that involve recording performance on particular activities or tasks.” What type of measures does this glossary entry describe?
- State measures.
- Behavioural measures.
- Physiological measures.
- Activity measures.
- Performance measures.
12. “An approach to psychology that asserts that human behaviour can be understood in terms of directly observable relationships (in particular, between a stimulus and a response) without having to refer to underlying mental states.” Which approach to psychology is this a glossary definition of?
- Behaviourism.
- Freudianism.
- Cognitivism.
- Radical observationism.
- Marxism.
13. “The complete set of events, people or things that a researcher is interested in and from which any sample is taken.” What does this glossary entry define?
- Total sample.
- Complete sample.
- Reference sample.
- Reference group.
- Population.
14. “Either the process of reaching conclusions about the effect of one variable on another, or the outcome of such a process.” What does this glossary entry define?
- Causal inference.
- Induction.
- Deduction.
- Inductive reasoning.
- Inferential accounting.
15. “The extent to which the effect of an independent variable on a dependent variable has been correctly interpreted.” Which construct is this a glossary definition of?
- Internal inference.
- External inference.
- External validity.
- Holistic deduction.
- Internal validity.
-The most customary experiment consists of three main parts:
Independent and Dependent Variables
Pretesting and Post-testing
Subjects tend to undergo behavioral changes as a result of participating in an experiment. Examples of such changes include:
Experimental and Control Groups
ex. having two characteristics
-present or non-present
ex. a variable may be the independent variable in one study but serve as a dependent variable in another experiment.
- when doing experimental research, it is very important to observe the experimental and control groups very closely.
- using a control group helps a researcher observe changes in the experiment due to the independent variable, by making such changes aeem more obvious.
(Insert graph pg 234)
The Double-Blind Experiment
Double-Blind experiment- an experimental design in which the researchers are ignorant to which groups are experimental or control.- using a double-blind experiment reduces biases of results from researchers.
- Pgymalion Effect- people perform better when more is expected of them
- For example, college students are frequently used in experiments. While they are a relatively easy group to access and analyze, one issue of concern is their generizability: given that college students are such an enormously diverse group, is it sensible to make generalizations about them? This question points out a potential drawback to using such large and heterogeneous groups as college students.
- Probability sampling, randomization, and matching are methods of attaining comparability between the experimental and control groups.
- Randomization is the preferred method.
- However, randomization and matching may be used together.
Probability Sampling
- one begins with a sampling constant containing the entire population involved in the study. Then the researcher selects two samples that will be copies of each other.
- the degree of resemblance (representativeness) will be a product of the sample size.
- this type of sampling is seldom used in any experiment.
Randomization- a process for selecting people to be in a control or experimental group. Randomization is preferable because it limits the potential bias (systemic error) in the experiment, as it provides an equal likelihood that "good" and "poor" performers will be in the experimental group. However, there is still a chance that more of one category may end up in a given group. The best way to overcome this is a large sample size; hence, randomization is ideal when the population is very big.
-there are several ways of randomly selecting people for a control or experimental group; for example:
1) Out of a sample of 1600, you can select every 8th person for each group. (selection rate of 1/8) 2) Out of a sample of 100 you can select every other person to be in each group. (selection rate of 1/2; a higher rate yields a better likelihood for authenticity, and you can afford a higher rate when the sample size is small)- Regardless of the way that the researcher decides to place subjects into each group, this process must be done in a fair and equal manner, because each sample will be a reflection of the total population's characteristics.
Matching
Matching- a process in which subjects are paired based on the similarities of one or more variables. One member of the pair is assigned to the experimental group while the other is assigned to a control group.- matching is a way to compare the experimental and control groups.
- matching is more efficient if a quota matrix is constructed for all of the relevant characteristics.
- the overall average description of the experimental and control group should be the same.
- As a rule of thumb, both the control and experimental groups should have the same ages, gender and racial composition, etc.
Matching or Randomization?
Randomization over Matching
- a researcher may not be aware which variables are relevant for the matching process, and thus he should turn to randomization
- most statistical calculations that are used in analyzing results of experiments will all assume the randomization process is occurring.
Combining Randomization and Matching
- allows researchers to discover different ways of analyzing situations.
Pre-experimental Research Designs
- Donald Campbell and Juilan Stanley introduce three "pre-experimental" designs:
Sources of Internal Invalidity
Internal Invalidity- explains that there is a possibility that conclusions gathered from experimental results may not precisely represent the occurrences in the experiment.- Campbell, Stanley, and Thomas Cook pointed out several sources of internal invalidity:
Sources of External Invalidity
External Invalidity- explains the possibility that conclusions gathered from results may be a "generalization about the real world."- Campbell and Stanley describe four forms:
- Soloman Four Group Design
- four rules of interactions of pre-testing, post-testing, and variables.
- Post-testing-Only Control Group Design
Validity Internal validity
– the ability to eliminate alternative explanations of the treatment effect
- a combination of validity and reliability issues
- represents the possibility that the results of an experiment do not accurately reflect what occurred in the experiment
- classical experiments tend to eliminate all internal validity
External validity
- the ability to generalize experimental findings to events and settings outside the experiment itself
- results of the experiment may not translate to the real world
Web-Based Experiments
- nowadays researchers are using the internet for conducting experiments.
Reasons:
-cheaper -less time consumingNatural Experiments
- often occur but not prominent
Weaknesses
ex. what happens in the experiment may not take place in the real world.Strengths
ex. the independent and dependent variable are isolated from one another in study. This makes changes easy to spot and conclusions to be drawn.- relative ease of replication
- scientific rigor
- experiments involve misleading subjects
- experiments may potentially cause harm to individuals
Avoid biased Items
An issue with prejudice is the lack of a correct definition. Given different circumstances, how prejudice is defined can be derived. Concerning questionnaires, bias is defined by the property of the question in-which encourages the respondent to answer in a particular way. Ex. "Don't you agree with the CEO of Apple..." would manipulate the question by promoting agreement with Apple's CEO. This bias usually would increase support in this situation, yet at the cost corrupting the results. An example of this would be:
More support vs Less support
"Halting rising crime rate" vs "Law enforcement"; "Dealing with drug addiction" vs "Drug rehabilitation"; "Scholarly financial support" vs "Financial aid"
Furthering biasism, the social desirability regards questions and answers. In this case, people are more prone to respond with an answer that will make them look good. This can deter a participants revealing their true thoughts, especially when being questioned face-to-face. To counter this problem, a questioner should deter from asking inquires that makes the questioner feel embarrassment, inhumane, perverted, stupid, or socially disadvantaged. The asking of hypothetical situations can also elicit biased responses due to the respondent answering a question that has no direct consequence on his/her being. The use of proper or specific names has also shown biases, with more positive valued names directed to men than woman.
Experiments involve taking action and then observing the consequences of that action. Experiments seek to answer the question: how do subjects change as a result of the experimental treatment? They fundamentally address causality; however, establishing causality in experiments is not necessarily an easy process. Experiments are infrequently used in sociology. Within the social sciences, they are more often used in social psychology. They are frequently used in the natural sciences and medicine.
Experiments are typically well-suited for projects that involve limited and well-defined concepts and propositions. They are better suited for explanatory purposes rather than descriptive ones.
The classical experiment design serves as the foundation for all modern experiments. Major components of this method include independent and dependent variables, pre-testing and post-testing, and experimental and control groups.
Validity issues in experimental research - Internal validity refers to the possibility that the conclusions drawn from experiment results may not accurately reflect what went on in the experiment itself. External validity refers to the possibility that conclusions drawn from experimental results may not be generalizable to the "real" world.
Internal validity is the ability to eliminate alternative explanations of the treatment effect. It is really a combination of validity and reliability issues. Internal validity represents the possibility that conclusions drawn from experimental results may not accurately reflect what happened in the experiment itself. Sources range from history, maturation, testing, instrumentation, statistical regression, selection bias, experimental mortality, causal time order, diffusion or imitation of treatments, compensation, compensatory rivalry, and demoralization. Classic experimental designs eliminate virtually all threats to internal validity. External validity – the ability to generalize experimental findings to events and settings outside the experiment itself. It represents the possibility that conclusions drawn from experimental results may not be generalizable to the “real” world. A general problem with experiments is that subjects are rarely recruited using probability sampling techniques. Another problem is the artificiality of the experimental setting. Internal and external validity are both very important when it comes to experiments.
- Basis for all modern experiments
- Major components of classical experiment
- Independent and dependent variables
- Pre-testing and post-testing
- Experimental and control groups
In social research, experiments are a mode of scientific observation. Experiments involve taking action and observing the consequence of that action. Experiments are more appropriate for some topics and research purpose than others. Experiments are especially well suited to research projects involving relatively limited and well defined concepts and propositions. Because experiments focus on determining causation, they are also better suited to explanatory than to descriptive purposes.
The most conventional type of experiment involves three major pairs of components: independent and dependent variables, pretesting and posttesting, and experimental and control groups. An experiment examines the effects of independent variable on a dependent variable. The independent variable takes the form of an experimental stimulus which is either present or absent. The experimenter compares what happens when the stimulus is present to what happens when it is not. To be used in an experiment, both independent and dependent variables must be operationally defined and they must be operationally defined before the experiment begins.
In experimental design subjects are measured in terms of a dependent variable which is called pretesting, exposed to a stimulus representing an independent variable, and then remeasured in terms of the dependent variable which is called posttesting. Any difference between the first and last measurements on the dependent variable are then attributed to the independent variable. Experimental group is a group of subjects to whom an experimental stimulus is administered in experimentation. Control group is a group of subjects to whom no experimental stimulus is administered and who should resemble the experimental group in all other respects in experimentation. The comparison of the control group and the experimental group at the end of the experiment points to the effect of the experimental stimulus.
Pre-testing: the measurement of a dependent variable along subjects
Post-testing: the measurement of a dependent variable among subjects after they have been exposed to an independent variable.
- Post testing allows researchers to measure if the experiment changed something
Hawthorne Effect:subjects perform better when in an experiment
Demand Characteristics:subjects try to give the answer they think is correct
Placebo Effect: subjects respond to the belief that they are receiving a drug
Experimental group:a group of subjects to whom the experimental stimulus is administered
Control group:a group of subjects to whom no experimental stimulus is administered but who should resemble the experimental group in all other respects
The Double-Blind Experiment:an experimental design in which neither the subjects nor the experimenters know which is the experimental and which is the control group
Selecting Subjects:
- Randomization: a technique for assigning experimental subjects to experimental and control groups
- Matching: the procedure whereby pairs of subjects are matched on the basis of their similarities on one or more variables and one member of the pair is assigned to the experimental group and the other to the control group
- Quota matrix: used to create experimental and control groups by finding pairs of matching subjects and assigning one to the experimental group and the other to the control group
Variations on Experimental Design
- One-shot case study: a single group of subjects is measured on a dependent variable following an experimental stimulus
- One-group pre-test post-test design: a pre-test is added for the experimental group, but lacks a control group
- Static-group comparison: includes experimental and control groups, but no pre-test
Validity in Experimental Design
- Internal Validity: the ability to eliminate alternative explanations of a treatment effect (i.e., a combination of validity and reliability issues). Internal validity represents the possibility that conclusions drawn from experimental results may not accurately reflect what happened in the experiment itself.
- External Validity: the ability to generalize experimental findings to events and settings outside the experiment itself. External validity represents the possibility that conclusions drawn from experimental results may not be generalizable to the real world.
Strengths of Experimental Method:
- Isolation of experimental variable's impact over time
- Replication
Weaknesses of Experimental Method:
- Artificiality of laboratory setting
- Cost
- Ethics
Ethics and Experiments As with other methods for conducting social research, there are ethical considerations to take into account when creating and carrying out an experiment. 1) Deception should only be used if it is necessary for the purposes of the research; that is, it must be confirmed that there is no way of getting around the use of deception. Additionally, deception should only be used when the potential benefits of the research outweigh the risks of deceiving subjects. Using deception is considered an ethical violation, so its use must essential, and the research in which it is used must have the potential for valuable, implicative findings. 2) If it is necessary that the experiment is intrusive in some way in the participants' lives, considerations should be made so that they will not be physically or psychologically damaged. The potential value should, again, outweigh the possible risks of such intrusion in experiments.