Outline for Group Design
Formulate a proposal for a group design which is either an experiment, pre-experiment or quasi-experiment.
A) Name and diagram the type of experiment or quasi-experiment.
B) Describe the sample of subjects who comprise your experiment. Your description should be a summary of the number of subjects, their ages, sits., and other relevant demographic descriptors. What problem/need do the subjects share in common? Do they share any other characteristics which could be considered control variables? Describe your method of arriving at this sample. In other words, how did the subjects come to you or how did you get them to participate in this experiment? How many groups will be exposed to the experimental stimulus(i); will you employ a control group? Have you used randomization or some form of matching?
C) Name the dependent variable and describe when and how it will be measured. Use more than one method of measuring the dependent variable to increase the reliability and validity of your findings. Try to use pre-existing measurement instruments. Cite research literature that shows that the measurement instruments you plan to use have been proven to be reliable and valid. If you cannot find written support for your measurement instruments, explain why you believe that they are reliable and valid.
D) Describe the independent variable--
what treatment(s) or training will be provided by the clinical researcher
or someone from his/her team? What theoretical or empirical evidence do
you have which shows why this intervention should work?
How long will the treatment be provided? Be specific about the content
and format to which each subject in the experimental condition would
be exposed. How will you make certain that all subjects in the experimental
condition receive the exact same treatment? Describe the training and background
possessed by the worker who is carrying out the treatment.
E) Provide a well-written, one-tail experimental hypothesis indicating what you believe will be the effect of the experimental treatment. What test of statistical significance (t-test, f-test, or chi-square) will you use to see if changes are due to chance sampling errors or statistically significant?
F) Explain which threats to internal validity were controlled by the design and which were not.
G) Explain which threats to external
validity are present in your design and which have been controlled.
What suggestions can you make about how other researchers can use systematic
or direct replication to enable greater generalization of results?
PERSON(S) BEING RATED________________________RATING__________
| A | Named and diagrammed the type of design. | 2pts.__ | |
| B | Described the sample size of each group | 1 pt. __ | |
| Described the composition of each group. & # of groups | 2 pts.__ | ||
| Described the method of attaining the groups. | 1 pt. __ | ||
| C | Provided nominal and operational definition of the prob. | 1 pt. __ | |
| Described what indicators (scales, single items) will be used to measure the dependent variable | 1 pt. __ | ||
| Described methods (survey, observation, existing data) of collecting info about the dependent variables | 1 pt. __ | ||
| Used pre-existing indicators with reliability
cited or
Used new indicators arguing rationally for high reliability |
1 pt. __ | ||
| --------------------------------------------------------------
Used pre-existing indicators with validity cited or Used new indicators arguing rationally for high validity -high validity |
1 pt. __ | ||
| Tried for non-reactive indicators | 1 pt. __ | ||
| Described when & how often measurements will be taken | 1 pt. __ | ||
| Used triangulation (more than 1 indicator & more than 1 method of measuring the dependent variable) | 1 pt. __ | ||
| Described data collector & whether s/he was blind about whether data are from control or experimental Ss. | 1 pt. __ | ||
| Included a copy of all measurement instruments | 1 pt. __ |
|
|
|||||
| D | Provided logical and/or empirical support for selecting this intervention | 2pts. __ | |||
|
1 pt. __ | ||||
| Discussed the sequence, frequency & duration of intervention sessions | 2pts.__ | ||||
| Described the content and format of intervention | 3pts.__ | ||||
| Described background of person(s) who provided intervention | 1 pt. __ | ||||
| Discussed how to ensure treatment integrity (Did each subject truly receive the treatment as planned?) | 1 pt. __ | ||||
| E | Provided well-written alternative hypothesis & correct statistical test | 2pts.__ | |||
| F | Discussed threats to internal validity: controlled and not | 1 pt. __ | |||
| G | Discussed threats to external validity: controlled and not | 1 pt. __ | |||
Mahler, SWK 317--Outline for Single Subject Design
A. Choose a client from your field placement or develop an imaginary client-situation. Describe the behavior(s) and/or attitude problem(s) which this person has in clear and measurable terms. The problem must be one that can be measured incrementally ( a continuous variable)
B. The Baseline Phase
Devise a way of measuring the client's behavior and/or attitude during a baseline period. You can mention the initial frequency of the behavior, the intensity of behavior (or feeling or attitude) and/or the duration. In the case of an attitude, you can describe the position or value the client holds which results in problems for him/her or significant others. Make sure to define the problem in nominal and operational terms. What methods of measurement will be taken? What instruments, if any, will be used? Who will do the observing/measuring? How reliable and valid are the instruments and the measurers? Over what period of time will baseline measures be taken? How frequently will the dependent measure be taken? Will multiple (several indicators) measures be taken during the baseline period? What level of measurement are your dependent measures? Make sure to give a convincing explanation of your procedure for attaining baseline data.
C & D. The Intervention Phase
Your intervention should be formulated as a response(s) to your ideas about the dynamics of the problem and the client's strengths and needs. Think aloud and jot down your ideas about what contributes to the client's problem and what treatment, training, or intervention might help the client. Develop and give a rationale for a minimum of two strategies which logically could reduce the client's problematic behavior/attitude. Cite social science research literature that supports your treatment choices. Make sure to explain the strategy. The strategy(ies) is the independent variable. Explain the order and length of treatment (for each strategy). Name and provide letters which describe the single subject design you have formulated. Describe the measurement procedure during the treatment phase.
E. Type of time series design
Select a type of single subject design. Choose a design that shows two
interventions and is as strong in internal validity as possible. Describe
whether you chose a withdrawal, multiple baseline, and/or multiple treatment
design to test the effects of the independent variables Include a diagram;
for example: a-b-a-c.
Periodic measurement of the dependent variable(s)
At what time intervals will measurements of the dependent variable(s)
be taken? Will the same measurements be taken at each measurement interval?
Provide a letter diagram describing your clinical research design.
F. Threats to Internal Validity
What threats to internal validity were eliminated (or controlled for)
and which were not eliminated by the design you formulated?
G. Discuss the Issue of External Validity and Single-Subject Designs
What threats to external validity were eliminated and which threats
to external validity were not eliminated by your design?
Mahler, SWK 317--Evaluation Sheet for Single-Subject Design
NAME(s): __________________________
Points will be earned, grading your work in each of the following areas (WELL OK POORLY)
|
|
Target problem was clearly described & defined in operational terms. Subject was described (gender, age, race, situation) |
|
__ | |
|
|
Selected more than one method to measure the client’s target behavior prior to intervention. |
|
__ | |
| Attempted to use methods and/or indicators that are non-reactive. |
|
__ | ||
| Used methods or indicators that are reliable. Cited references to confirm reliability or offered rational explanation |
|
__ | ||
| Used methods or indicators that are valid. Cited references to confirm validity or offered rational explanation |
|
__ | ||
| Attached measurement device(s) (including newly created ones) |
|
__ | ||
|
|
A theoretical relationship btw the problem and the strategy was explained.(Why should this strategy work with this kind of problem in this sit?) |
|
|
|
| An empirical study was cited that argued in favor of this intervention |
|
__ | ||
| The strategy was explained in detail so that each session was outlined |
|
|
||
| The time sequence for this strategy was clearly described (how often, for how long each time, over what period of time) |
|
|
||
|
|
A theoretical relationship btw the problem and the strategy was explained.(Why should this strategy work with this kind of problem in this sit?) |
|
|
|
| An empirical study was cited that argued in favor of this intervention |
|
|
||
| The strategy was explained in detail so that each session was outlined |
|
|
||
| The time sequence for this strategy was clearly described (how often, for how long each time, over what period of time) |
|
|
| E | Named and diagrammed the type of single subject design. Described whether a withdrawal, multiple baseline, and/or multiple treatment design was used to test the effects of the independent variables | 3 | __ | |
| Provided clear description of the sequence and intervals in which measurements would be taken during the baseline, treatment, and non-treatment phases. | 2 | __ | ||
| Discussed ethical and/or practical considerations | 1 | __ | ||
| F | Discussed IV threats that were eliminated by design | 1 | __ | |
| Discussed IV threats that were not eliminated | 1 | __ | ||
| G | Discussed EV threats that were reduced by the design | 1 | __ | |
| Discussed EV threats that were not controlled. | 1 | __ | ||
| Explained replication as a way to enhance external validity | 1 | __ |