Friday, July 20, 2012

Phase 2

There are so many competing actions needed right now I can't seem to move forward at all.
So this is my attempt to list what needs to be done and so form a plan of action.

  1. write paper 1 - lit review identifying gaps and hence need for this project
  2. thematic analysis of data from phase 1 - write  a paper on findings - need to adress the research questions identified in proposal
  3. use findings from analysis to inform the development of an evaluation framework to be tested in phase 2
  4. identify the projects to be used as case study in phase 2
  5. write a plan of action for the case study approach - something to give to project leaders
  6. have initial meetings with project leaders of two projects. Get ethics info and consent forms ready.

Action plan - phase 2
"The investigator will act in the role of Participant-as-Observer (Gold, 1958) of the evaluation and project process(es), actively participating with the project members and documentation and providing a depth to the research which would not be possible with an observer-only role (Babchuk, 1962)." (proposal, June, 2012)


  1. Meet with the project team. Show the list of questions which will be used as part of the data gathering instrument. Answer any of their questions.
  2. First 'interview' for follow up on answers. [need to develop some more questions but may be those from the 'notes' column in the table below.]
  3. Explain that I will attend all of their project meetings (where possible) and take notes which i will use in my reflections. Act as participant-as-observer.
  4. Then I will meet two more times for 'interview', once after the progress report is due and again at the end of the project - perhaps after the final report is submitted. Each time, there will be a set of questions to be answered and then I will follow up on these in more detail in the interviews.
So in total there will be three interview stages but perhaps a number of people will be interviewed.

Questions for first interview - Phase 2. (Time required – approx. 1hr)


Area
Questions
Notes
1. project clarification
What is the nature of the project?
What is the focus of the project?
What is the scope of the project?
What are the intended outcomes?
What (if any) are the project outputs?
What are the operational processes developed to achieve the outcomes?
What is the conceptual and theoretical framework underpinning the project?
What is the context of the project?
Are their any identified risks?
What key values drive the project?
Are there sufficient resources/admin for this project?

Are the plans too ambitious?

What may happen to delay the project?
Has teaching time been factored in?
2. Evaluation purpose and scope
What are you evaluating?
Why is the evaluation being done?
Are you basing the evaluation on any particular method framework or approach?
How will the information be used?
Who will evaluate this project? Are they suitably skilled?
What value will the evaluation process add to the project?




Do they need training? Do they need some support resources?
3. Project Stakeholders and study audiences
Who are the stakeholders for the project and the audiences for the evaluation information?
Stakeholders- Who has an interest or stake in the project and/or its outcomes, and in the evaluation of the project?
Audiences - Who will be interested in the results of the study and what types of information do they expect from the evaluation?
How should competing interests be prioritised?
Have you asked for feedback on the project?
Use these to your advantage – to help guide the project.
Be clear to understand the difference between two groups.
4. Key evaluation questions
What are the KEQ? Some examples could be:
What processes were planned and what were actually put in place for the project?
Were there any variations from the processes that were initially proposed, and if so, why?
How might the project be improved?
What were the observable short-term outcomes?
To what extent have the intended outcomes been achieved?
Were there any unintended outcomes?
What factors helped and hindered in the achievement of the outcomes?
What measures, if any, have been put in place to promote sustainability of the project’s focus and outcomes?
What lessons have been learned from this project and how might these be of assistance to other institutions?

5. Data Collection Methods
How will the information be collected and analysed? What/who are the data sources?
What types of data are most appropriate?
What are the most appropriate methods of data collection?
How will the data be analysed and presented in order to address the key evaluation questions?
What ethical issues are involved in the evaluation and how will they be addressed?

6. Dissemination of Findings
How will the evaluation findings be disseminated? Who are the audiences for reports on the evaluation and what are their particular needs and interests?
What are the functions of reporting?
What reporting strategies will be used?
When will reporting take place?
What kinds of information will be included in evaluation reports?

Are the stakeholders involved in dissemination plans?

7. Evaluation Plan
What does your evaluation time line and activity schedule look like?
What measures do you have in place to ensure you don’t run out of time for the evaluation to take place as planned?
Who will you ask to review your evaluation plan?
Has time for reflection been built in to the plan?






1 comment:

Thank you for your comments!