The Great Falls Montana United Way has generously funded Coiner Evaluation Organization (CEO) to complete a multi-year evaluation of their Fit and Fall Proof (FFP) Program that will be implemented in May 2012. The aim of the evaluation is to understand and chart the implementation and delivery of the FFP Program to residents in Great Falls Montana. The evaluation team considers the FFP program would fall into the process stage of development. Process evaluation assesses “what works” and establishes the ability to achieve the programs outcomes (Harris, 2010). A triangulation methodology will be used to combine different research methods to include the combining of qualitative and quantitative data to answer the research questions and provide a conclusion and recommendations. The research methods selected are: interviews; one-on-one and group, surveys, literature review, and statistical analysis of the data. The analysis and interpretation of the data collected will be provided to stakeholders after six months of implementing the program then again at one year with recommendation to complete “process evaluation” as needed. CEO will gladly do an outcome evaluation if requested. The input from stakeholders will be ongoing to obtain their input and values before any final conclusions are disseminated. A communication plan that includes goals, tools and a timeline will be utilized for disseminating results. The design will be both quantitative and qualitative. After engaging stakeholders in developing evaluation questions the following were identified:
Strategies/Activities/Outputs
• Is the FFP program being implemented as intended?
• What type, quantity, and quality of services are being provided to participants of the FFP Program ?
• What materials were developed and what training was provided to participants and trainers involved in the FFP program?
• What was the level of participation for each center?
• Did activities yield the anticipated output?
• What is the satisfaction of the participants related to the program components?
CEO will follow the Participatory Framework for Evaluation model: design, collect data, analyze and interpret and report findings.
Step-by step of each procedure in the evaluation plan
• Question overview-overview of evaluation questions; based on concerns and priorities of the stakeholders, components of the logic model and are we on track.
• Purpose of the evaluation use and the users—CEO will identify the purpose of the evaluation and who will have access to the results.
• Program description—Fit and Fall Proof™ (FFP), is an exercise-based fall prevention program for older adults that was implemented in Idaho and will be implemented in Great Falls Montana also for older adults
• Development of logic model
• Methods (frequency, duration and location)
o Participant recruitment (65+): posters and advertising at the six Senior Centers; United Way and Senior Citizen Centers and Great Falls District Health will recruit; participation will be volunteer, demographic information will be collected, sign-in sheets for each session; a pre and post evaluation will be offered but will not be mandatory; this will help with measuring pre/post activity levels, satisfaction with the program and any recommendations.
o Incentives: all participants will receive a t-shirt at sign-up as well as a bright green wrist band that is encouraged to be worn to each class
o Tools: surveys developed and validated in conjunction with stakeholders to assess satisfaction with and impression of program, i.e.,
