Worksheet 3A-Focusing the Evaluation in the Logic Model
| If this is the situation | Then these are the parts of the logic model I would include in my evaluation focus | |
| 1 |
Who is asking evaluation questions of the program? A committee comprising of representatives from CDC, state and federal government and local community will ask the evaluation questions as the program is targeting the community members. The community-based organization will try to determine whether the accomplishments made by the program are sufficient to warrant for a contribution of foundational resources. |
Outcomes Outcome-based evaluations are the best means of determining whether a program is a success. This type of evaluation will measure the activities implemented by the program and the results from the respective activities (Diaz et al., 2014). Outcome evaluations will measure how the program’s participants and circumstances change and if the program has been a factor in causing the change (Diaz et al., 2014). Some of the outcomes will include trying to establish if there are sustained reductions of obesity in children, and ascertain whether there is evidence suggesting that the reduction in obesity rates is a result of the program and not outside factors. |
| 2 |
Who will use the evaluation results and for what purpose? The program will use the results to make a case to the committee. The committee will use the results in establishing whether there is a need for additional funding the program. CDC will use the results from the program in implementing national wide obesity intervention programs in case the program is a success. |
Costs It is vital to find out the costs used in “curing” a child from obesity by ensuring that the disorder is brought and kept down. By focusing on the costs, it will enable one in making certain if the program is feasible or just a waste of resources. |
| 3 |
In Step 1, did we identify the interest of other stakeholders that we must take into account? Advocacy and lobby groups do now ant emphasis on parents/guardian training as the only solution to eliminating obesity since they believe obesity is a lifestyle problem due it eating unhealthy diets and lack of physical activity. Dietitians and physical exercise therapists want evidence of sufficient cases to justify the time spent on screening. |
The evaluation must examine other activities beyond the training of parents and guardians in reducing obesity to meet the advocacy and lobby groups’ requirements. The evaluation must include measurement of the number of obesity children found by provider screening. |
Worksheet 3B-“Reality Checking” the Evaluation Focus
| If this is my answer to these questions | Then I would conclude the questions in my evaluation focus are/are not reasonable ones to ask right now. | |
| 1 |
How long has the intervention been underway? Two years |
Reasonable- Since the implementation of the program, two years have elapsed, and this is enough time as there is an expectation that some form of progress is expected on the targeted outcomes. |
| 2 |
How intensive/ambitious is the intervention? Multi-faceted effort or simple intervention? An entirely implemented child obesity reduction program is a multi-faceted and intensive effort. A multi-faceted approach is one that involves two or more interventions (Squires et al., 2014). In this case, elimination and reduction of obesity will not just involve changing dietary patterns but also ensure the children engage in physical exercises. |
Reasonable- The program is rigorous enough to generate these results if things go as planned. |
| 3 |
How much (time and money) can be devoted to the evaluation of this effort? Middling amount that will enable for some worthy evaluation but not for complex and grandiose analyses. |
Reasonable- The resources are sufficient to evaluate the expected outcomes. |
Delegate your assignment to our experts and they will do the rest.
Summary
Worksheet 3A provides a snippet of the evaluation process that will be used in the program. The worksheet is based on Step 1 and Step 2 of the program evaluation process. The logical model used in step there is vital in this case as in this case; there is no need for evaluating the entire program (Centre for Disease Control and Prevention, 2011). According to the worksheet, it is dived into three categories which include establishing who shall ask the evaluation questions, who shall use the evaluation results and for what and identifying the interest of some of the stakeholders. A committee comprising of representatives from the CDC, State and Federal government and local community shall ask the evaluation questions. The program and committee members in making various decisions will use the results. Likewise, it is essential to take the interest of the advocacy groups, physical exercise therapists, and dietitians into account. The outcomes and costs will be the most important parts included during the carrying out of the evaluation.
Worksheet 3B allows for the determination of whether the evaluation is feasible or realistic (Center for Disease Control and Prevention, 2011). Worksheet 3B contains a set of three questions, which will be used in outlining the feasibility of the evaluation. These include establishing the program’s stage development, the intensity of the program and relevant resources and logistical considerations. According to the Worksheet, the program has been underway for two years making reasonable for carrying out an evaluation. The program also observes a multi-faceted and intensive approach, which qualifies it as being reasonable for carrying out an evaluation. The resources to be used in evaluation are middling and not too expensive, making it reasonable and realistic.
Critique
Worksheet 3A is an evaluation scope that allows one to make the best decisions on how best to focus the evaluation. The worksheet is based on the logic model that was built in Step 1 and Step 2. The determination of the evaluation focus is based on a case-by-case decision, as outlined by the CDC (Centre for Disease Control and Prevention, 2011). The Centre for Disease Control and Prevention (2011) report states that utility considerations should be based on a set of four questions. These include 1) What is the purpose of the evaluation? 2) Who will use the evaluation results? 3) How will they use the evaluation results? 4) What do other key stakeholders need from the evaluation? However, the worksheet had a set of only three questions instead of the recommended four questions. This is an indication that the utility considerations was not fully ascertained by the worksheet with the most important question, what is the purpose of the evaluation? Missing out. This question is essential as it serves as a foundation for the evaluation methods; design and questions (Centre for Disease Control and Prevention, 2011).
Worksheet 3B aims at determining the feasibility considerations of the evaluation and program. The Center for Disease Control and Prevention (2011) report states that this is based on a set of three questions 1) What is the stage of development of the program 2) How intensive is the program and 3) What are the relevant resource and logistical consideration? The worksheet has efficiently met these and answered the questions. The worksheet has been able to prove that the program is feasible as it is well established. However, the worksheet does not allow one to provide a detailed description of the three questions.
Step 4: Gather Credible Evidence
Worksheet 4A-Evaluation Questions, indicators, and data Collection Methods/Sources
| Logical Model Components in Evaluation Focus | Indicator(s) or Evaluation Questions | Data Method(s)/Source(s) | |
| 1 | Screening | Initial and follow-up screening is completed by the children identified as being high risk | Physical exercise therapists and dietitians log data |
| 2 | Campaigns and awareness | The relevant information on obesity has reached the high-risk children and their families. | Demographical algorithms |
| 3 | Training of parents and guardians | The families of children within the region have received the appropriate training on strategies through which they can use to reduce obesity | Training logs |
| 4 | Implementing physical exercises | All children, both obese and overweight, are engaging in weekly exercises such as bicycle riding, jogging and running. | Logs of physical exercise therapists |
| 5 | Obesity causes identified | Strategies aimed at reducing obesity are formulated based on the identified causes | Survey of families |
| Interview of families | |||
| 6 | Obesity cases reduced | The number of overweight and obese children reduce by 35% within the first three months of program implementation. | Follow-up assessments by dietitians |
Worksheet 4B- Data Collection Logistics
| Data Collection Method/Source | From whom will these data be collected | By whom will these data be collected and when | Security or confidentiality steps | |
| 1 | Follow-up assessment | Dietitians, physical exercise therapists | Dietitians and exercise therapist will gather the data and compile it after every three months | Client information will be kept private and confidential during follow-ups assessments |
| 2 | Logs | Physical exercise therapist, dietitians | Physical exercise therapist and dietitians will gather this data and compile it after every three months | Client information shall be kept private during the checking of logs. |
| 3 | Demographical algorithms | State demographical databases | State officials from the planning department will compile the data after every three months | Personally identifiable information will be kept anonymous. |
| 4 | Surveys | Parents and guardians | Trained data collectors will gather the data from parents and guardians after every six months. | The survey templates will be stored safely, and client information will remain anonymous |
| 5 | Interviews | Parents and guardians | Trained interviewers will gather data from parents and guardians after every six months | Recording devices will be stored safely. |
Summary
Worksheet 4A aims at ascertaining the indicators, data collection methods and sources and the logical model components that will be the core focus of the evaluation. The worksheet identified six major logical components that would be used in the evaluation focus, and they included; screening, campaigns and awareness, training of parents and guardians, implementing physical exercises, obesity causes identification and reduction of obesity cases. Each of the logical components had its indicators that would be used in establishing whether it was attained or not. The worksheet also highlighted various data collection methods/sources, which included follow-up assessments, interviews, surveys, log data and demographical algorithms.
Worksheet 4 B involved outlining the various data collection logistics. This involves the physical infrastructure, timing and methods that will be used in the handling and gathering of the evidence. The worksheet has identified five data collection methods/sources, which include follow-up assessments, logs, demographical algorithms, surveys and interviews. The worksheet has listed from whom the data shall be gathered, and they include; dietitians, physical exercise therapists, state demographical databases, parents and guardians. Trained data collectors, interviewers, dietitians, physical exercise therapists and officials after every 3 to 6 months will gather the data. The worksheet has also identified various security and confidentiality steps, which includes anonymity of persona identifiable information, storing of interview recording devices and filled survey forms.
Critique
Worksheet 4A aims at laying down a foundation of the data gathering process. Evidence gathering must include the following considerations indicators, methods of data gathering/sources of evidence, quantity, quality and logistics. Worksheet 4A has listed all the requirements an indication that through it, the data gathering process is going to be smooth and effective.
Worksheet 4B has adhered to FDA regulations that state there must be adequate provisions that will protect the subjects’ privacy and ensure there is data confidentiality (Breault, 2006). Moreover, the logistics and protocols procedures as cited by the CDC (2011) report including when you will collect the data? 2) Who will be participating in the evaluation? 3) Who will collect the information? 4) How will confidentiality be maintained? Have been met by the worksheet. However, the worksheet does not specify whether the data is going to be gathered from all the participants or just a sample.
References
Breault, J. L. (2006). Protecting human research subjects: The past defines the future. Ochsner Journal , 6 (1), 15-20.
Centers for Disease Control and Prevention. (2011). Introduction to program evaluation for public health programs : A self-study guide. Retrieved from https://www.cdc.gov/eval/guide/index.htm
Diaz, T., Guenther, T., Oliphant, N. P., & Muñiz, M. (2014). A proposed model to conduct process and outcome evaluations and implementation research of child health programs in Africa using integrated community case management as an example. Journal of Global Health , 4 (2).
Squires, J. E., Sullivan, K., Eccles, M. P., Worswick, J., & Grimshaw, J. M. (2014). Are multifaceted interventions more effective than single-component interventions in changing health-care professionals' behaviours? An overview of systematic reviews. Implementation Science , 9 (1), 152.
