PubMed HealthSearch

SEARCH · PubMed Health

Results for “Program Evaluation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4Linked to original sources

Program evaluation of Texas mental health and mental retardation centers.

The diversity of programs offered by the 24 mental health and mental retardation centers in Texas required that program evaluation take a management-by-objectives approach, with each center examined as a unique system with its own goals, techniques, and activities. The approach required the centers to develop statements of management objectives, which they did with varying degrees of success. The evaluations were carried out by site-visit teams. The authors describe the evaluation process, the difficulties encountered, and some of the beneficial effects.

Community Mental Health Services

Oral rehydration program evaluation by quality assurance sampling in rural Haiti.

An oral rehydration program in rural Haiti was evaluated by quality assurance sampling. The quality assurance sampling method and its application are described. The indicators measured were knowledge of the oral rehydration salts packet, knowledge of preparation of the solution from the packet, oral rehydration therapy use, and knowledge of preparation of the solution from salt and sugar. Coverages of the first two indicators were adequate, coverages of the latter two were inadequate. The method is a useful low-cost approach to evaluation of program coverage.

Child, Preschool

Toy Control Program evaluation.

The Toy Control Program for the Apple IIe microcomputer is a software and hardware package developed for the training of single-switch scanning skills. The specially designed scanning programs provide on screen visual feedback and activate a battery-powered toy to reinforce performance. This study examined whether the training of preschool subjects in single-switch scanning skills with the Toy Control Program would result in increased task completion scores and increased levels of attention to task, as compared with conditions of toy activation only and microcomputer programs with screen reinforcement only. The results showed that the subjects paid significantly more attention to the toys as reinforcers (p less than .01). No significant difference was found for the performance results of the three conditions. These findings support the use of a program like the Toy Control Program, which integrates the instructional capabilities of a computer with the reinforcement potential of a toy and the creativity of a therapist.

Cerebral Palsy

Program evaluation guidelines for the rehabilitation professional.

The overall purpose of the present chapter was to provide a set of guidelines to new rehabilitation investigators for conducting program evaluation in the burgeoning field of clinical rehabilitation. The specific objectives were to encourage investigators to develop a research consultation network, consider the benefits of utilizing a theoretical framework in specifying program objectives, assess program implementation, and to discuss the need and methods for ensuring high quality data. There is currently a widening gap in the United States and Canada between rehabilitation professionals who provide clinical services and those who conduct research on the effects of rehabilitation interventions. This is a matter of great concern and consequence. Without a firm commitment to evaluation, clinical rehabilitation practice may ultimately flounder in the mire of conjecture and ad hominem debate characteristic of therapeutic movements that have come and gone (e.g., the human potential movement). It is essential for the life of the discipline that rehabilitation programs be firmly grounded in both humanitarian and scientific principles.

Goals

Educational program evaluation: the University of Vermont family nurse practitioner program.

Graduates of the Family Nurse Practitioner (FNP) Program at the University of Vermont, Burlington, were surveyed to determine if the FNPs had enlarged their nursing roles following completion of the program. A sample of Vermont nurses served as a control group. Results of a questionnaire, used to obtain information about the nurses' training, functions, and attitudes, indicated that FNPs performed activities associated with an expanded nursing role more frequently than did their nonpractiioner counterparts. There was evidence that the two groups differed in their attitudes toward various aspects of their nursing roles. The evaluation is an ongoing study; as the number of program graduates increases, further characterization of their roles will be possible.

Attitude of Health Personnel

The Medical Education Evaluation Program of the state of Ohio.

In October 1988, seven foreign medical graduates participated in the first administration of the examination devised by the Medical Education Evaluation Program (MEEP) mandated by the State Medical Board of Ohio. The MEEP was established to provide an objective evaluation of an applicant's clinical competencies; passing the MEEP examination was intended to certify that the applicant's clinical skills were comparable to those of a medical student graduating from a school accredited by the Liaison Committee on Medical Education. An applicant who successfully passed the MEEP examination and fulfilled the other Ohio licensure requirements would be eligible to take the Federation Licensing Examination (FLEX) and apply for an unrestricted license to practice medicine in Ohio. The paper describes the origin and development of the MEEP examination and the testing modalities selected (multiple-choice examinations and the use of standardized patients). Four fundamental areas were tested; these are named and described, along with the method for calculating scores for each area and the criteria for passing the different components of the examination. Although the small sample size prohibited meaningful data analysis for the performance of the first group of MEEP candidates, the MEEP examination appears to meet psychometric standards of certifying and licensing examinations, based on data from comparable tests taken by beginning fourth-year medical students in New England and NBME Part III examination examinees. Some potential pitfalls of the MEEP examination are mentioned, as well as the fact that it presents a challenge to boards of medical examiners of other states to implement performance-based assessments of physicians who graduate from non-accredited medical schools.

Clinical Competence

Plasma glucose levels: long-term effect of diet in the Chicago Coronary Prevention Evaluation Program.

In 150 middle-aged men prone to coronary disease, long-term data based on the Chicago Coronary Prevention Evaluation Program's diet showed that there was a favorable effect on fasting glycemia level and glucose tolerance. This diet for reducing obesity and hypercholesterolemia was low in cholesterol and saturated fat and moderate in polyunsaturated and total fat, with replacement of some fat by carbohydrate. At 2 years, decreased weight and serum cholesterol values of normoglycemic men were accompanied by a modest but significant fall in fasting and postload glycemia; at 4 years. fasting glycemia levels remained slightly below baseline. For men with suspect fasting hyperglycemia at baseline, sustained fall in weight and serum cholesterol value was associated with sizeable long-term reductions in fasting glycemia and improvement of glucose tolerance. Decrease in plasma glucose was significantly related to decrease in weight. No evidence of impairment of glucose tolerance with years-long consumption of this diet was recorded.

Blood Glucose

Program evaluation in a rural community mental health center.

Can a rural community mental health center with limited resources meet the federal guidelines for program evaluation? This case example shows that a rural center can comply with the guidelines through evaluation activities tailored to its special needs and small size.

Colorado

Centers for Disease Control performance evaluation program in bacteriology: 1980 to 1985 review.

This report presents a summary and analysis of data from the Centers for Disease Control performance evaluation program in bacteriology for the 6-year period 1980 to 1985. During this period, the number of laboratories enrolled in the program ranged from about 750 to 1,000. Identification results reported by participating laboratories for representative species of six major groups of bacteria were placed into five response categories that were based on the level and accuracy of the identifications. Data on the performance of participants with bacterial groups and performance with selected species within each major group were analyzed. Overall, participants experienced the least difficulty in identifying species or serogroups of members of the gram-positive and gram-negative cocci. Participants encountered greater difficulties with anaerobes, gram-positive bacilli, and miscellaneous gram-negative bacteria. Identification of members of the family Enterobacteriaceae was of moderate difficulty. Problems in identifying certain bacterial species were probably related to a number of factors such as the characteristics of the species, its frequency of occurrence, the state of technology available for identification, and the state of proficiency and quality control in individual laboratories at the time of testing. Examples are given of improvements over time in the identification of certain bacterial species. Laboratories participating in an external proficiency testing program should take full advantage of the benefits of participation by instituting measures to correct testing deficiencies identified by the program.

Bacteria

Economic aspects of clinical decision making: evaluating clinical programs.

The importance of program evaluation is discussed, and issues to consider when designing and conducting program evaluations in the restructuring health-care environment are identified. Program evaluation is carried out for the purpose of supporting specific decisions for individual organizations. Unlike scientific research, program evaluation accepts time as a constraint, and its audience is composed of managers. Considering the likelihood of being fixed-dollar contractors or employees in an era of managed care, professionals must try to understand the cost objectives of management; similarly, managers must understand the patient-care objectives of professionals. Program evaluation can help provide the necessary documentation of a program's impact on the outcome of health care, which influences the total cost of care. Successful program evaluation requires careful planning, and issues related to six steps in the planning process are described: defining the objective of the evaluation, choosing and defining the program to be evaluated, choosing indicator variables, designing the evaluation, presenting the results, and planning follow-through. While program evaluation is too often understood in negative terms, particularly as something done because of external pressure, it is as much a part of management as is directing day-to-day operations or developing a long-range plan.

Decision Making

[Evaluating programs for preparation to old age: some theoretical thoughts and a practical example (author's transl)].

In the first part methodically satisfactory experimental designs for evaluating programs for preparation to old age on the basis of Cambell & Stanely (1963) are sketched including conditions which hinder the realization of the ideal notions. In the second part an experiment for comparing two preparatory courses to old age using different methods of instruction is described. It was observed that the more demanding teaching method resulted in more anxiety for old age. This led to the conclusion, that programs for preparation to old age should be planned as a sequence of several units in which the mastering of the new ideas may be learned and in which this learning process may be supervised.

Age Factors

Comprehensive drug-use evaluation program in a health maintenance organization.

Development and use of a drug-use evaluation (DUE) program for hospital and outpatient facilities of a health-maintenance organization (HMO) are described. A full-time pharmacist coordinates the DUE program. Primary components of the DUE program are (1) establishment and use of drug therapy management protocols, (2) periodic review and evaluation of drug-use statistics by the pharmacy and therapeutics (P&T) committee, (3) monitoring of pharmacist interventions, and (4) evaluation of specific drug use within individual medical staff departments. Information from all DUE activities is channeled through the P&T committee and linked to the HMO's overall quality assurance program. The DUE program has the support of the HMO physicians. It has enhanced the quality of drug use and identified opportunities to further improve the quality of patient care. In surveys by the Joint Commission on Accreditation of Healthcare Organizations, the HMO facilities have received no recommendations. Pharmacists and physicians have cooperated to develop a comprehensive DUE program for an HMO.

California

The Behavior Observation Instrument: a method of direct observation for program evaluation.

The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.

Activities of Daily Living

Readmission discount factors in program evaluation. An output value analysis of an adult psychiatry program.

The application of output value analysis, a type of benefit/cost analysis, to a psychiatric patient population is reported. A method for discounting the value of the program if a patient was readmitted within a year after discharge was introduced. The application of this discount factor reduces the value produced by the program and thereby reduces both productivity and effectiveness indices. When applied to groups known to differ in readmission rates, such as first admissions and readmissions or voluntary and involuntary admissions, the discount factor can accentuate group differences markedly. When selected diagnostic groups were compared, the discount factor could even reverse the relative standing of the groups.

Brain Damage, Chronic

Preceptor program evaluation demonstrates improved orientation.

Although the preceptor method of orientation is generally accepted as an effective mechanism for orienting newly employed nurses, very few evaluation studies of preceptor programs have been reported in the literature. This article describes a study designed prior to implementing a preceptor program at the University of Wisconsin Hospital and Clinics in order to measure the outcomes of the program. Data were collected on the satisfaction of orientees, preceptors, other staff nurses, and nurse managers. The preceptor role and preceptor's level of comfort and skill were studied. To quantify the economic impact, both length of orientation and nursing turnover were considered.

Education, Nursing, Continuing

[Outpatient insulin therapy in type II diabetes: program evaluation and calculation of cost saving].

BACKGROUND: Evaluation of the results of a program of outpatient insulinization in type II diabetes and the resulting saving in cost. METHODS: Data from 39 patients with that disease (mean age 62 years) were evaluated four months after the beginning of insulin therapy and diabetic education. The economic cost of the outpatient program was calculated and compared with the cost if patients had been admitted. RESULTS: A good metabolic control was achieved with a significant reduction (p less than 0.001) of the glycemic levels from 281 +/- 43 mg/dl (15.6 +/- 2.4 mmol/l) to 156 +/- 22 mg/dl (8.6 +/- 1.5 mmol/l). Fructose levels were reduced from 4.7 +/- 0.54 mmol/l to 3.29 +/- 0.51 mmol/l. Seventeen patients had some episode of mild hypoglycemia. The insulin dose was increased from 0.27 +/- 0.06 U per kg and day to 0.42 +/- 0.1 (11 patients required two insulin doses). At onset, no patient controlled the glycemia at home, while at the end of the program 46% did so. The evaluation of each educational end-point showed a mean of 4.8 +/- 0.3 (from 0 to 5); the end-point with the best score were the technical aspects. The economic cost of the program was 230.39 ptas per patient and day, versus 1351.75 ptas per patient and day if the patients had been admitted. CONCLUSIONS: Outpatient insulinization in type II diabetes has very good results and is economically effective provided the adequate equipment and facilities are available.

Adult