SEARCH · PubMed Health

Results for “Program Evaluation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3Linked to original sources

PubMed1979

Program evaluation research: an experimental cost-effectiveness analysis of an armed robbery intervention program.

An armed robbery alarm system was implemented in 48 different stores in two separate geographical areas for 6 months and 12 months, respectively. The alarms were placed in the two separate areas at different times and all alarms were eventually removed. Thus, multiple baseline and reversal strategies were used to evaluate program impact. A device planted in a cash drawer was triggered whenever "bait" money was removed from the drawer sending an alarm signal directly to police cars and headquarters. On-scene apprehensions of armed robbers within target stores were greatly increased even though the armed robbery systems did not deter robbery incidents nor influence the court disposition of the cases. There was also no crime deterrence, crime displacement, or increased apprehensions in either the immediate neighborhoods of target stores or on a city-wide basis. The cost effectiveness of the program was calculated to be poor even though the program is being maintained because of the absence of an alternative robbery apprehension technology.

Cost-Benefit Analysis↗

PubMed1979

Program evaluation for effective resource management and accountability.

A means of determining the effectiveness of public programs as a basis for justifying resource allocation to these programs is urgently needed. Program evaluation can provide the data base required for program decision-making and modification. A ten-step model for planning and carrying out an evaluation is suggested as a guideline for program personnel who may be assigned to evaluation responsibilities. Nutrition professionals must become aware of the increasing need for evaluation and of the procedures for conducting the evaluation process within programs for which they are responsible. Failure to provide documentation of adequate, on-going evaluation of effectiveness may lead to a loss of resources for the program and, ultimately, to the demise of the nutritional care program.

Evaluation Studies as Topic↗

PubMed1976

A protocol for program evaluation.

In May 1975 the Center for Educational Development, College of Medicine, University of Illinois at the Medical Center, conducted a workshop titled, "Evaluation in the Health Professions." Five tracks were offered at the workshop and one focused on program evaluation. The 12 participants from this track worked on their respective projects for four-and-one-half days from an earlier version of the protocol presented in this article. Much of the workshop was tape recorded, and this article is the result of reviewing the tapes and recording the problems that were encountered with the original version of the protocol for program evaluation.

Curriculum↗

PubMed1992

Methods of psychoeducational program evaluation in mental health settings.

Psychoeducational programs for families of the mentally ill became widespread during the 1980s as a means of providing a forum for the relevant education and mutual support of participants. While these programs are thought to be extremely useful as interventions, very little emphasis has been placed on evaluation as a means of demonstrating their effectiveness in achieving goals. There is a possibility, then, that psychoeducation will continue to flourish with little direct evidence of positive outcomes for its family participants. This article consists of a literature review of existing methods of psychoeducational program evaluation, both quantitative and qualitative, all of which may be applicable in certain circumstances. The process by which an evaluation instrument was developed for a program with families of the mentally ill is then presented in some detail.

Family↗

PubMed1979

A mathematical model of speedskating performance improvement for goal setting and program evaluation.

An analysis of world class performance improvement over chronological time was used to develop mathematical curves of performance for each speedskating event. The equations were calculated using an unconstrained non-linear least squares iterative curve-fitting technique. A non-linear model was selected to satisfy the principle of diminishing returns, that is, it is more difficult to achieve a unit of performance improvement as performance approaches the theoretical limits of man. Minimum criteria of acceptance for each curve were: 1) the coefficient of determination must be 0.90; 2) the year 2000 predicted value must be less than the current world record; and 3) the curve must be progressive, i.e. satisfy the principle of diminishing returns. Satisfactory curves were calculated for seven of the eight male and female events studied. A four year Olympic cycle was noted and a definite change in performance trend was identified as occurring in the mid 1960's. The calculated mathematical curves can be used in three applications: 1) setting objective individual goals and evaluating these goals; 2) evaluating and comparing training programs on successive years; and 3) evaluating total programs.

Female↗

PubMed1989

Program evaluation.

In this chapter, evaluation was defined as a decision-making process that leads to suggestions for action to maintain and/or improve effectiveness and efficiency of programs and participants. Purposes for evaluating nursing programs in education and service were explained. The principles that govern evaluation in nursing, which are the same as those that govern the evaluation of any programmatic endeavor, were presented. The unique and specific character of nursing and its settings, which must be taken into account when strategies and techniques for implementing these principles are designed and/or selected, were discussed. Of major concern was the selection of an approach to evaluating nursing programs. Models for evaluating programs that have served as prototypes for evaluation in a variety of settings and fields were presented. More specifically, the views addressed included: Tyler's Objective-Based Evaluation, Accreditation/Certification Evaluation, Stake's Client-Centered Evaluation, Stufflebeam's Decision-Oriented Evaluation, Taba's Experimental-Research Evaluation, and Scriven's Consumer-Oriented Evaluation. Also discussed was the Utilization-Focused Approach to Evaluation. However, while all prototypes contribute in some manner to the conditions necessary for conducting a comprehensive evaluation of nursing programs, none are complete or sufficient in this regard. An eclectic approach to evaluating nursing programs developed by Waltz in an attempt to incorporate the strengths of existing models, minimize limitations, and expand thinking to include additional components and concerns with particular relevance to nursing was discussed. Attention was given to definition of terms, purposes for the evaluation, what the focus of the evaluation is, how the evaluation should proceed, when evaluation should occur, and major audiences. Specific considerations that increase the likelihood that an evaluation will be comprehensive but cost-efficient were elaborated.

Accreditation↗

PubMed1990

Centers for Disease Control perspective on quality assurance for human immunodeficiency virus type 1 antibody testing. Model Performance Evaluation Program.

Ensuring high quality in human immunodeficiency virus type 1 (HIV-1) antibody testing is an essential component of the organized public health response to epidemic HIV-1 infection. In 1986, the Centers for Disease Control designed the Model Performance Evaluation Program to assess and improve the analytic quality of HIV-1 antibody testing. In addition, the program was designed to gather information about HIV-1 antibody testing practices. The utility of this information is in identifying potential barriers to quality throughout the total testing process. Currently, 1405 laboratories participate in the program. Participating laboratories are located both within and outside the United States and consist primarily of hospitals, blood banks, health departments, and independent laboratories. The responses to a questionnaire completed by 1050 program-participant laboratories in September 1988 suggest that at several stages in the HIV-1 antibody total testing process, laboratory practices (including the interpretation of Western blot patterns) are variable and that standardization of these practices would improve quality.

Centers for Disease Control and Prevention, U.S.↗

PubMed1990

AIDS education for the podiatric physician. Evaluating program impact.

An important component in the development of any educational program is the evaluation of its effectiveness. The program described in this article was designed in such a way that its impact on practitioners' knowledge, attitudes, and clinical practices regarding human immunodeficiency virus (HIV) could be evaluated. One hundred ten participants were asked to complete pre-conference and post-conference tests in order to measure improvement that resulted from program attendance. The author presents both a description of the conference and a summary of the evaluation results, along with suggestions for improving future educational programs.

Acquired Immunodeficiency Syndrome↗

PubMed1990

Indirect immunofluorescence test performance and questionnaire results from the Centers for Disease Control Model Performance Evaluation Program for human immunodeficiency virus type 1 testing.

Results from laboratories performing indirect immunofluorescence (IIF) testing for human immunodeficiency virus type 1 antibody and participating in the Centers for Disease Control Model Performance Evaluation Program in 1988 are presented. Approximately 90% of all laboratories receiving specimen panels or questionnaires furnished results to the Centers for Disease Control. In September 1988, 111 reports were received from IIF laboratories from 34 states and nine countries; most of these laboratories did IIF testing in conjunction with other antibody tests. Hospital laboratories were the most common type of laboratory participating in the program. Laboratories that performed IIF employed fewer personnel and performed testing less frequently than did laboratories that performed enzyme immunoassays or Western blot (immunoblot) tests and were likely to use a commercial test kit. Most of the laboratories that referred specimens for IIF testing sent them to the state laboratory. The analytic specificity for the Model Performance Evaluation Program specimens was 98.5% when indeterminate results on a negative specimen were considered correct (negative) and 89.6% when indeterminate results on a negative specimen were considered incorrect; analytic sensitivity was 94.8% when indeterminate results on a positive specimen were correct (positive) and 91.4% when indeterminate results on a positive specimen were considered incorrect. When indeterminate results were considered correct, all types of laboratories (blood bank, state, hospital, independent, and other) had analytic specificities over 96%, and all manufacturers had analytic specificities above 95%. All types of laboratories had analytic sensitivities over 92%, and analytic sensitivities were above 94% for all manufacturers and reagent sources except Cellular Products. Comparison of percentages of correct responses between IIF and Western blot assays on those samples for which there was good agreement on the target interpretation revealed no significant differences. Both individual donor and diluted materials were included in the evaluations; the diluted donor material presented the greatest testing difficulty. Within-survey reproducibility was about 93% overall and by specimen type. Between-survey reproducibility was about 81% for negative and indeterminate specimens and 88.5% for positive specimens, for an overall between-survey reproducibility of 84.3%. Differences in performance were noted when results were compared by type of laboratory and test manufacturer.

Acquired Immunodeficiency Syndrome↗

PubMedDate not supplied

The development of a comprehensive, institution-based patient risk evaluation program: I. Development, content, and data management.

There is a need for standardization of risk factor questionnaires for epidemiological research. This paper describes the development and implementation of a comprehensive cancer risk evaluation program at the University of Texas M.D. Anderson Cancer Center. A detailed self-administered questionnaire is given to all newly registered adult patients. The format of the instrument, coding systems, quality control measures, and data entry mechanisms are discussed. The criteria for the choice of a data base management system are outlined. The identification of high-risk patient subgroups is possible, and it is feasible to link this data base with clinical and biochemical data. There is considerable potential for collaborative research using this risk evaluation program, bringing together basic scientists, clinicians, and epidemiologists.

Cancer Care Facilities↗

PubMed1978

Program evaluation as health services research.

Evaluation of health program is necessary for more rational allocation of scarce resources. Steps in evaluation include: 1)Specification of the program goals, 2) Description of the program, 3) Definition and measurement of outcome, 4) Assessment of intervening variables, 5) Analysis of data, and 6) Implementation of findings. Examples from impirical evaluation studies are presented to illustrate one practical application of these steps. While the random controlled trial is a most powerful tool, it is very difficult to apply in complex human services programs. In the future, more use of multivariate matching of groups to approximate a quasi experimental situation will be needed. Education of health professionals in methods of evaluation is necessary to promote planned improvement in health services.

Boston↗

PubMed1991

Program evaluation as a measure of the quality of a new approach to community psychiatric care.

The effectiveness of a new approach to providing psychiatric rehabilitation services in community settings will be assessed using a combination of quality assurance principles and program evaluation techniques. A new Assertive Community Rehabilitation Program (ACRP) is evaluated and compared with existing hospital rehabilitation programs. Measures of service efficiency, admission, discharge and readmission rates, and service costs are made for 100 new referrals, 99 inpatients and 117 outpatients. Follow-up interviews use standardized measures of clients' quality of life, clinical status, client and staff satisfaction, and community resource utilization. After 19 weeks of operation, the ACRP has prevented more admissions, and discharged more inpatients than the comparison programs. Readmission rates have not differed. Results at the end of the one-year project using this program-based quality assurance approach will facilitate managerial decisions about the future of rehabilitation services.

Adult↗

PubMed1987

Beyond model programs: evaluation of a countywide system of residential treatment programs.

Assessing deinstitutionalization as a social policy requires examining a system of programs rather than single, "model" services. The authors report an evaluation of 19 residential treatment programs in Hennepin County, Minnesota, that provide three different levels of care (intensive, transitional, and supportive) for mentally ill clients. Data on client characteristics, program outcomes, and hospitalization costs were collected in two study periods between 1980 and 1985. The results showed that the programs served three distinct client subpopulations that differed in recidivism, vocational status, discharge setting, and costs according to the type of program. Clients in all programs made substantial gains in community integration, and as a group the programs were cost-effective.

Chronic Disease↗

PubMed1976

The politics of program evaluation: the mental health experience.

The authors discuss evaluation studies of the community mental health centers program. The emphasize that program evaluation is a political activity to influence the allocation of public resources. They examine its relationship to decision-making, power conflicts, and bureaucratic goals. They point out that the evaluator is seldom totally objective. They also emphasize the increasing use of evaluation by politicians.

Community Mental Health Services↗

PubMed1990

Drug-use evaluation programs for psychotropic medications.

Drug-use evaluation (DUE) programs for psychotropic medications at a state-operated mental health center are described. DUE programs were developed at Western Missouri Mental Health Center to monitor prescribing of medications in the hospital and ambulatory-care settings. DUE criteria were developed for all major groups of psychotropic medications: antipsychotics, antidepressants, antianxiety and hypnotic agents, lithium, and antiparkinsonian drugs. The criteria appear on special forms developed for the programs; pharmacists use these forms to evaluate every medication order for inpatients and every 50th medication order for ambulatory-care patients. Physicians are alerted to noncompliant prescribing practices by memorandum, oral consultation, or both. In 3204 inpatient DUEs conducted from July 1986 to December 1988, orders for antiparkinsonian drugs showed the poorest compliance with DUE criteria. In both the hospital and ambulatory-care settings, antiparkinsonian agents required the most follow-up. The overall compliance rate for inpatient DUEs was 84%; for ambulatory-care DUEs, the compliance rate was 64%. As a result of the ambulatory-care DUE program, basic laboratory studies and dyskinesia rating scales are being ordered on a more timely basis. These DUE programs have increased pharmacist monitoring of patient care and improved documentation of medication use.

Drug Utilization↗

PubMed1975

Program evaluation of Texas mental health and mental retardation centers.

The diversity of programs offered by the 24 mental health and mental retardation centers in Texas required that program evaluation take a management-by-objectives approach, with each center examined as a unique system with its own goals, techniques, and activities. The approach required the centers to develop statements of management objectives, which they did with varying degrees of success. The evaluations were carried out by site-visit teams. The authors describe the evaluation process, the difficulties encountered, and some of the beneficial effects.

Community Mental Health Services↗

PubMed1991

Oral rehydration program evaluation by quality assurance sampling in rural Haiti.

An oral rehydration program in rural Haiti was evaluated by quality assurance sampling. The quality assurance sampling method and its application are described. The indicators measured were knowledge of the oral rehydration salts packet, knowledge of preparation of the solution from the packet, oral rehydration therapy use, and knowledge of preparation of the solution from salt and sugar. Coverages of the first two indicators were adequate, coverages of the latter two were inadequate. The method is a useful low-cost approach to evaluation of program coverage.

Child, Preschool↗

PubMed1991

Toy Control Program evaluation.

The Toy Control Program for the Apple IIe microcomputer is a software and hardware package developed for the training of single-switch scanning skills. The specially designed scanning programs provide on screen visual feedback and activate a battery-powered toy to reinforce performance. This study examined whether the training of preschool subjects in single-switch scanning skills with the Toy Control Program would result in increased task completion scores and increased levels of attention to task, as compared with conditions of toy activation only and microcomputer programs with screen reinforcement only. The results showed that the subjects paid significantly more attention to the toys as reinforcers (p less than .01). No significant difference was found for the performance results of the three conditions. These findings support the use of a program like the Toy Control Program, which integrates the instructional capabilities of a computer with the reinforcement potential of a toy and the creativity of a therapist.

Cerebral Palsy↗