PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Program Evaluation”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10Linked to original sources

Policy-relevant program evaluation in a national substance abuse treatment system.

This article discusses recent trends in public and private substance abuse services and offers suggestions on how the evaluation of such services can inform clinical practice and policy making. This analysis focuses particularly on the Department of Veterans Affairs (VA), which operates the largest substance abuse treatment system in the United States. In recent years, there has been an erosion of services for substance abuse outside the VA. In contrast, due to increased funding from the U.S. Congress, the VA significantly expanded substance abuse treatment from 1990 to 1994. However, efforts to "reinvent" and downsize government initiated a reversal of this growth trend in 1994, and VA services may shrink further as the system becomes more decentralized and adopts managed care strategies from the private sector. Drawing from the VA Program Evaluation and Resource Center's (PERC) experience of evaluating the VA system and working with federal policy makers, this article presents examples and suggestions for making evaluations of substance abuse treatment systems more useful in policy discussions and in day-to-day clinical practice.

Forecasting↗

The Medical Education Evaluation Program of the state of Ohio.

In October 1988, seven foreign medical graduates participated in the first administration of the examination devised by the Medical Education Evaluation Program (MEEP) mandated by the State Medical Board of Ohio. The MEEP was established to provide an objective evaluation of an applicant's clinical competencies; passing the MEEP examination was intended to certify that the applicant's clinical skills were comparable to those of a medical student graduating from a school accredited by the Liaison Committee on Medical Education. An applicant who successfully passed the MEEP examination and fulfilled the other Ohio licensure requirements would be eligible to take the Federation Licensing Examination (FLEX) and apply for an unrestricted license to practice medicine in Ohio. The paper describes the origin and development of the MEEP examination and the testing modalities selected (multiple-choice examinations and the use of standardized patients). Four fundamental areas were tested; these are named and described, along with the method for calculating scores for each area and the criteria for passing the different components of the examination. Although the small sample size prohibited meaningful data analysis for the performance of the first group of MEEP candidates, the MEEP examination appears to meet psychometric standards of certifying and licensing examinations, based on data from comparable tests taken by beginning fourth-year medical students in New England and NBME Part III examination examinees. Some potential pitfalls of the MEEP examination are mentioned, as well as the fact that it presents a challenge to boards of medical examiners of other states to implement performance-based assessments of physicians who graduate from non-accredited medical schools.

Clinical Competence↗

Plasma glucose levels: long-term effect of diet in the Chicago Coronary Prevention Evaluation Program.

In 150 middle-aged men prone to coronary disease, long-term data based on the Chicago Coronary Prevention Evaluation Program's diet showed that there was a favorable effect on fasting glycemia level and glucose tolerance. This diet for reducing obesity and hypercholesterolemia was low in cholesterol and saturated fat and moderate in polyunsaturated and total fat, with replacement of some fat by carbohydrate. At 2 years, decreased weight and serum cholesterol values of normoglycemic men were accompanied by a modest but significant fall in fasting and postload glycemia; at 4 years. fasting glycemia levels remained slightly below baseline. For men with suspect fasting hyperglycemia at baseline, sustained fall in weight and serum cholesterol value was associated with sizeable long-term reductions in fasting glycemia and improvement of glucose tolerance. Decrease in plasma glucose was significantly related to decrease in weight. No evidence of impairment of glucose tolerance with years-long consumption of this diet was recorded.

Blood Glucose↗

Family medicine residency programs. Evaluating the need for different third-year programs.

We asked hospital chief executive officers (CEOs) and District Health Council executive directors (DHCs) to compare third-year family medicine residency programs and judge which are more needed in their communities. Care for the elderly and emergency medicine ranked highest among CEOs, while DHCs ranked care for the elderly and mental health highest. Academic family medicine and northern programs ranked lowest for both groups.

Attitude of Health Personnel↗

Program evaluation in a rural community mental health center.

Can a rural community mental health center with limited resources meet the federal guidelines for program evaluation? This case example shows that a rural center can comply with the guidelines through evaluation activities tailored to its special needs and small size.

Colorado↗

Centers for Disease Control performance evaluation program in bacteriology: 1980 to 1985 review.

This report presents a summary and analysis of data from the Centers for Disease Control performance evaluation program in bacteriology for the 6-year period 1980 to 1985. During this period, the number of laboratories enrolled in the program ranged from about 750 to 1,000. Identification results reported by participating laboratories for representative species of six major groups of bacteria were placed into five response categories that were based on the level and accuracy of the identifications. Data on the performance of participants with bacterial groups and performance with selected species within each major group were analyzed. Overall, participants experienced the least difficulty in identifying species or serogroups of members of the gram-positive and gram-negative cocci. Participants encountered greater difficulties with anaerobes, gram-positive bacilli, and miscellaneous gram-negative bacteria. Identification of members of the family Enterobacteriaceae was of moderate difficulty. Problems in identifying certain bacterial species were probably related to a number of factors such as the characteristics of the species, its frequency of occurrence, the state of technology available for identification, and the state of proficiency and quality control in individual laboratories at the time of testing. Examples are given of improvements over time in the identification of certain bacterial species. Laboratories participating in an external proficiency testing program should take full advantage of the benefits of participation by instituting measures to correct testing deficiencies identified by the program.

Bacteria↗

Rehabilitation program evaluation using a revised level of rehabilitation scale (LORS-II).

The Level of Rehabilitation Scale (LORS) was prepared to aid in meeting program evaluation needs of rehabilitation facilities. Advantages of the original LORS-I, including economy of administration, behaviorally defined levels of function, multiple points of view, and concise presentation of findings were retained. Normative information concerning improvement levels for the activities of daily living subscale was developed for cerebrovascular accident inpatients. Data showed that expected improvement varies according to functional level at admission and patient age.

Activities of Daily Living↗

Economic aspects of clinical decision making: evaluating clinical programs.

The importance of program evaluation is discussed, and issues to consider when designing and conducting program evaluations in the restructuring health-care environment are identified. Program evaluation is carried out for the purpose of supporting specific decisions for individual organizations. Unlike scientific research, program evaluation accepts time as a constraint, and its audience is composed of managers. Considering the likelihood of being fixed-dollar contractors or employees in an era of managed care, professionals must try to understand the cost objectives of management; similarly, managers must understand the patient-care objectives of professionals. Program evaluation can help provide the necessary documentation of a program's impact on the outcome of health care, which influences the total cost of care. Successful program evaluation requires careful planning, and issues related to six steps in the planning process are described: defining the objective of the evaluation, choosing and defining the program to be evaluated, choosing indicator variables, designing the evaluation, presenting the results, and planning follow-through. While program evaluation is too often understood in negative terms, particularly as something done because of external pressure, it is as much a part of management as is directing day-to-day operations or developing a long-range plan.

Decision Making↗

[Evaluating programs for preparation to old age: some theoretical thoughts and a practical example (author's transl)].

In the first part methodically satisfactory experimental designs for evaluating programs for preparation to old age on the basis of Cambell & Stanely (1963) are sketched including conditions which hinder the realization of the ideal notions. In the second part an experiment for comparing two preparatory courses to old age using different methods of instruction is described. It was observed that the more demanding teaching method resulted in more anxiety for old age. This led to the conclusion, that programs for preparation to old age should be planned as a sequence of several units in which the mastering of the new ideas may be learned and in which this learning process may be supervised.

Age Factors↗

Comprehensive drug-use evaluation program in a health maintenance organization.

Development and use of a drug-use evaluation (DUE) program for hospital and outpatient facilities of a health-maintenance organization (HMO) are described. A full-time pharmacist coordinates the DUE program. Primary components of the DUE program are (1) establishment and use of drug therapy management protocols, (2) periodic review and evaluation of drug-use statistics by the pharmacy and therapeutics (P&T) committee, (3) monitoring of pharmacist interventions, and (4) evaluation of specific drug use within individual medical staff departments. Information from all DUE activities is channeled through the P&T committee and linked to the HMO's overall quality assurance program. The DUE program has the support of the HMO physicians. It has enhanced the quality of drug use and identified opportunities to further improve the quality of patient care. In surveys by the Joint Commission on Accreditation of Healthcare Organizations, the HMO facilities have received no recommendations. Pharmacists and physicians have cooperated to develop a comprehensive DUE program for an HMO.

California↗

A microcomputer database for mental health program evaluation.

This article describes the development of a microcomputer database within the Mental Health Division of a regional hospital. The multiple uses of this database are illustrated and include management information, program evaluation, assistance with case management and quality assurance, and applied clinical research. Guidance is given on choosing appropriate software and hardware and on negotiating with information providers and funding agencies.

Computers↗

The Behavior Observation Instrument: a method of direct observation for program evaluation.

The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.

Activities of Daily Living↗

Drug-use evaluation programs in short-term-care general hospitals.

The results of a survey to assess drug-use evaluation (DUE) programs in short-term-care general U.S. hospitals are reported. During February 1992, questionnaires were mailed to pharmacy directors at 491 randomly selected short-term-care general hospitals with 100 or more beds. The questionnaire was designed to collect information on the characteristics of surveyed hospitals and their pharmacies, DUE program characteristics, and the perceptions of pharmacists about the DUE programs. The net response rate was 66.6% (327 usable replies). Pharmacists involvement in DUE program activities was found to be very high, with two thirds of respondents indicating they participated in all five ASHP-recommended activities. Pharmacists rated the effectiveness of current DUE programs as moderate, while the importance of pharmacist participation was perceived to be very high. Pharmacists were members of 97.9% of the respondents' DUE committees, but only 65.5% of the pharmacist members held voting privileges. Pharmacists reported devoting an average of 11.27 hours weekly to DUE-related tasks. Reasons used to select drugs for DUEs, interventions employed, uses of DUE results, and methods of evaluating the effectiveness of DUE programs all varied widely. In short-term-care general hospitals with 100 or more beds, pharmacists assigned to DUE activities were highly involved in DUE committees and programs. The effectiveness of these activities needs to be assessed in more detail.

Data Collection↗

Readmission discount factors in program evaluation. An output value analysis of an adult psychiatry program.

The application of output value analysis, a type of benefit/cost analysis, to a psychiatric patient population is reported. A method for discounting the value of the program if a patient was readmitted within a year after discharge was introduced. The application of this discount factor reduces the value produced by the program and thereby reduces both productivity and effectiveness indices. When applied to groups known to differ in readmission rates, such as first admissions and readmissions or voluntary and involuntary admissions, the discount factor can accentuate group differences markedly. When selected diagnostic groups were compared, the discount factor could even reverse the relative standing of the groups.

Brain Damage, Chronic↗