PubMed Health⌕ Search

Biomedical subjects

H Stephen Leff

Publications and source records attributed to H Stephen Leff.

10 recordsLinked to original sources

Desired attributes of evidence assessments for evidence-based practices.

In this paper we describe three approaches to assessing evidence for stakeholders interested in evidence-based practices: narrative reviews, systematic reviews (including meta-analyses), and registries. We then compare the approaches in terms of the degree to which they posses desired attributes of evidence assessments. Our review suggests that hybrid approaches that combined the best features of all three should be pursued to further the use of evidence-based practices, and that such hybrids are possible given the capacity of the World Wide Web. We conclude by stressing the need for empirical research on evidence assessments.

Evidence-Based Medicine↗

Demographic characteristics and employment among people with severe mental illness in a multisite study.

People with psychiatric disabilities experience disproportionately high rates of unemployment. As research evidence is mounting regarding effective vocational programs, interest is growing in identifying subgroup variations. Data from a multisite research and demonstration program were analyzed to identify demographic characteristics associated with employment outcomes, after adjusting for the effects of program, services, and study site. Longitudinal analyses found that people with more recent work history, younger age, and higher education were more likely to achieve competitive employment and to work more hours per month, while race and gender effects varied by employment outcome. Results provide strong evidence of demographic subgroup variation and need.

Adolescent↗

Estimated payments to employment service providers for persons with mental illness in the Ticket to Work program.

OBJECTIVE: The Ticket to Work and Work Incentives Improvement Act of 1999 removes work disincentives and promotes access to vocational services for people with disabilities. This study calculated the amount of payments that would have been made to employment service providers if study participants had been enrolled in the Ticket program. METHODS: Data were from 450 Social Security Disability Insurance beneficiaries with psychiatric disabilities enrolled in a multisite study of supported employment. Earnings over two years were used to calculate provider payments under two reimbursement formulas used in the Ticket program. RESULTS: Only a quarter of service recipients (26 percent) reached earnings levels that would have triggered provider payments under the first reimbursement formula. Only 4 percent would have completed their trial work period and left the rolls, generating payments under the second formula. CONCLUSIONS: The current provider payment systems of the Ticket to Work program do not reflect the reality of rehabilitation for individuals with severe mental illness. Reforms should take into account outcomes of return-to-work services for this population.

Adolescent↗

Results of a multisite randomized trial of supported employment interventions for individuals with severe mental illness.

CONTEXT: National probability surveys indicate that most individuals with schizophrenia and other severe mental illnesses are not employed. This multisite study tested the effectiveness of supported employment (SE) models combining clinical and vocational rehabilitation services to establish competitive employment. METHODS: We randomly assigned 1273 outpatients with severe mental illness from 7 states in the United States to an experimental SE program or to a comparison or a services-as-usual condition, with follow-up for 24 months. Participants were interviewed semiannually, paid employment was tracked weekly, and vocational and clinical services were measured monthly. Mixed-effects random regression analysis was used to predict the likelihood of competitive employment, working 40 or more hours in a given month, and monthly earnings. RESULTS: Cumulative results during 24 months show that experimental group participants (359/648 [55%]) were more likely than those in the comparison programs (210/625 [34%]) to achieve competitive employment (chi(2) = 61.17; P<.001). Similarly, patients in experimental group programs (330/648 [51%]) were more likely than those in comparison programs (245/625 [39%]) to work 40 or more hours in a given month (chi(2) = 17.66; P<.001). Finally, participants in experimental group programs had significantly higher monthly earnings than those in the comparison programs (mean, US 122 dollars/mo [n=639] vs US 99 dollars/mo [n=622]); t(1259) = -2.04; P<.05). In the multivariate longitudinal analysis, experimental condition subjects were more likely than comparison group subjects to be competitively employed, work 40 or more hours in a given month, and have higher earnings, despite controlling for demographic, clinical, work history, disability beneficiary status, and study site confounders. Moreover, the advantage of experimental over comparison group participants increased during the 24-month study period. CONCLUSION: The SE models tailored by integrating clinical and vocational services were more effective than services as usual or unenhanced services.

Adult↗

Clinical factors associated with employment among people with severe mental illness: findings from the employment intervention demonstration program.

Research has shown that supported employment programs are effective in helping psychiatric outpatients achieve vocational outcomes, yet not all program participants are able to realize their employment goals. This study used 24 months of longitudinal data from a multisite study of supported employment interventions to examine the relationship of patient clinical factors to employment outcomes. Multivariate random regression analysis indicated that, even when controlling for an extensive series of demographic, study condition (experimental versus control), and work history covariates, clinical factors were associated with individuals' ability to achieve competitive jobs and to work 40 or more hours per month. Poor self-rated functioning, negative psychiatric symptoms, and recent hospitalizations were most consistently associated with failure to achieve these employment outcomes. These findings suggest ways that providers can tailor supported employment programs to achieve success with a diverse array of clinical subpopulations.

Adolescent↗

Integration of psychiatric and vocational services: a multisite randomized, controlled trial of supported employment.

OBJECTIVE: Although large-scale surveys indicate that patients with severe mental illness want to work, their unemployment rate is three to five times that of the general adult population. This multisite, randomized implementation effectiveness trial examined the impact of highly integrated psychiatric and vocational rehabilitation services on the likelihood of successful work outcomes. METHOD: At seven sites nationwide, 1,273 outpatients with severe mental illness were randomly assigned either to an experimental supported employment program or to a comparison/services-as-usual condition and followed for 24 months. Data collection involved monthly services tracking, semiannual in-person interviews, recording of all paid employment, and program ratings made by using a services-integration measure. The likelihood of competitive employment and working 40 or more hours per month was examined by using mixed-effects random regression analysis. RESULTS: Subjects served by models that integrated psychiatric and vocational service delivery were more than twice as likely to be competitively employed and almost 1(1/2) times as likely to work at least 40 hours per month when the authors controlled for time, demographic, clinical, and work history confounds. In addition, higher cumulative amounts of vocational services were associated with better employment outcomes, whereas higher cumulative amounts of psychiatric services were associated with poorer outcomes. CONCLUSIONS: Supported employment models with high levels of integration of psychiatric and vocational services were more effective than models with low levels of service integration.

Adult↗

Effects of job development and job support on competitive employment of persons with severe mental illness.

OBJECTIVES: Few studies have sought to determine which specific supported employment services improve employment outcomes for people with pyschiatric disabilities. This study examined the effects of job development and job support among other services on acquisition and retention of competitive employment. METHODS: Data used in the analysis came from seven sites of the Employment Intervention Demonstration Program. Employment data were collected weekly for a period up to 24 months for 1,340 participants. A random-effects meta-analysis was conducted. RESULTS: Job development increased the probability of obtaining competitive employment. The effects of job development on job acquisition remained after the effects of other factors were controlled for. Job support was associated with more months in the first competitive job but not total hours worked. However, no evidence for the causal role of job support was found in analyses that tested the effects of job support after the job support was provided. The causal role of job support alone was also cast in doubt by the fact that a substantial overlap existed between individuals who received job support and vocational counseling. CONCLUSIONS: Job development is a very effective service when the goal is job acquisition. Job support is associated with retention of a first competitive job, but its causal role is questionable.

Adult↗

Assessment of Medicaid managed behavioral health care for persons with serious mental illness.

OBJECTIVES: This five-site study compared Medicaid managed behavioral health programs and fee-for-service programs on use and quality of services, satisfaction, and symptoms and functioning of adults with serious mental illness. METHODS: Adults with serious mental illness in managed care programs (N=958) and fee-for-service programs (N=1,011) in five states were interviewed after the implementation of managed care and six months later. After a multiple regression to standardize the groups for case mix differences, a meta-analysis using a random-effects model was conducted, and bioequivalence methods were used to determine whether differences were significant for clinical or policy purposes. RESULTS: A significantly smaller proportion of the managed care group received inpatient care (5.7 percent compared with 11.5 percent). The managed care group received significantly more hours of primary care (4.9 compared with 4.5 hours) and was significantly less healthy. However, none of these differences exceed the bioequivalence criterion of 5 percent. Managed care and fee for service were "not different but not equivalent" on 20 of 34 dependent variables. Cochrane's Q statistic, which measured intersite consistency, was significant for 20 variables. CONCLUSIONS: Managed care and fee-for-service Medicaid programs did not differ on most measures; however, a lack of sufficient power was evident for many measures. Full endorsement of managed care for vulnerable populations will require further research that assumes low penetration rates and intersite variability.

Adult↗

What is evidence?

The evidence-based practice movement rests on the premise that the scientific evidence regarding treatment should be used judiciously to inform treatment decisions. This article focuses on the most fundamental question regarding evidence-based practice: What is evidence? To address this question, the authors first review several of the definitions, criteria, and strategies that have been used to define scientific evidence. Second, a number of critical issues that have been raised regarding the nature of treatment evidence are discussed. Finally, suggestions for further consideration in the process of synthesizing evidence for clinicians are offered.

Adolescent↗

Service quality as measured by service fit and mortality among public mental health system service recipients.

Service fit, defined as consistency between mental health services judged needed and services received was measured for a random sample of service recipients in a public mental health system (N = 6588). A variant of small area analysis was used to measure the relationship between catchment area mortality rates from natural causes, suicide, and medicolegal causes and area fit scores for a variety of services. We tested the theory-based hypothesis that service fit would predict interarea variations in mortality better than simple measures of amount of service prescribed and received. We also tested the hypothesis that, controlling for relevant demographic and clinical factors, fit would be protective for mortality from all causes. Findings supported the first hypothesis. With respect to the second, service fit for only certain services was protective. Housing and clubhouses services were particularly protective, suggesting the importance of services providing social support.

Adult↗