PubMed HealthSearch

PubMed · 8070799

Sample sizes for usability studies: additional considerations.

Abstract

Recently, Virzi (1992) presented data that support three claims regarding sample sizes for usability studies: (1) observing four or five participants will allow a usability practitioner to discover 80% of a product's usability problems, (2) observing additional participants will reveal fewer and fewer new usability problems, and (3) more severe usability problems are easier to detect with the first few participants. Results from an independent usability study clearly support the second claim, partially support the first, but fail to support the third. Problem discovery shows diminishing returns as a function of sample size. Observing four to five participants will uncover about 80% of a product's usability problems as long as the average likelihood of problem detection ranges between 0.32 and 0.42, as in Virzi. If the average likelihood of problem detection is lower, then a practitioner will need to observe more than five participants to discover 80% of the problems. Using behavioral categories for problem severity (or impact), these data showed no correlation between problem severity (impact) and rate of discovery. The data provided evidence that the binomial probability formula may provide a good model for predicting problem discovery curves, given an estimate of the average likelihood of problem detection. Finally, data from economic simulations that estimated return on investment (ROI) under a variety of settings showed that only the average likelihood of problem detection strongly influenced the range of sample sizes for maximum ROI.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

J R Lewis. 1994. Sample sizes for usability studies: additional considerations.. https://doi.org/10.1177/001872089403600215

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related citations

Broad laser indentation surface for retinal laser photocoagulation using indirect ophthalmoscopic delivery.

Laser photocoagulation of the peripheral retina is an important part of the therapeutic options for treating many vitreoretinal disorders, such as diabetic retinopathy, retinopathy of prematurity, and vitreoretinal degeneration. When preequatorial retinal photocoagulation is required, indirect delivery of laser energy is preferable, whether applied in the office setting or as part of a sterile surgical procedure. The anterior retina is usually visualized by scleral indentation employing a conventional scleral indentor or muscle hook. Under these circumstances the retinal surface presented frequently is too small and irregular, making efficient laser delivery unnecessarily laborious, resulting in a variable uptake of laser energy.

Equipment Design

ECAT ART - a continuously rotating PET camera: performance characteristics, initial clinical studies, and installation considerations in a nuclear medicine department.

Advances in fully three-dimensional (3D) image reconstruction techniques have permitted the development of a commercial, rotating, partial ring, fully 3D positron emission tomographic (PET) scanner, the ECAT ART. The system has less than one-half the number of bismuth germanate detectors compared with a full ring scanner with the equivalent field of view, resulting in reduced capital cost. The performance characteristics, implications for installation in a nuclear medicine department, and clinical utility of the scanner are presented in this report. The sensitivity (20 cm diameterx20 cm long cylindrical phantom, no scatter correction) is 11400 cps.kBq-1.ml-1. This compares with 5800 and 40500 cps.kBq-1.ml-1 in 2D and 3D respectively for the equivalent full ring scanner (ECAT EXACT). With an energy window of 350-650 keV the maximum noise equivalent count (NEC) rate was 27 kcps at a radioactivity concentration of approximately 15 kBq.ml-1 in the cylinder. Spatial resolution is approximately 6 mm full width at half maximum on axis degrading to just under 8 mm at a distance of 20 cm off axis. Installation and use within the nuclear medicine department does not appreciably increase background levels of radiation on gamma cameras in adjacent rooms and the dose rate to an operator in the same room is 2 microSv. h-1 for a typical fluorine-18 fluorodeoxyglucose (18F-FDG) study with an initial injected activity of 370 MBq. The scanner has been used for clinical imaging with18F-FDG for neurological and oncological applications. Its novel use for imaging iron-52 transferrin for localising erythropoietic activity demonstrates its sensitivity and resolution advantages over a conventional dual-headed gamma camera. The ECAT ART provides a viable alternative to conventional full ring PET scanners without compromising the performance required for clinical PET imaging.

Equipment Design

Ligature carrier specifically designed for transvaginal sacrospinous colpopexy.

A new ligature carrier designed for sacrospinous colpopexy permits bite acquisition to be performed under direct surgical visualization within the confines of the pararectal space. In addition, it permits ample penetration of the sacrospinous ligament through the coccygeus muscle, without restriction of suture type, size, or number of sutures per bite. As part of site-specific reconstructive pelvic surgery, we have performed sacrospinous colpopexy using this ligature carrier in 71 patients with genital prolapse. We have encountered no operative complications from the use of this ligature carrier.

Equipment Design