PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “Computer vision”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18Linked to original sources

The correlation between internal and external markers for abdominal tumors: implications for respiratory gating.

PURPOSE: The correlation of the respiratory motion of external patient markers and abdominal tumors was examined. Data of this type are important for image-guided therapy techniques, such as respiratory gating, that monitor the movement of external fiducials. METHODS AND MATERIALS: Fluoroscopy sessions for 4 patients with internal, radiopaque tumor fiducial clips were analyzed by computer vision techniques. The motion of the internal clips and the external markers placed on the patient's abdominal skin surface were quantified and correlated. RESULTS: In general, the motion of the tumor and external markers were well correlated. The maximum amount of peak-to-peak craniocaudal tumor motion was 2.5 cm. The ratio of tumor motion to external-marker motion ranged from 0.85 to 7.1. The variation in tumor position for a given external-marker position ranged from 2 to 9 mm. The period of the breathing cycle ranged from 2.7 to 4.5 seconds, and the frequency patterns for both the tumor and the external markers were similar. CONCLUSIONS: Although tumor motion generally correlated well with external fiducial marker motion, relatively large underlying tumor motion can occur compared with external-marker motion and variations in the tumor position for a given marker position. Treatment margins should be determined on the basis of a detailed understanding of tumor motion, as opposed to relying only on external-marker information.

Abdominal Neoplasms↗

A global approach for solving evolutive heat transfer for image denoising and inpainting.

This paper proposes an alternative to partial differential equations (PDEs) for solving problems in computer vision based on evolutive heat transfer. Traditionally, the method for solving such physics-based problems is to discretize and solve a PDE by a purely mathematical process. Instead of using the PDE, we propose to use the global heat principle and to decompose it into basic laws. We show that some of these laws admit an exact global version since they arise from conservative principles. We also show that the assumptions made about the other basic Iaws can be made wisely, taking into account knowledge about the problem and the domain. The numerical scheme is derived in a straightforward way from the modeled problem, thus providing a physical explanation for each step in the solution. The advantage of such an approach is that it minimizes the approximations made during the whole process and it modularizes it, allowing changing the application to a great number of problems. We apply the scheme to two applications: image denoising and inpainting which are modeled with heat transfer. For denoising, we propose a new approximation for the conductivity coefficient and we add thin lines to the features in order to block diffusion.

Algorithms↗

Doppler echocardiography flow-velocity image analysis for patients with atrial fibrillation.

Currently, Doppler echocardiography analysis is performed manually. An automated method that analyzes the Doppler signal can potentially improve accuracy and result in a powerful tool for noninvasive evaluation of cardiac hemodynamics, especially for patients with atrial fibrillation, where multiple samples are needed to obtain an accurate averaged measurement. The aim of this study was to develop an automated method for Doppler analysis based on image processing and computer vision algorithms. Images were obtained from the mitral valve and the tricuspid valve Doppler tracings from 45 patients, 20 with normal sinus rhythm and 25 with atrial fibrillation. The proposed algorithm automatically detects the maximal velocity envelope of the spectral Doppler ultrasound tracings. Averaged values for the time velocity integral, peak mitral inflow velocity and peak tricuspid regurgitation velocity were calculated for multiple beats available in a single screen frame. Measurements extracted automatically from the maximal velocity envelope were compared to measurements obtained manually by two expert technicians. High linear correlation (r) was found between the automatically- and the manually-extracted parameters (0.95 < r < 0.99). A smaller variation was found in most cases between the manually-calculated average beat and the automated average beat (bias value between 3.8% and 5.2%) than between the manually-calculated average beat and the selection of a representative beat (bias value between 6.2% and -2.6%). The newly-developed automated method offers a new, accurate and reliable clinical tool, particularly for the assessment of patients with irregular heart rate.

Algorithms↗

First order augmentation to tensor voting for boundary inference and multiscale analysis in 3D.

Most computer vision applications require the reliable detection of boundaries. In the presence of outliers, missing data, orientation discontinuities, and occlusion, this problem is particularly challenging. We propose to address it by complementing the tensor voting framework, which was limited to second order properties, with first order representation and voting. First order voting fields and a mechanism to vote for 3D surface and volume boundaries and curve endpoints in 3D are defined. Boundary inference is also useful for a second difficult problem in grouping, namely, automatic scale selection. We propose an algorithm that automatically infers the smallest scale that can preserve the finest details. Our algorithm then proceeds with progressively larger scales to ensure continuity where it has not been achieved. Therefore, the proposed approach does not oversmooth features or delay the handling of boundaries and discontinuities until model misfit occurs. The interaction of smooth features, boundaries, and outliers is accommodated by the unified representation, making possible the perceptual organization of data in curves, surfaces, volumes, and their boundaries simultaneously. We present results on a variety of data sets to show the efficacy of the improved formalism.

Algorithms↗

Selection and fusion of color models for image feature detection.

The choice of a color model is of great importance for many computer vision algorithms (e.g., feature detection, object recognition, and tracking) as the chosen color model induces the equivalence classes to the actual algorithms. As there are many color models available, the inherent difficulty is how to automatically select a single color model or, alternatively, a weighted subset of color models producing the best result for a particular task. The subsequent hurdle is how to obtain a proper fusion scheme for the algorithms so that the results are combined in an optimal setting. To achieve proper color model selection and fusion of feature detection algorithms, in this paper, we propose a method that exploits nonperfect correlation between color models or feature detection algorithms derived from the principles of diversification. As a consequence, a proper balance is obtained between repeatability and distinctiveness. The result is a weighting scheme which yields maximal feature discrimination. The method is verified experimentally for three different image feature detectors. The experimental results show that the fusion method provides feature detection results having a higher discriminative power than the standard weighting scheme. Further, it is experimentally shown that the color model selection scheme provides a proper balance between color invariance (repeatability) and discriminative power (distinctiveness).

Algorithms↗

Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery.

The problem of image registration, or the alignment of two or more images representing the same scene or object, has to be addressed in various disciplines that employ digital imaging. In the area of remote sensing, just like in medical imaging or computer vision, it is necessary to design robust, fast, and widely applicable algorithms that would allow automatic registration of images generated by various imaging platforms at the same or different times and that would provide subpixel accuracy. One of the main issues that needs to be addressed when developing a registration algorithm is what type of information should be extracted from the images being registered, to be used in the search for the geometric transformation that best aligns them. The main objective of this paper is to evaluate several wavelet pyramids that may be used both for invariant feature extraction and for representing images at multiple spatial resolutions to accelerate registration. We find that the bandpass wavelets obtained from the steerable pyramid due to Simoncelli performs best in terms of accuracy and consistency, while the low-pass wavelets obtained from the same pyramid give the best results in terms of the radius of convergence. Based on these findings, we propose a modification of a gradient-based registration algorithm that has recently been developed for medical data. We test the modified algorithm on several sets of real and synthetic satellite imagery.

Algorithms↗

Towards a theory of a solution space for the biplane imaging geometry problem.

Biplane angiographic imaging is a primary method for visual and quantitative assessment of the vasculature. In order to reliably reconstruct the three-dimensional (3D) position, orientation, and shape of the vessel structure, a key problem is to determine the rotation matrix R and the translation vector t which relate the two coordinate systems. This so-called Imaging Geometry Determination problem is well studied in the medical imaging and computer vision communities and a number of interesting approaches have been reported. Each such technique determines a solution which yields 3D vasculature reconstructions with errors comparable to other techniques. From the literature, we see that different techniques with different optimization strategies yield reconstructions with equivalent errors. We have investigated this behavior, and it appears that the error in the input data leads to this equivalence effectively yielding what we call the solution space of feasible geometries, i.e., geometries which could be solutions given the error or uncertainty in the input image data. In this paper, we lay the theoretical framework for this concept of a solution space of feasible geometries using simple schematic constructions, deriving the underlying mathematical relationships, presenting implementation details, and discussing implications and applications of the proposed idea. Because the solution space of feasible geometries encompasses equivalent solutions given the input error, the solution space approach can be used to evaluate the precision of calculated geometries or 3D data based on known or estimated uncertainties in the input image data. We also use the solution space approach to calculate an imaging geometry, i.e., a solution.

Algorithms↗

Bayesian image segmentation using local iso-intensity structural orientation.

Image segmentation is a fundamental problem in early computer vision. In segmentation of flat shaded, nontextured objects in real-world images, objects are usually assumed to be piecewise homogeneous. This assumption, however, is not always valid with images such as medical images. As a result, any techniques based on this assumption may produce less-than-satisfactory image segmentation. In this work, we relax the piecewise homogeneous assumption. By assuming that the intensity nonuniformity is smooth in the imaged objects, a novel algorithm that exploits the coherence in the intensity profile to segment objects is proposed. The algorithm uses a novel smoothness prior to improve the quality of image segmentation. The formulation of the prior is based on the coherence of the local structural orientation in the image. The segmentation process is performed in a Bayesian framework. Local structural orientation estimation is obtained with an orientation tensor. Comparisons between the conventional Hessian matrix and the orientation tensor have been conducted. The experimental results on the synthetic images and the real-world images have indicated that our novel segmentation algorithm produces better segmentations than both the global thresholding with the maximum likelihood estimation and the algorithm with the multilevel logistic MRF model.

Algorithms↗

Correspondence-free determination of the affine fundamental matrix.

Fundamental matrix estimation is a central problem in computer vision and forms the basis of tasks such as stereo imaging and structure from motion. Existing algorithms typically analyze the relative geometries of matched feature points identified in both projected views. Automated feature matching is itself a challenging problem. Results typically have a large number of false matches. Traditional fundamental matrix estimation methods are very sensitive to matching errors, which led naturally to the application of robust statistical estimation techniques to the problem. In this work, an entirely novel approach is proposed to the fundamental matrix estimation problem. Instead of analyzing the geometry of matched feature points, the problem is recast in the frequency domain through the use of Integral Projection, showing how this is a reasonable model for orthographic cameras. The problem now reduces to one of identifying matching lines in the frequency domain which, most importantly, requires no feature matching or correspondence information. Experimental results on both real and synthetic data are presented that demonstrate the algorithm is a practical technique for fundamental matrix estimation. The behavior of the proposed algorithm is additionally characterized with respect to input noise, feature counts, and other parameters of interest.

Algorithms↗

Core-based portal image registration for automatic radiotherapy treatment verification.

PURPOSE: Portal imaging is the most important quality assurance procedure for monitoring the reproducibility of setup geometry in radiation therapy. The role of portal imaging has become even more critical in recent years due to the migration of three-dimensional (3D) treatment planning technology, including high-precision conformal therapy, from the research setting to routine clinical practice. Unfortunately, traditional methods for acquiring and interpreting portal images suffer from a number of deficiencies that contribute to the well-documented observation that many setup errors go undetected, and some persist for a clinically significant portion of the prescribed dose. Significant improvements in both accuracy and efficiency of detecting setup errors can, in principle, be achieved by using automatic image registration for on-line screening of images obtained from electronic portal imaging devices (EPIDs). METHODS AND MATERIALS: This article presents recent developments in a method called core-based image analysis that shows great promise for achieving the desired improvements in error detection. Core-based image analysis is a fundamental computer vision method that is capable of exploiting the full power of EPIDs by providing for on-line detection of setup errors via automatic registration of user-selected anatomical structures. We describe a robust method for automatic portal image registration based on core analysis and demonstrate an approach for assessing both accuracy and precision of registration methods using realistic, digitally reconstructed portal radiographs (DRPRs) where truth is known. RESULTS: Automatic core-based analysis of a set of 20 DRPRs containing known, random field positioning errors was performed for a patient undergoing treatment for prostate cancer. In all cases, the reported translation was within 1 mm of the actual translation with mean absolute errors of 0.3 mm and standard deviations of 0.3 mm. In all cases, the reported rotation was within 0.6 degree of the actual rotation with a mean absolute error of 0.18 degree and a standard deviation of 0.23 degree. CONCLUSION: Our results, using digitally reconstructed portal radiographs that closely resemble clinical portal images, suggest that automatic core-based registration is suitable as an on-line screening tool for detecting and quantifying patient setup errors.

Humans↗

A method for finding candidate conformations for molecular replacement using relative rotation between domains of a known structure.

This paper presents a methodology to obtain candidate conformations of multidomain proteins for use in molecular replacement. For each separate domain, the orientational relationship between the template and the target structure is obtained using standard molecular replacement. The orientational relationships of the domains are then used to calculate the relative rotation between the domains in the target conformation by using pose-estimation techniques from the field of robotics and computer vision. With the angle of relative rotation between the domains as a cost function, iterative normal-mode analysis is used to drive the template structure to a candidate conformation that matches the X-ray crystallographic data obtained for the target conformation. The selection of the correct intra-protein domain orientations from among the many spurious maxima in the rotation function (including orientations obtained from domains in symmetry mates rather than within the same copy of the protein) presents a challenge. This problem is resolved by checking R factors of each domain, measuring the absolute value of relative rotation between domains, and evaluating the cost value after each candidate conformation is driven to convergence with iterative NMA. As a validation, the proposed method is applied to three test proteins: ribose-binding protein, lactoferrin and calcium ATPase. In each test case, the orientation and translation of the final candidate conformation in the unit cell are generated correctly from the suggested procedure. The results show that the proposed method can yield viable candidate conformations for use in molecular replacement and can reveal the structural details and pose of the target conformation in the crystallographic unit cell.

Algorithms↗

Automatic multiparameter fluorescence imaging for determining lymphocyte phenotype and activation status in melanoma tissue sections.

A system has been developed that combines multiparameter fluorescence imaging and computer vision techniques to provide automatic phenotyping of multiple cell types in a single tissue section. This system identifies both the nuclear and cytoplasmic boundary of each cell. A routine based on the watershed algorithm has been developed to segment an image of Hoechst-stained nuclei with an accuracy of greater than 85%. Deformable splines initially positioned at the nuclear boundaries are applied to images of fluorescently labelled cell-surface antigens. The splines lock onto the peak fluorescence signal surrounding the cell, providing an estimate of the cell boundary. From measurements acquired at this boundary, each cell is classified according to antigen expression. The system has been piloted in biopsies from melanoma patients participating in a clinical trial of the antibody R24. Thin tissue sections have been stained with Hoechst and three different fluorescent antibodies to antigens that permit the typing and evaluation of activity of T-cells. Changes in the infiltrates evaluated by multiparameter imaging were consistent with results obtained by immunoperoxidase analysis. The multiparameter fluorescent technique enables simultaneous determination of multiple cell subsets and can provide the spatial relationships of each cell type within the tissue.

Antigens, CD↗

A semi-localized elastic net for surface reconstruction of objects from multislice images.

The traveling salesman problem (TSP) is a prototypical problem of combinatorial optimization and, as such, it has received considerable attention from neural-network researchers seeking quick, heuristic solutions. An early stage in many computer vision tasks is the extraction of object shape from an image consisting of noisy candidate edge points. Since the desired shape will often be a closed contour, this problem can be viewed as a version of the TSP in which we wish to link only a subset of the points/cities (i.e. the "noisefree" ones). None of the extant neural techniques for solving the TSP can deal directly with this case. In this paper, we present a simple but effective modification to the (analog) elastic net of Durbin and Willshaw which shifts emphasis from global to local behavior during convergence, so allowing the net to ignore some image points. Unlike the original elastic net, this semi-localized version is shown to tolerate considerable amounts of noise. As an example practical application, we describe the extraction of "pseudo-3D" human lung outlines from multiple preprocessed magnetic resonance images of the torso. An effectiveness measure (ideally zero) quantifies the difference between the extracted shape and some idealized shape exemplar. Our method produces average effectiveness scores of 0.06 for lung shapes extracted from initial semi-automatic segmentations which define the noisefree case. This deteriorates to 0.1 when extraction is from a noisy edge-point image obtained fully-automatically using a feedforward neural network.

Algorithms↗

Nonlinear, near photo-realistic caricatures using a parametric facial appearance model.

A mathematical model previously developed for use in computer vision applications is presented as an empirical model for face space. The term appearance space is used to distinguish this from previous models. Appearance space is a linear vector space that is dimensionally optimal, enables us to model and describe any human facial appearance, and possesses characteristics that are plausible for the representation of psychological face space. Randomly sampling from a multivariate distribution for a location in appearance space produces entirely plausible faces, and manipulation of a small set of defining parameters enables the automatic generation of photo-realistic caricatures. The appearance space model leads us to the new concept of nonlinear caricatures, and we show that the accepted linear method for caricature is only a special case of a more general paradigm. Nonlinear methods are also viable, and we present examples of photographic quality caricatures, using a number of different transformation functions. Results of a simple experiment are presented that suggest that nonlinear transformations can accurately capture key aspects of the caricature effect. Finally, we discuss the relationship between appearance space, caricature, and facial distinctiveness. On the basis of our new theoretical framework, we suggest an experimental approach that can yield new evidence for the plausibility of face space and its ability to explain processes of recognition.

Artificial Intelligence↗

A self-learning segmentation framework--the Taguchi approach.

The detection of object boundary is an interesting and challenging task in computer vision and medical image processing. The active contour model (snake model) has attracted much attention for object boundary detection in the past decade. However, due to the lack of understanding on the effect of different energy terms to the behavior of related objective functions for an image, the assignment of weights for different energy terms in this model is usually fulfilled empirically. Few discussions have been brought out specifically for assigning these weights automatically. In this paper, a novel self-learning segmentation framework, based on the snake model is proposed and applied to the detection of cardiac boundaries from ultrasonic images. The framework consists of a learning section and a detection section, and provides a training mechanism to obtain the weights from a desired object contour given manually. This mechanism first employs Taguchi's method to determine the weight ratios among distinct energy terms, followed by a weight refinement step with a genetic algorithm. The refined weights can be treated as the a priori knowledge embedded in the manually defined contour and be used for subsequent contour detection. Experiments with both synthetic and real echocardiac images were conducted with satisfactory outcomes. Results also show that the present method can be used to analyze successive images of the same object with only one training contour. Finally, the validity of the weight determining process was verified by the analysis of variance method (ANOVA).

Algorithms↗

A method and software for segmentation of anatomic object ensembles by deformable m-reps.

Deformable shape models (DSMs) comprise a general approach that shows great promise for automatic image segmentation. Published studies by others and our own research results strongly suggest that segmentation of a normal or near-normal object from 3D medical images will be most successful when the DSM approach uses (1) knowledge of the geometry of not only the target anatomic object but also the ensemble of objects providing context for the target object and (2) knowledge of the image intensities to be expected relative to the geometry of the target and contextual objects. The segmentation will be most efficient when the deformation operates at multiple object-related scales and uses deformations that include not just local translations but the biologically important transformations of bending and twisting, i.e., local rotation, and local magnification. In computer vision an important class of DSM methods uses explicit geometric models in a Bayesian statistical framework to provide a priori information used in posterior optimization to match the DSM against a target image. In this approach a DSM of the object to be segmented is placed in the target image data and undergoes a series of rigid and nonrigid transformations that deform the model to closely match the target object. The deformation process is driven by optimizing an objective function that has terms for the geometric typicality and model-to-image match for each instance of the deformed model. The success of this approach depends strongly on the object representation, i.e., the structural details and parameter set for the DSM, which in turn determines the analytic form of the objective function. This paper describes a form of DSM called m-reps that has or allows these properties, and a method of segmentation consisting of large to small scale posterior optimization of m-reps. Segmentation by deformable m-reps, together with the appropriate data representations, visualizations, and user interface, has been implemented in software that accomplishes 3D segmentations in a few minutes. Software for building and training models has also been developed. The methods underlying this software and its abilities are the subject of this paper.

Algorithms↗

Contour tracking using a knowledge-based snake algorithm to construct three-dimensional pharyngeal bolus movement.

Videofluorography (VFG) using a barium-mixed bolus is in wide clinical use for assessing patients with swallowing disorders. VFG is usually done with both lateral (LA) and anterior-posterior (AP) views, most commonly in two separate sittings. A real-time, three-dimensional (3-D) representation of the evolution of a pharyngeal bolus and its volumetric information can potentially help clinicians analyze and visualize the kinematics of swallowing, dysphagia, and compensatory therapeutic strategies. Active contour models, also known as "Snakes," have been used to solve various image analysis and computer vision problems. We applied a Snake algorithm to automate in part the contour tracking and reconstruction of VFG images to visualize and quantitatively analyze the 3-D evolution of a pharyngeal bolus. To improve the accuracy of the Snake search, we provided the additional "knowledge" of the pharyngeal image itself, which served as an extra constraint to push the Snake curve toward the desired contour. VFG of pharyngeal bolus transport in a normal subject was recorded by using barium-mixed boluses (viscosity: 185 centipoise, density: 2.84 g/cc) with volumes of 5, 10, and 20 ml. The resulting LA and AP video images were digitally captured and matched frame by frame. The knowledge-based Snake search algorithm was used to generate Snake points to satisfy both internal (i.e., smoothness) and external (i.e., boundary fitting) constraints. Using these Snake points, we traced the 3-D bolus movement at each time instant, assuming elliptic geometry in the cross-section of the pharyngeal bolus. By concentrating the 3-D images for each time instant, we developed a 3-D movie representing pharyngeal bolus movement. The efficiency, reproducibility, and accuracy of this algorithm in tracing pharyngeal bolus boundaries and estimating front/tail velocities were assessed and found satisfactory. We conclude that 3-D pharyngeal bolus movement can be traced both accurately and efficiently by using a knowledge-based Snake search algorithm.

Algorithms↗

Multibody grouping by inference of multiple subspaces from high-dimensional data using oriented-frames.

Recently, subspace constraints have been widely exploited in many computer vision problems such as multibody grouping. Under linear projection models, feature points associated with multiple bodies reside in multiple subspaces. Most existing factorization-based algorithms can segment objects undergoing independent motions. However, intersections among the correlated motion subspaces will lead most previous factorization-based algorithms to erroneous segmentation. To overcome this limitation, in this paper, we formulate the problem of multibody grouping as inference of multiple subspaces from a high-dimensional data space. A novel and robust algorithm is proposed to capture the configuration of the multiple subspace structure and to find the segmentation of objects by clustering the feature points into these inferred subspaces, no matter whether they are independent or correlated. In the proposed method, an Oriented-Frame (OF), which is a multidimensional coordinate frame, is associated with each data point indicating the point's preferred subspace configuration. Based on the similarity between the subspaces, novel mechanisms of subspace evolution and voting are developed. By filtering the outliers due to their structural incompatibility, the subspace configurations will emerge. Compared with most existing factorization-based algorithms that cannot correctly segment correlated motions, such as motions of articulated objects, the proposed method has a robust performance in both independent and correlated motion segmentation. A number of controlled and real experiments show the effectiveness of the proposed method. However, the current approach does not deal with transparent motions and motion subspaces of different dimensions.

Algorithms↗