PubMed Health⌕ Search

SEARCH · PubMed Health

Results for “feature selection”

Explore indexed PubMed citations for clinical trials, systematic reviews and public health research. Read source abstracts and follow each citation to its original PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14Linked to original sources

Prediction of genotoxicity of chemical compounds by statistical learning methods.

Various toxicological profiles, such as genotoxic potential, need to be studied in drug discovery processes and submitted to the drug regulatory authorities for drug safety evaluation. As part of the effort for developing low cost and efficient adverse drug reaction testing tools, several statistical learning methods have been used for developing genotoxicity prediction systems with an accuracy of up to 73.8% for genotoxic (GT+) and 92.8% for nongenotoxic (GT-) agents. These systems have been developed and tested by using less than 400 known GT+ and GT- agents, which is significantly less in number and diversity than the 860 GT+ and GT- agents known at present. There is a need to examine if a similar level of accuracy can be achieved for the more diverse set of molecules and to evaluate other statistical learning methods not yet applied to genotoxicity prediction. This work is intended for testing several statistical learning methods by using 860 GT+ and GT- agents, which include support vector machines (SVM), probabilistic neural network (PNN), k-nearest neighbor (k-NN), and C4.5 decision tree (DT). A feature selection method, recursive feature elimination, is used for selecting molecular descriptors relevant to genotoxicity study. The overall accuracies of SVM, k-NN, and PNN are comparable to and those of DT lower than the results from earlier studies, with SVM giving the highest accuracies of 77.8% for GT+ and 92.7% for GT- agents. Our study suggests that statistical learning methods, particularly SVM, k-NN, and PNN, are useful for facilitating the prediction of genotoxic potential of a diverse set of molecules.

Computational Biology↗

Prediction error estimation: a comparison of resampling methods.

MOTIVATION: In genomic studies, thousands of features are collected on relatively few samples. One of the goals of these studies is to build classifiers to predict the outcome of future observations. There are three inherent steps to this process: feature selection, model selection and prediction assessment. With a focus on prediction assessment, we compare several methods for estimating the 'true' prediction error of a prediction model in the presence of feature selection. RESULTS: For small studies where features are selected from thousands of candidates, the resubstitution and simple split-sample estimates are seriously biased. In these small samples, leave-one-out cross-validation (LOOCV), 10-fold cross-validation (CV) and the .632+ bootstrap have the smallest bias for diagonal discriminant analysis, nearest neighbor and classification trees. LOOCV and 10-fold CV have the smallest bias for linear discriminant analysis. Additionally, LOOCV, 5- and 10-fold CV, and the .632+ bootstrap have the lowest mean square error. The .632+ bootstrap is quite biased in small sample sizes with strong signal-to-noise ratios. Differences in performance among resampling methods are reduced as the number of specimens available increase. SUPPLEMENTARY INFORMATION: A complete compilation of results and R code for simulations and analyses are available in Molinaro et al. (2005) (http://linus.nci.nih.gov/brb/TechReport.htm).

Algorithms↗

Profiled support vector machines for antisense oligonucleotide efficacy prediction.

BACKGROUND: This paper presents the use of Support Vector Machines (SVMs) for prediction and analysis of antisense oligonucleotide (AO) efficacy. The collected database comprises 315 AO molecules including 68 features each, inducing a problem well-suited to SVMs. The task of feature selection is crucial given the presence of noisy or redundant features, and the well-known problem of the curse of dimensionality. We propose a two-stage strategy to develop an optimal model: (1) feature selection using correlation analysis, mutual information, and SVM-based recursive feature elimination (SVM-RFE), and (2) AO prediction using standard and profiled SVM formulations. A profiled SVM gives different weights to different parts of the training data to focus the training on the most important regions. RESULTS: In the first stage, the SVM-RFE technique was most efficient and robust in the presence of low number of samples and high input space dimension. This method yielded an optimal subset of 14 representative features, which were all related to energy and sequence motifs. The second stage evaluated the performance of the predictors (overall correlation coefficient between observed and predicted efficacy, r; mean error, ME; and root-mean-square-error, RMSE) using 8-fold and minus-one-RNA cross-validation methods. The profiled SVM produced the best results (r = 0.44, ME = 0.022, and RMSE= 0.278) and predicted high (>75% inhibition of gene expression) and low efficacy (<25%) AOs with a success rate of 83.3% and 82.9%, respectively, which is better than by previous approaches. A web server for AO prediction is available online at http://aosvm.cgb.ki.se/. CONCLUSIONS: The SVM approach is well suited to the AO prediction problem, and yields a prediction accuracy superior to previous methods. The profiled SVM was found to perform better than the standard SVM, suggesting that it could lead to improvements in other prediction problems as well.

Databases, Genetic↗

Computer-aided detection of lung nodules: false positive reduction using a 3D gradient field method and 3D ellipsoid fitting.

We are developing a computer-aided detection system to assist radiologists in the detection of lung nodules on thoracic computed tomography (CT) images. The purpose of this study was to improve the false-positive (FP) reduction stage of our algorithm by developing features that extract three-dimensional (3D) shape information from volumes of interest identified in the prescreening stage. We formulated 3D gradient field descriptors, and derived 19 gradient field features from their statistics. Six ellipsoid features were obtained by computing the lengths and the length ratios of the principal axes of an ellipsoid fitted to a segmented object. Both the gradient field features and the ellipsoid features were designed to distinguish spherical objects such as lung nodules from elongated objects such as vessels. The FP reduction performance in this new 25-dimensional feature space was compared to the performance in a 19-dimensional space that consisted of features extracted using previously developed methods. The performance in the 44-dimensional combined feature space was also evaluated. Linear discriminant analysis with stepwise feature selection was used for classification. The parameters used for feature selection were optimized using the simplex algorithm. Training and testing were performed using a leave-one-patient-out scheme. The FP reduction performances in different feature spaces were evaluated by using the area Az under the receiver operating characteristic curve and the number of FPs per CT section at a given sensitivity as accuracy measures. Our data set consisted of 82 CT scans (3551 axial sections) from 56 patients with section thickness ranging from 1.0 to 2.5 mm. Our prescreening algorithm detected 111 of the 116 solid nodules (nodule size: 3.0-30.6 mm) marked by experienced thoracic radiologists. The test Az values were 0.95 +/- 0.01, 0.88 +/- 0.02, and 0.94 +/- 0.01 in the new, previous, and combined feature spaces, respectively. The number of FPs per section at 80% sensitivity in these three feature spaces were 0.37, 1.61, and 0.34, respectively. The improvement in the test Az with the 25 new features was statistically significant (p<0.0001) compared to that with the previous 19 features alone.

Algorithms↗

Support vector machines for dyadic data.

We describe a new technique for the analysis of dyadic data, where two sets of objects (row and column objects) are characterized by a matrix of numerical values that describe their mutual relationships. The new technique, called potential support vector machine (P-SVM), is a large-margin method for the construction of classifiers and regression functions for the column objects. Contrary to standard support vector machine approaches, the P-SVM minimizes a scale-invariant capacity measure and requires a new set of constraints. As a result, the P-SVM method leads to a usually sparse expansion of the classification and regression functions in terms of the row rather than the column objects and can handle data and kernel matrices that are neither positive definite nor square. We then describe two complementary regularization schemes. The first scheme improves generalization performance for classification and regression tasks; the second scheme leads to the selection of a small, informative set of row support objects and can be applied to feature selection. Benchmarks for classification, regression, and feature selection tasks are performed with toy data as well as with several real-world data sets. The results show that the new method is at least competitive with but often performs better than the benchmarked standard methods for standard vectorial as well as true dyadic data sets. In addition, a theoretical justification is provided for the new approach.

Artificial Intelligence↗

Sequence analysis of oligodeoxyribonucleotides by mass spectrometry. 2. Application of computerized pattern recognition to sequence determination of di-, tri-, and tetranucleotides.

A novel strategy for the sequence analysis of oligodeoxyribonucleotides has been devised which is based upon the analysis of intact underivatized oligonucleotides by mass spectrometry followed by interpretation of the mass-spectral data by computerized pattern-recognition techniques. The pyrolytic and electron-impact conditions of the mass spectrometer permit the cleavage of oligonucleotides of varying chain length and composition, yielding reproducible fragmentations and characteristic m/e values which can be used to reveal purine and/or pyrimidine base sequence information. The selection of optimum features (which are the ratios of peak heights of specific ions, or the linear combination of such ratios) has been done by an interactive feature selection method employing multidimensional k nearest-neighbor analysis and two-dimensional feature-space plots (nonlinear mappings) of the mass-spectral data. Features have been found which allow 100% classification accuracy in predicting the 5' and 3' terminus of all of the dinucleotides commonly found in DNA. Other specific features have been found which indicate adjacent nucleotides within a tetranucleotide. Knowledge of the adjacent nucleotide pairs present, in conjunction with the information as to the 3' or 5' position of the residues in each pair, permits the reconstruction of the sequence of the tetranucleotide.

Base Sequence↗

DREAM: a shell-like software system for medical data analysis and decision support.

A software system was designed whose aim is to support everyday scientific research of physicians in different fields of medicine. DREAM is a shell-like tool which can be customized embedding in it the desirable structure of a particular medical problem. Various basic statistical analyses are provided along with the decision support capabilities. The decision aid is proposed in two steps--feature selection and classifier design. Genetic algorithm is implemented as the feature selection procedure. The classifier design option includes crisp and fuzzy k-Nearest Neighbors rule and a two-level classification scheme based on majority rule on the votes of several first-level k-Nearest Neighbors classifiers. The system's performance is illustrated with a database from aviation medicine.

Aerospace Medicine↗

Computerised electrocardiology employing bi-group neural networks.

A configuration of bi-group neural networks (BGNN) is proposed combined with an evidential reasoning framework to interpret 12-lead electrocardiograms for three mutually exclusive classes. A number of pre-processing feature selection techniques were investigated prior to application of the input feature vector to each individual BGNN. The network outputs were discounted within a belief interval of 1 based on their performance on test data prior to combination. It was found that the application of the feature selection techniques enhanced the individual performance of the BGNN, and subsequently enhanced the overall performance. The proposed framework was compared with conventional classification techniques of multi-output neural networks and linear multiple regression. The framework attained a higher level of classification in comparison with the other methods; 70.4% compared with 66.7% for both multi-output neural and statistical techniques.

Diagnosis, Differential↗

Learning from examples in the small sample case: face expression recognition.

Example-based learning for computer vision can be difficult when a large number of examples to represent each pattern or object class is not available. In such situations, learning from a small number of samples is of practical value. To study this issue, the task of face expression recognition with a small number of training images of each expression is considered. A new technique based on linear programming for both feature selection and classifier training is introduced. A pairwise framework for feature selection, instead of using all classes simultaneously, is presented. Experimental results compare the method with three others: a simplified Bayes classifier, support vector machine, and AdaBoost. Finally, each algorithm is analyzed and a new categorization of these algorithms is given, especially for learning from examples in the small sample case.

Algorithms↗

Clinical and hormonal features of selective follicle-stimulating hormone (FSH) deficiency due to FSH beta-subunit gene mutations in both sexes.

OBJECTIVE: To report the clinical, hormonal, and molecular features of a female adolescent with selective FSH deficiency. In addition, a complete review of previous cases is provided, focusing on hormonal aspects. DESIGN: Clinical study. SETTING: University hospital. PATIENT(S): A 16-year-old girl with primary amenorrhea and poor breast development due to isolated FSH deficiency. INTERVENTION(S): Blood drawing before and after GnRH stimulation and pelvic ultrasound examination. MAIN OUTCOME MEASURE(S): Gonadotropin and E(2) measurements and sequencing of the FSH beta-subunit gene. RESULT(S): The patient was referred for primary amenorrhea and partial breast development (Tanner III). Her basal and GnRH-stimulated LH levels were elevated (31 IU/L and 98 IU/L, respectively), whereas her FSH levels were undetectable (<1 IU/L) in both conditions. Estradiol levels were low (<13 pg/mL). Automatic sequencing showed a nucleotide substitution of C for A in exon 3, resulting in a homozygous nonsense mutation in amino acid position 76 (Tyr76X) of the FSH beta-subunit. CONCLUSION(S): The Tyr76X mutation of the FSH beta-subunit was associated with a partial phenotype of FSH deficiency. To date, only four loss-of-function mutations of the FSH beta-subunit have been described in eight patients with undetectable serum FSH and high serum LH levels. Therefore, this unusual hormonal profile strongly suggests a defect in the FSH beta-subunit in both sexes.

Adolescent↗

Computerized motion analysis of videotaped neonatal seizures of epileptic origin.

PURPOSE: The main objective of this research is the development of automated video processing and analysis procedures aimed at the recognition and characterization of the types of neonatal seizures. The long-term goal of this research is the integration of these computational procedures into the development of a stand-alone automated system that could be used as a supplement in the neonatal intensive care unit (NICU) to provide 24-h per day noninvasive monitoring of infants at risk for seizures. METHODS: We developed and evaluated a variety of computational tools and procedures that may be used to carry out the three essential tasks involved in the development of a seizure recognition and characterization system: the extraction of quantitative motion information from video recordings of neonatal seizures in the form of motion-strength and motor-activity signals, the selection of quantitative features that convey some unique behavioral characteristics of neonatal seizures, and the training of artificial neural networks to distinguish neonatal seizures from random infant behaviors and to differentiate between myoclonic and focal clonic seizures. RESULTS: The methods were tested on a set of 240 video recordings of 43 patients exhibiting myoclonic seizures (80 cases), focal clonic seizures (80 cases), and random infant movements (80 cases). The outcome of the experiments verified that optical- flow methods are promising computational tools for quantifying neonatal seizures from video recordings in the form of motion-strength signals. The experimental results also verified that the robust motion trackers developed in this study outperformed considerably the motion trackers based on predictive block matching in terms of both reliability and accuracy. The quantitative features selected from motion-strength and motor-activity signals constitute a satisfactory representation of neonatal seizures and random infant movements and seem to be complementary. Such features lead to trained neural networks that exhibit performance levels exceeding the initial goals of this study, the sensitivity goal being >or=80% and the specificity goal being >or=90%. CONCLUSIONS: The outcome of this experimental study provides strong evidence that it is feasible to develop an automated system for the recognition and characterization of the types of neonatal seizures based on video recordings. This will be accomplished by enhancing the accuracy and improving the reliability of the computational tools and methods developed during the course of the study outlined here.

Brain↗

Systematic selection of prognostic features in patients with severe head injury.

In this study small sets of clinical features were identified that, when combined, yield high quality predictions of long term outcome. The study is based on a series of 305 consecutive head-injured Dutch patients, all of whom had been in coma for at least 6 hours. The overall social outcome was assessed after 6 months using the Glasgow outcome scale. Predictions of outcome were made by assigning probabilities to each possible outcome category. The prognostically most promising features recorded during the early post-traumatic course were identified, and powerful combinations of prognostic features were selected on admission and 1, 3, 7, 14, and 28 days after the start of coma by an appropriate statistical method. At each time point, optimal prediction required sets of only three to five features, typically including age in decades, depth and duration of coma as assessed by the Glasgow coma scale, pupil reactivity to light, and spontaneous and reflex eye movements. The method described allows bedside predictions in individual patients and provides a tool for comparing the severity of injury between series of patients.

Adolescent↗

Visual selection of features and objects: is location special? A reinterpretation of Nissen's (1985) findings.

Nissen (1985) compared selection by location with selection by color or shape in partial-report experiments. Her analysis of response contingencies when a target was defined in terms of one attribute (location, color, or shape), and when the task was to report the two remaining attributes, suggested a special role for selection by location: It appeared that cross-referencing between color and shape was mediated by location. An alternative interpretation is developed here: The findings are explained by a theory of attention (Bundesen, 1990), in which selection by location is treated on a par with selection by color or shape.

Attention↗

Support vector machines for automated gait classification.

Ageing influences gait patterns causing constant threats to control of locomotor balance. Automated recognition of gait changes has many advantages including, early identification of at-risk gait and monitoring the progress of treatment outcomes. In this paper, we apply an artificial intelligence technique [support vector machines (SVM)] for the automatic recognition of young-old gait types from their respective gait-patterns. Minimum foot clearance (MFC) data of 30 young and 28 elderly participants were analyzed using a PEAK-2D motion analysis system during a 20-min continuous walk on a treadmill at self-selected walking speed. Gait features extracted from individual MFC histogram-plot and Poincaré-plot images were used to train the SVM. Cross-validation test results indicate that the generalization performance of the SVM was on average 83.3% (+/-2.9) to recognize young and elderly gait patterns, compared to a neural network's accuracy of 75.0+/-5.0%. A "hill-climbing" feature selection algorithm demonstrated that a small subset (3-5) of gait features extracted from MFC plots could differentiate the gait patterns with 90% accuracy. Performance of the gait classifier was evaluated using areas under the receiver operating characteristic plots. Improved performance of the classifier was evident when trained with reduced number of selected good features and with radial basis function kernel. These results suggest that SVMs can function as an efficient gait classifier for recognition of young and elderly gait patterns, and has the potential for wider applications in gait identification for falls-risk minimization in the elderly.

Adult↗

A feature based pharmacophore for Candida albicans MyristoylCoA: protein N-myristoyltransferase inhibitors.

A three-dimensional pharmacophore model has been generated for Candida albicans MyristoylCoA: protein N-myristoyltransferase (NMT) inhibitors, using the software program CATALYST. The in vitro NMT inhibitory activity of a series of peptidic inhibitors was used for pharmacophore generation. The effect of altering the control parameters and feature selection was studied to arrive at the pharmacophore model. The selection of the best hypothesis model was based on the total cost, predictive ability, difference in the cost from the null hypothesis and alignment of the training set compounds on to the hypothesis. The pharmacophore model selected has four features; one hydrophobic, two hydrogen bond acceptor and one positive ionisable function. Groups identified as necessary by scanning alanine mutagenesis studies of the peptidic substrate of C. albicans NMT, have been identified as pharmacophore features. Comparison of the ligand binding with the enzyme in the crystal structure of NMT and that proposed by the phamacophore is consistent. The pharmacophore thus generated can be used as a template for designing non-peptidic inhibitors of NMT.

Acyltransferases↗

Pattern classification by adaptive machines.

Man's intelligent behavior is due in part to his ability to select, classify, and abstract significant information reaching him from his environment by way of his senses. This function, pattern recognition, has become a major focus of research by scientists working in the field of artificial intelligence. At the lowest level, pattern recognition reduces to pattern classification, which consists of the separation, into desired classes, of groups of objects, sounds, odors, events, properties, and the like; the separations are based on sets of measurements made on the entities being classified. The pattern classifier is composed of a data filter and a categorizer. The data filter selects the distinguishing features and represents them as sets of real numbers; each set is termed a pattern. The categorizer assigns each pattern to one of several desired classes. Patterns can be represented geometrically as points in an n-dimensional space; the n coordinates of each point are the numerical values of the features selected to represent the pattern. A pattern classification system separates an n-dimensional space into regions, each of which ideally contains points of only one class. One method to effect this separation is by means of ldquo;trainablerdquo; categorizers-major components of adaptive machines. They consist of networks whose internal parameters are varied according to a set of fixed rules during a training cycle. A statistically large sample of known patterns are presented, one at a time, to the networks; internal corrections are made each time a pattern is erroneously classified. Classifica-tion performance tends to improve as the set of known patterns is cycled repetitively through the machine. Finally, the adequacy of adaptation is tested by a separate set of similar patterns which have not been used in the training process. A number of different machine organizations and training rules have been developed and are being applied successfully to numerous classification problems. More difficult recognition problems requiring the aid of logioal tests and analysis, search and association, use the digital computer programmed to supplement the functions of the adaptive classifier.

Body Constitution↗

Deciphering microbial and metabolic influences in gastrointestinal diseases-unveiling their roles in&#xa0;gastric cancer, colorectal cancer, and inflammatory bowel disease.

INTRODUCTION: Gastrointestinal disorders (GIDs) affect nearly 40% of the global population, with gut microbiome-metabolome interactions playing a crucial role in gastric cancer (GC), colorectal cancer (CRC), and inflammatory bowel disease (IBD). This study aims to investigate how microbial and metabolic alterations contribute to disease development and assess whether biomarkers identified in one disease could potentially be used to predict another, highlighting cross-disease applicability. METHODS: Microbiome and metabolome datasets from Erawijantari et al. (GC: n&#x2009;=&#x2009;42, Healthy: n&#x2009;=&#x2009;54), Franzosa et al. (IBD: n&#x2009;=&#x2009;164, Healthy: n&#x2009;=&#x2009;56), and Yachida et al. (CRC: n&#x2009;=&#x2009;150, Healthy: n = 127) were subjected to three machine learning algorithms, eXtreme gradient boosting (XGBoost), Random Forest, and Least Absolute Shrinkage and Selection Operator (LASSO). Feature selection identified microbial and metabolite biomarkers unique to each disease and shared across conditions. A microbial community (MICOM) model simulated gut microbial growth and metabolite fluxes, revealing metabolic differences between healthy and diseased states. Finally, network analysis uncovered metabolite clusters associated with disease traits. RESULTS: Combined machine learning models demonstrated strong predictive performance, with Random Forest achieving the highest Area Under the Curve(AUC) scores for GC(0.94[0.83-1.00]), CRC (0.75[0.62-0.86]), and IBD (0.93[0.86-0.98]). These models were then employed for cross-disease analysis, revealing that models trained on GC data successfully predicted IBD biomarkers, while CRC models predicted GC biomarkers with optimal performance scores. CONCLUSION: These findings emphasize the potential of microbial and metabolic profiling in cross-disease characterization particularly for GIDs, advancing biomarker discovery for improved diagnostics and targeted therapies.

Humans↗

Color image analysis for quantifying renal tumor angiogenesis.

OBJECTIVE: To segment and quantify microvessels in renal tumor angiogenesis based on a color image analysis method and to improve the accuracy and reproducibility of quantifying microvessel density. STUDY DESIGN: The segmentation task was based on a supervised learning scheme. First, 12 color features (RGB, HSI, I1I2I3 and L*a*b*) were extracted from a training set. The feature selection procedure selected I2L*S features as the best color feature vector. Then we segmented microvessels using the discriminant function made using the minimum error rate classification rule of Bayesian decision theory. In the quantification step, after applying a connected component-labeling algorithm, microvessels with discontinuities were connected and touching microvessels separated. We tested the proposed method on 23 images. RESULTS: The results were evaluated by comparing them with manual quantification of the same images. The comparison revealed that our computerized microvessel counting correlated highly with manual counting by an expert (r = 0.95754). The association between the number of microvessels after the initial segmentation and manual quantification was also assessed using Pearson's correlation coefficient (r = 0.71187). The results indicate that our method is better than conventional computerized image analysis methods. CONCLUSION: Our method correlated highly with quantification by an expert and could become a way to improve the accuracy, feasibility and reproducibility of quantifying microvessel density. We anticipate that it will become a useful diagnostic tool for angiogenesis studies.

Algorithms↗