PubMed Health⌕ Search

Biomedical subjects

MS Drew

Publications and source records attributed to MS Drew.

2 recordsLinked to original sources

Spectral sharpening with positivity

Spectral sharpening is a method for developing camera or other optical-device sensor functions that are more narrowband than those in hardware, by means of a linear transform of sensor functions. The utility of such a transform is that many computer vision and color-correction algorithms perform better in a sharpened space, and thus such a space can be used as an intermediate representation for carrying out calculations. In this paper we consider how one may sharpen sensor functions such that the transformed sensors are all positive. We show that constrained optimization can be used to produce positive sensors in two fundamentally different ways: by constraining the coefficients in the transform or by constraining the functions directly. In the former method, we prove that convexity can be used to constrain the solution exactly. In a sense, we are continuing the work of MacAdam and of Pearson and Yule, who formed positive combinations of the color-matching functions. However, the advantage of the spectral sharpening approach is that not only can we produce positive curves, but the process is "steerable" in that we can produce positive curves with as good or better properties for sharpening within a given set of sharpening intervals. At base, however, it is positive colors in the transformed space that are the prime objective. Therefore we also carry out sharpening of sensor curves governed not by positivity of the curves themselves but of colors resulting from them. Curves that result have negative lobes but generate positive colors. We find that this type of constrained sharpening generates the best results, which are almost as good as for unconstrained sharpening but without the penalty of negative colors. All methods discussed may be used with any number of sensors.

Journal Article↗

Color from shape from color: a simple formalism with known light sources

Photometric stereo is a well-known technique for recovering surface normals of a surface but requires three or more images of a surface taken under illumination from different directions. At best, one may dispense with the need for multiple images by using colored lights tuned to camera filters. But a less restrictive paradigm is available that uses the orientation-from-color approach, wherein multiple broadband illuminants impinge on a surface simultaneously. In that method, colors for a Lambertian surface lie on an ellipsoid in color space. The method has been applied mainly to single-color objects, with ellipsoid quadratic-form parameters determined from a large number of pixels. However, recently Petrov and Antonova [Color Res. Appl. 21, 97 (1996)] developed an entirely local approach, useful also for multicolored objects with color uniform in each patch. We investigate to what extent a method such as that of Petrov and Antonova can be applied in the ostensibly simpler situation in which the complex lighting environment is known, i.e., a color photometric stereo situation, with all lights in play at once with only a single image to analyze. We find that, assuming a simple model of color formation, we are able to recover the object colors along with surface normals, using only a single image. Because we immerse the object in a known lighting environment, we show that only half of the equations utilized by Petrov and Antonova are actually needed, making the method more stable. Nevertheless, solutions do not exist at every pixel; instead we may determine a best estimate of patch color, using a robust estimator, and then apply that estimate throughout a patch. Results are shown to be quite good compared with ground truth. The simple color model can often be made to hold more exactly by transforming the color space into one corresponding to spectrally sharpened sensors, which are a matrix transform away from the actual camera sensors. In our study the reliability and accuracy of the normal vector and of the surface color recovery algorithm are improved by this straightforward transformation.

Journal Article↗