Ways to test stochastic dynamic programming models empirically.

Abstract

Stochastic dynamic programming (SDP) models are widely used to predict optimal behavioural and life history strategies. We discuss a diversity of ways to test SDP models empirically, taking as our main illustration a model of the daily singing routine of birds. One approach to verification is to quantify model parameters, but most SDP models are schematic. Because predictions are therefore qualitative, testing several predictions is desirable. How state determines behaviour (the policy) is a central prediction that should be examined directly if both state and behaviour are measurable. Complementary predictions concern how behaviour and state change through time, but information is discarded by considering behaviour rather than state, by looking only at average state rather than its distribution, and by not following individuals. We identify the various circumstances in which an individual's state/behaviour at one time is correlated with its state/behaviour at a later time. When there are several state variables the relationships between them may be informative. Often model parameters represent environmental conditions that can also be viewed as state variables. Experimental manipulation of the environment has several advantages as a test, but a problem is uncertainty over how much the organism's policy will adjust. As an example we allow birds to use different assumptions about how well past weather predicts future weather. We advocate mirroring planned empirical investigations on the computer to investigate which manipulations and predictions will best test a model. Copyright 2000 The Association for the Study of Animal Behaviour.