In fitting the process-dissociation model (L. L. Jacoby, 1991) to observed data, researchers aggregate outcomes across participant, items, or both. T. Curran and D. L. Hintzman (1995) demonstrated how biases from aggregation may lead to artifactual support for the model. The authors develop a hierarchical process-dissociation model that does not require aggregation for analysis. Most importantly, the Curran and Hintzman critique does not hold for this model. Model analysis provides for support of process dissociation--selective influence holds, and there is a dissociation in correlation patterns among participants and items. Items that are better recollected also elicit higher automatic activation. There is no correlation, however, across participants; that is, participants with higher recollection have no increased tendency toward automatic activation. The critique of aggregation is not limited to process dissociation. Aggregation distorts analysis in many nonlinear models, including signal detection, multinomial processing tree models, and strength models. Hierarchical modeling serves as a general solution for accurately fitting these psychological-processing models to data.

Understanding how response time (RT) changes with manipulations has been critical in distinguishing among theories in cognition. It is well known that aggregating data distorts functional relationships (e.g., Estes, 1956). Less well appreciated is a second pitfall: Minimizing squared errors (i.e., OLS regression) also distorts estimated functional forms with RT data. We discuss three properties of RT that should be modeled for accurate analysis and, on the basis of these three properties, provide a hierarchical Weibull regression model for regressing RT onto covariates. Hierarchical regression model analysis of lexical decision task data reveals that RT decreases as a power function of word frequency with the scale of RT decreasing 11% for every doubling of word frequency. A detailed discussion of the model and analysis techniques are presented as archived materials and may be downloaded from www.psychonomic.org/archive.

The theory of signal detection is convenient for measuring mnemonic ability in recognition memory paradigms. In these paradigms, randomly selected participants are asked to study randomly selected items. In practice, researchers aggregate data across items or participants or both. The signal detection model is nonlinear; consequently, analysis with aggregated data is not consistent. In fact, mnemonic ability is underestimated, even in the large-sample limit. We present two hierarchical Bayesian models that simultaneously account for participant and item variability. We show how these models provide for accurate estimation of participants’ mnemonic ability as well as the memorability of items. The model is benchmarked with a simulation study and applied to a novel data set.

We present a statistical model for inference with response time (RT) distributions. The model has the following features. First, it provides a means of estimating the shape, scale, and location (shift) of RT distributions. Second, it is hierarchical and models between-subjects and within-subjects variability simultaneously. Third, inference with the model is Bayesian and provides a principled and efficient means of pooling information across disparate data from different individuals. Because the model efficiently pools information across individuals, it is particularly well suited for those common cases in which the researcher collects a limited number of observations from several participants. Monte Carlo simulations reveal that the hierarchical Bayesian model provides more accurate estimates than several popular competitors do. We illustrate the model by providing an analysis of the symbolic distance effect in which participants can more quickly ascertain the relationship between nonadjacent digits than that between adjacent digits.

This paper provides a statistical framework for estimating higher-order characteristics of the response time distribution, such as the scale (variability) and shape. Consideration of these higher order characteristics often provides for more rigorous theory development in cognitive and perceptual psychology (e.g., Luce, 1986). RT distribution for a single participant depends on certain participant characteristics, which in turn can be thought of as arising from a distribution of latent variables. The present work focuses on the three-parameter Weibull distribution, with parameters for shape, scale, and shift (initial value). Bayesian estimation in a hierarchical framework is conceptually straightforward. Parameter estimates, both for participant quantities and population parameters, are obtained through Markov Chain Monte Carlo methods. The methods are illustrated with an application to response time data in an absolute identification task. The behavior of the Bayes estimates are compared to maximum likelihood (ML) estimates through Monte Carlo simulations. For small sample size, there is an occasional tendency for the ML estimates to be unreasonably extreme. In contrast, by borrowing strength across participants, Bayes estimation "shrinks" extreme estimates. The results are that the Bayes estimators are more accurate than the corresponding ML estimators.