Research

Computational models

Encoding models that connect sensory input, brain responses and behavior.

Connective field model on the cortical surface: changing the field's center and size changes which part of the source map predicts a response.

Our encoding models explain a brain response from the sensory input or from activity elsewhere in the brain, using parameters with a biological meaning. We then ask how those parameters vary across brain regions, how they change with attention and neurochemistry, and how they relate to behavior.

Approach

An fMRI voxel samples hundreds of thousands of neurons. On a retinotopic map, neurons with similar receptive fields lie close together, so each voxel has a preference: its population receptive field (pRF), the region of visual space it responds to. We fit pRF models to responses to mapping stimuli and extend them with computations such as divisive normalization.

Connective field models apply the same idea from brain to brain. They explain a region’s responses from a Gaussian patch of activity on a topographic source map such as primary visual cortex (V1). Depending on the source map, the patch’s center stands for a location in visual space or a position on the body, and its size, in millimeters of cortex, measures the spatial scale of integration. They need only brain activity, so they can be fit to data from any experiment, including movie watching and rest (Knapen, 2021). For behavior and the pupil, we use models of learning and decision making to estimate latent processes trial by trial. Our model-fitting software is listed under software and data.

What we have found

Normalization explains diverse pRF responses. A pRF model based on divisive normalization captured seemingly disparate response signatures in human visual cortex with a single computation, and outperformed existing pRF models; its parameters varied systematically across the visual hierarchy (Aqil et al., 2021). Comparing these parameters from 7T fMRI with receptor density maps from positron emission tomography provided evidence that serotonin and GABA receptor densities are a biological substrate for modulations of normalization in the human visual system (Aqil et al., 2024).

Contextual computation under psilocybin. In humans, psilocybin altered contextual perception in the Ebbinghaus illusion and contextual modulation of visual cortical responses, and a computational model captured and linked both changes (Aqil et al., 2025).

Attention changes how visual cortex samples space. Spatial and feature-based attention interacted in how human visual cortex resampled space; an attentional gain field of varying precision explains this parsimoniously (van Es et al., 2018). Focused attention attracted pRFs toward the attended location more strongly than distributed attention did (Sheikh Abdirashid et al., 2025).

The pupil tracks learning variables. In a reinforcement learning task, the human pupil dilated before a choice with trial-by-trial value beliefs. After feedback, early dilation scaled with value uncertainty and later constriction with signed reward prediction errors (Van Slooten et al., 2018).

Open questions

Can a small set of canonical computations, with parameters set by local neurochemistry, account for responses beyond visual cortex? How should encoding models handle the eye movements and complex input of natural vision? To make these models easier to apply and extend, the Popylar project develops prfmodel, a community Python package for pRF and connective field modeling. Version 0.2.0 was released for our workshop in Coimbra in November 2026.

Papers

16 papers on this theme, selected papers first. Filter the full list.

  1. Vicarious body maps bridge vision and touch in the human brain

    Hedger N, Naselaris T, Kay K, Knapen T

    Nature 650(8100), 173–181 (2025) Selected

  2. Psilocybin alters visual contextual computations

    Aqil M, de Hollander G, Vreugdenhil N, Knapen T, Dumoulin SO

    Nature Communications 16(1), 10271 (2025) Selected

  3. Computational model links normalization to chemoarchitecture in the human visual system

    Aqil M, Knapen T, Dumoulin SO

    Science Advances 10(1), eadj6102 (2024) Selected

  4. Divisive normalization unifies disparate response signatures throughout the human visual hierarchy

    Aqil M, Knapen T, Dumoulin SO

    Proceedings of the National Academy of Sciences 118(46), e2108713118 (2021) Selected

  5. Topographic connectivity reveals task-dependent retinotopic processing throughout the human brain

    Knapen T

    Proceedings of the National Academy of Sciences 118(2), e2017032118 (2021) Selected

  6. Spatial sampling in human visual cortex is modulated by both spatial and feature-based attention

    van Es DM, Theeuwes J, Knapen T

    eLife 7, e36928 (2018) Selected

  7. Non-invasive mapping of the temporal processing hierarchy in the human visual cortex

    Eickhoff K, Hillebrand A, Knapen T, de Jong MC, Dumoulin SO

    PLoS Computational Biology 22(7), e1014434 (2026)

  8. The precision of attention controls attraction of population receptive fields

    Sheikh Abdirashid S, Knapen T, Dumoulin SO

    Journal of Vision 25(11), 3 (2025)

  9. Contextual responses drive a unique laminar signature in human V1

    Heij J, Raimondo L, Siero JCW, van der Zwaag W, Knapen T, Dumoulin SO

    iScience 28(7), 112967 (2025)

  10. Learning in Visual Regions as Support for the Bias in Future Value-Driven Choice

    Jahfari S, Theeuwes J, Knapen T

    Cerebral Cortex 30(4), 2005–2018 (2020)

Show all 16 papersShow fewer papers
  1. Dopaminergic medication reduces striatal sensitivity to negative outcomes in Parkinson's disease

    McCoy B, Jahfari S, Engels G, Knapen T, Theeuwes J

    Brain 142(11), 3605–3620 (2019)

  2. Cross-Task Contributions of Frontobasal Ganglia Circuitry in Response Inhibition and Conflict-Induced Slowing

    Jahfari S, Ridderinkhof KR, Collins AGE, Knapen T, Waldorp LJ, Frank MJ

    Cerebral Cortex 29(5), 1969–1983 (2019)

  3. Implicit and explicit learning in reactive and voluntary saccade adaptation

    van Es DM, Knapen T

    PLoS ONE 14(1), e0203248 (2019)

  4. How pupil responses track value-based decision-making during and after reinforcement learning

    Van Slooten JC, Jahfari S, Knapen T, Theeuwes J

    PLoS Computational Biology 14(11), e1006632 (2018)

  5. How Visual Cortical Organization Is Altered by Ophthalmologic and Neurologic Disorders

    Dumoulin SO, Knapen T

    Annual Review of Vision Science 4, 357–379 (2018) Review

  6. Cognitive and Ocular Factors Jointly Determine Pupil Responses under Equiluminance

    Knapen T, de Gee JW, Brascamp J, Nuiten S, Hoppenbrouwers S, Theeuwes J

    PLoS ONE 11(5), e0155574 (2016)

People

Ningkai Wang

PhD student (co-supervised with Jan Theeuwes)

Former lab members who worked on this theme: Nick Hedger, Marco Aqil, Sumiya Sheikh Abdirashid, Ron van de Klundert.

Software & data

Python package for fitting population receptive field models (including compressive spatial summation, difference-of-Gaussians and divisive normalization variants) and related models such as connective field and contrast sensitivity models, on GPU-accelerated backends (TensorFlow, PyTorch or JAX, through Keras 3). Developed by the Popylar team with the Netherlands eScience Center.

pip install "prfmodel[tensorflow]"

prfpy

Available

Python package to simulate and fit population receptive field (pRF) models to time series data, including the divisive normalization pRF model. prfmodel, developed in the Popylar project, builds on it.

pRFtime

Available

Python toolbox for spatiotemporal forward modeling of brain signals. It combines pRF maps from fMRI with MEG to estimate when each visual field map contributes to the measured response.