The perirhinal (PER) and postrhinal cortex (POR) in the medial temporal lobe (MTL) are commonly described as two distinct systems that process non-spatial and spatial information, respectively. Recent findings suggest that the two regions exhibit functional overlap when processing stimulus information, especially when associative responses are required in goal-directed behavior. However, we lack the neural correlates of this. In the current study, we recorded spiking activities for single units of the PER and POR as rats were required to choose a response associated with the identity of a visual object or scene stimulus. We found that similar proportions of cells fired selectively for either scene or object between the two regions. In the PER and POR, response-selective neurons showed higher contrast for different responses than stimulus-selective cells did for stimuli. More cells fired selectively for specific choice response in the POR than in the PER. The differential firing patterns of the PER and POR were best explained when the stimulus and response components were considered together: Stimulus-selective cells were modulated more by the response in the POR than in the PER, whereas response-selective cells in the PER were modulated more by object information than by scenes. Our results suggest that in a goal-directed memory task, the information processing in the PER and POR may be dynamically modulated not only by input stimulus information but also by the associated choice behavior and stimulus-response interaction.