Book ; Thesis: Similarities and differences between the processing of immediate and delayed performance feedback
2018
Abstract: Learning from feedback enables behavioural adaptation. Actions with beneficial outcomes are performed more frequently in the future, whereas actions leading to non-beneficial or aversive outcomes are avoided. Animal research on feedback learning showed ... ...
| Title translation | Ähnlichkeiten und Unterschiede zwischen der Verarbeitung von sofortigem und verzögertem Leistungsfeedback |
|---|---|
| Abstract | Learning from feedback enables behavioural adaptation. Actions with beneficial outcomes are performed more frequently in the future, whereas actions leading to non-beneficial or aversive outcomes are avoided. Animal research on feedback learning showed that midbrain dopamine (DA) neuron firing rates burst in response to reward-predicting stimuli, while their firing rate dips when the expected reward is omitted, thereby coding a prediction error signal. In humans, DA neurons project from the midbrain to the striatum and anterior cingulate cortex (ACC), which have both been shown to play a role in feedback processing. However, a previous imaging study reported that the hippocampus (HC) becomes active when feedback is processed that follows a related action after a temporal delay (7 s). This finding associates the HC with delayed feedback processing, while it is usually ascribed to declarative memory. In line with this, patients suffering from Parkinson's disease (PD), which is characterised by a substantial depletion of striatal DA levels, were impaired in learning from immediate (1 s), but not delayed (7 s) feedback, possibly making use of their intact HC. Furthermore, an event-related potential (ERP) study found that the activity in the striatum/ACC decreases with increasing temporal delay between an action and the relative feedback. It is not yet clear whether the striatum/ACC and the HC are parts of two competing neuronal systems and feedback is processed in either one or the other depending on its timing, or whether these structures interact in a cooperative manner. In a series of three studies, the present dissertation examined the modulatory effects of temporal delay on the neuro-cognitive underpinning of feedback processing by comparing effects that are well-established in learning from immediate feedback between immediate (1 s) and delayed (7 s) feedback learning. Unlike healthy control participants, PD patients have previously been found to learn better from negative than positive immediate feedback, which was attributed to their lack of striatal DA. Study 1 compared this learning bias between two groups of patients (and their controls) that learned from immediate and delayed feedback, respectively. The feedback timing did, however, not affect the patients' tendency to learn better from negative feedback, which indicates that striatal DA depletion affected both learning from immediate and delayed feedback. This in turn suggests a striatal contribution to delayed feedback processing. The feedback-related negativity (FRN) is an ERP component that supposedly reflects DA-related activity in the striatum/ACC. Previous research showed that the FRN amplitude is increased for unexpected compared to expected immediate feedback mirroring a prediction error. Study 2 compared this FRN expectancy effect between immediate and delayed feedback finding larger FRN amplitudes for unexpected compared to expected feedback during both immediate and delayed feedback learning. In line with Study 1, this finding suggests striatal/ACC involvement in delayed feedback processing. Feedback agency has previously been shown to modulate activity in the striatum/ACC as well, with decreased activity for learning from feedback for observed versus self-performed actions. Study 3 investigated the combined influence of feedback agency and delay on the FRN as well as beta and theta band oscillations. The FRN was affected by feedback agency and delay, with a combined influence only for feedback for self-generated actions. Beta and theta power were affected by feedback timing, while agency only modulated the power in the theta band. These results indicate that the mechanisms underlying the FRN may differ from those underlying beta and theta oscillations. Beta and theta oscillations have been suggested to reflect valence-specific communication signals in the need for memory consolidation or cognitive control, respectively. Taken together, the results of all three studies indicate a contribution of the striatum/ACC to delayed feedback processing, which may suggest a cooperation of declarative and non-declarative systems during delayed feedback learning. - Contents: (1) Weismüller, B., Ghio, M., Logmin, K., Hartmann, C., Schnitzler, A., Pollok, B., Südmeyer, M. & Bellebaum, C. (2018). Effects of feedback delay on learning from positive and negative feedback in patients with Parkinson's disease off medication. Neuropsychologia, 117, 46-54. DOI: 10.1016/j.neuropsychologia.2018.05.010. (2) Weismüller, B. & Bellebaum, C. (2016). Expectancy affects the feedback-related negativity (FRN) for delayed feedback in probabilistic learning. Psychophysiology, 53, 1739-1750. DOI: 10.1111/psyp.12738. (3) Weismüller, B., Kullmann, J., Hoenen, M. & Bellebaum, C. (2019). Effects of feedback delay and agency on feedback-locked beta and theta power during reinforcement learning. Psychophysiology, 56:e13428. DOI: 10.1111/psyp.13428. |
| Keywords | Agency ; Beobachtungslernen ; Delayed Feedback ; Dopamin ; Dopamine ; Electrical Activity ; Elektrische Aktivität ; Erwartungen ; Evoked Potentials ; Evozierte Potenziale ; Expectations ; Feedback ; Handeln ; Learning ; Lernen ; Observational Learning ; Parkinson's Disease ; Parkinson-Krankheit ; Probability Learning ; Verzögerte Rückmeldung ; Wahrscheinlichkeitslernen |
| Language | English |
| Size | 102 pp., 61 pp. appendix |
| Publisher | Universität, Mathematisch-Naturwissenschaftliche Fakultät |
| Publishing place | Düsseldorf |
| Document type | Book ; Thesis |
| Note | Elektronische Publikation im Internet. Kumulative Dissertation |
| Database | PSYNDEX |
More links
Kategorien
Inter-library loan at ZB MED
Your chosen title can be delivered directly to ZB MED Cologne location if you are registered as a user at ZB MED Cologne.