Skip to main content
placeholder image

Emotional multiagent reinforcement learning in social dilemmas

Journal Article


Abstract


  • Social dilemmas have attracted extensive interest in multiagent system research in order to study the emergence of cooperative behaviors among selfish agents. Without extra mechanisms or assumptions, directly applying multiagent reinforcement learning in social dilemmas will end up with convergence to the Nash equilibrium of mutual defection among the agents. This paper investigates the importance of emotions in modifying agent learning behaviors in order to achieve cooperation in social dilemmas. Two fundamental variables, individual wellbeing and social fairness, are considered in the appraisal of emotions that are used as intrinsic rewards for learning. Experimental results reveal that different structural relationships between the two appraisal variables can lead to distinct agent behaviors, and under certain circumstances, cooperation can be obtained among the agents.

Publication Date


  • 2013

Citation


  • Yu, C., Zhang, M. & Ren, F. (2013). Emotional multiagent reinforcement learning in social dilemmas. Lecture Notes in Computer Science, 8291 372-387. Dunedin Emotional multiagent reinforcement learning in social dilemmas

Scopus Eid


  • 2-s2.0-84893094666

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers/1993

Has Global Citation Frequency


Number Of Pages


  • 15

Start Page


  • 372

End Page


  • 387

Volume


  • 8291

Place Of Publication


  • Germany

Abstract


  • Social dilemmas have attracted extensive interest in multiagent system research in order to study the emergence of cooperative behaviors among selfish agents. Without extra mechanisms or assumptions, directly applying multiagent reinforcement learning in social dilemmas will end up with convergence to the Nash equilibrium of mutual defection among the agents. This paper investigates the importance of emotions in modifying agent learning behaviors in order to achieve cooperation in social dilemmas. Two fundamental variables, individual wellbeing and social fairness, are considered in the appraisal of emotions that are used as intrinsic rewards for learning. Experimental results reveal that different structural relationships between the two appraisal variables can lead to distinct agent behaviors, and under certain circumstances, cooperation can be obtained among the agents.

Publication Date


  • 2013

Citation


  • Yu, C., Zhang, M. & Ren, F. (2013). Emotional multiagent reinforcement learning in social dilemmas. Lecture Notes in Computer Science, 8291 372-387. Dunedin Emotional multiagent reinforcement learning in social dilemmas

Scopus Eid


  • 2-s2.0-84893094666

Ro Metadata Url


  • http://ro.uow.edu.au/eispapers/1993

Has Global Citation Frequency


Number Of Pages


  • 15

Start Page


  • 372

End Page


  • 387

Volume


  • 8291

Place Of Publication


  • Germany