Skip to main navigation Skip to search Skip to main content

SparseMAAC: Sparse Attention for Multi-agent Reinforcement Learning

  • East China Normal University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

In multi-agent scenario, each agent needs to aware other agents’ information as well as the environment to improve the performance of reinforcement learning methods. However, as the increasing of the agent number, this procedure becomes significantly complicated and ambitious in order to prominently improve efficiency. We introduce the sparse attention mechanism into multi-agent reinforcement learning framework and propose a novel Multi-Agent Sparse Attention Actor Critic (SparseMAAC) algorithm. Our algorithm framework enables the ability to efficiently select and focus on those critical impact agents in early training stages, while eliminates data noise simultaneously. The experimental results show that the proposed SparseMAAC algorithm not only exceeds those baseline algorithms in the reward performance, but also is superior to them significantly in the convergence speed.

Original languageEnglish
Title of host publicationDatabase Systems for Advanced Applications - DASFAA 2019 International Workshops
Subtitle of host publicationBDMS, BDQM, and GDMA, Proceedings
EditorsGuoliang Li, Jun Yang, Joao Gama, Juggapong Natwichai, Yongxin Tong
PublisherSpringer Verlag
Pages96-110
Number of pages15
ISBN (Print)9783030185893
DOIs
StatePublished - 2019
Event24th International Workshops on Database Systems for Advanced Applications, DASFAA 2019: BDMS, BDQM, and GDMA - Chiang Mai, Thailand
Duration: 22 Apr 2019 → 25 Apr 2019

Publication series

NameLecture Notes in Computer Science
Volume11448 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference24th International Workshops on Database Systems for Advanced Applications, DASFAA 2019: BDMS, BDQM, and GDMA
Country/TerritoryThailand
CityChiang Mai
Period22/04/19 → 25/04/19

Keywords

  • Actor-attention-critic
  • Multi-agent deep reinforcement learning
  • Sparse attention mechanism

Fingerprint

Dive into the research topics of 'SparseMAAC: Sparse Attention for Multi-agent Reinforcement Learning'. Together they form a unique fingerprint.

Cite this