Search
Close
  • About Us
    • Governance
    • Our Team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying Robots
      • Legged robots
      • Collaboration, Learning and Tests
    • Educational robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for Kids
      • R2t2 Mars Mission
    • Graduate Programs in Robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for Girls
    • Master students
    • Young Researchers
    • Building Equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Master Students Exchange Program
    • PhD/Postdoc exchange program
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • Women keynote speakers
    • Best Paper Award
    • Ukrainian researchers
  • Outreach
    • Swiss Drone Days
    • Cybathlon
    • Swiss Robotics Days
    • Other Outreach Events
  • Contact
Menu
  • About Us
    • Governance
    • Our Team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying Robots
      • Legged robots
      • Collaboration, Learning and Tests
    • Educational robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for Kids
      • R2t2 Mars Mission
    • Graduate Programs in Robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for Girls
    • Master students
    • Young Researchers
    • Building Equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Master Students Exchange Program
    • PhD/Postdoc exchange program
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • Women keynote speakers
    • Best Paper Award
    • Ukrainian researchers
  • Outreach
    • Swiss Drone Days
    • Cybathlon
    • Swiss Robotics Days
    • Other Outreach Events
  • Contact
Search
Close
  • NCCR Robotics
    • Highlights
    • Governance
    • Our team
    • Labs
    • Past programs
    • Alumni
    • Open positions in robotics
  • Research
    • Wearable Robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying robots
      • Legged robots
      • Collaborations, learning and tests
    • Educational Robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
    • Research resources
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for kids
      • R2t2 Mars mission
    • Graduate programs in robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Building equality
    • Women in Robotics
    • Resources
  • Outreach
    • Swiss Robotics Days
    • Swiss Drone Days
    • Cybathlon
    • Photo exhibit
    • Other Outreach Events
Menu
  • NCCR Robotics
    • Highlights
    • Governance
    • Our team
    • Labs
    • Past programs
    • Alumni
    • Open positions in robotics
  • Research
    • Wearable Robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying robots
      • Legged robots
      • Collaborations, learning and tests
    • Educational Robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
    • Research resources
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for kids
      • R2t2 Mars mission
    • Graduate programs in robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Building equality
    • Women in Robotics
    • Resources
  • Outreach
    • Swiss Robotics Days
    • Swiss Drone Days
    • Cybathlon
    • Photo exhibit
    • Other Outreach Events

A Comparison of PSO and Reinforcement Learning for Multi-Robot Obstacle Avoidance

Publication date:

Authors:

  • Presented at: IEEE Congress on Evolutionary Computation, Cancún, México, June 20-23, 2013
  • Published in: 2013 IEEE Congress on Evolutionary Computation (CEC), p. 149-156
  • New York: IEEE, 2013

The design of high-performing robotic controllers constitutes an example of expensive optimization in uncertain environments due to the often large parameter space and noisy performance metrics. There are several evaluative techniques that can be employed for on-line controller design. Adequate benchmarks help in the choice of the right algorithm in terms of final performance and evaluation time. In this paper, we use multi-robot obstacle avoidance as a benchmark to compare two different evaluative learning techniques: Particle Swarm Optimization and Q-learning. For Q-learning, we implement two different approaches: one with discrete states and discrete actions, and another one with discrete actions but a continuous state space. We show that continuous PSO has the highest fitness overall, and Q-learning with continuous states performs significantly better than Q-learning with discrete states. We also show that in the single robot case, PSO and Q-learning with discrete states require a similar amount of total learning time to converge, while the time required with Q-learning with continuous states is significantly larger. In the multi-robot case, both Q-learning approaches require a similar amount of time as in the single robot case, but the time required by PSO can be significantly reduced due to the distributed nature of the algorithm.

    Reference

    • Detailed record: https://infoscience.epfl.ch/record/186658?ln=en
    • EPFL-CONF-186658
    • View record in Web of Science
    • URL: http://apps.webofknowledge.com/InboundService.do?UT=WOS%3A000326235300020&IsProductCode=Yes&mode=FullRecord&product=WOS&SID=W2Ht3JD6N1JE8pTzEue&smartRedirect=yes&SrcApp=PARTNER_APP&DestFail=http%3A%2F%2Fwww.webofknowledge.com%3FDestApp%3DCEL%26DestParams%3D%253Faction%253Dretrieve%2526mode%253DFullRecord%2526product%253DCEL%2526UT%253DWOS%253A000326235300020%2526customersID%253DTROpenURL%26e%3DoPZdSqe76bsQLZpgyOsQFsJs3GlDdNMpq4RAmwIuGgj8R3Kh.2W7i8SEke49lfJQ%26SrcApp%3DPARTNER_APP%26SrcAuth%3DTROpenURL&action=retrieve&Init=Yes&SrcAuth=TROpenURL&Func=Frame&customersID=TROpenURL
    Reference
    Read the paper
    • Innovation Booster Robotics
    • News
    • Past Events
    • Contact
    • Innovation Booster Robotics
    • News
    • Past Events
    • Contact
    • Journalists and media
    • News bulletin archive
    • Newsletter archive
    • Journalists and media
    • News bulletin archive
    • Newsletter archive
    Twitter Linkedin Youtube
    NCCR Robotics partner institutions

    Leading house

    epfl_white

    Co-Leading house

    eth_white
    unizuerich_white
    idsia_white
    unibe_all_white
    empa-all-white
    unibasel_white

    This website was built by NCCR Robotics and provides useful information on Swiss Robotics. From December 2022, it is no longer updated.

    Copyright © 2022 NCCR Robotics. All rights reserved.