Search
Close
  • About Us
    • Governance
    • Our Team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying Robots
      • Legged robots
      • Collaboration, Learning and Tests
    • Educational robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for Kids
      • R2t2 Mars Mission
    • Graduate Programs in Robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for Girls
    • Master students
    • Young Researchers
    • Building Equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Master Students Exchange Program
    • PhD/Postdoc exchange program
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • Women keynote speakers
    • Best Paper Award
    • Ukrainian researchers
  • Outreach
    • Swiss Drone Days
    • Cybathlon
    • Swiss Robotics Days
    • Other Outreach Events
  • Contact
Menu
  • About Us
    • Governance
    • Our Team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying Robots
      • Legged robots
      • Collaboration, Learning and Tests
    • Educational robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for Kids
      • R2t2 Mars Mission
    • Graduate Programs in Robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for Girls
    • Master students
    • Young Researchers
    • Building Equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Master Students Exchange Program
    • PhD/Postdoc exchange program
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • Women keynote speakers
    • Best Paper Award
    • Ukrainian researchers
  • Outreach
    • Swiss Drone Days
    • Cybathlon
    • Swiss Robotics Days
    • Other Outreach Events
  • Contact
Search
Close
  • About Us
    • Governance
    • Our team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable Robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying robots
      • Legged robots
      • Collaborations, learning and tests
    • Educational Robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for kids
      • R2t2 Mars mission
    • Graduate programs in robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for girls
    • Master students
    • Young researchers
    • Building equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • PhD/Postdoc Exchange Program
    • Master Students Exchange Program
    • Women Keynote Speakers
    • Best Paper Awards
    • Ukrainian Researchers
  • Outreach
    • Swiss Robotics Days
    • Swiss Drone Days
    • Cybathlon
    • Other Outreach Events
Menu
  • About Us
    • Governance
    • Our team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable Robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying robots
      • Legged robots
      • Collaborations, learning and tests
    • Educational Robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for kids
      • R2t2 Mars mission
    • Graduate programs in robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for girls
    • Master students
    • Young researchers
    • Building equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • PhD/Postdoc Exchange Program
    • Master Students Exchange Program
    • Women Keynote Speakers
    • Best Paper Awards
    • Ukrainian Researchers
  • Outreach
    • Swiss Robotics Days
    • Swiss Drone Days
    • Cybathlon
    • Other Outreach Events

Object Classification Based on Unsupervised Learned Multi-Modal Features For Overcoming Sensor Failures

Publication date:

Authors:

Authors: Nitsch, Julia; Nieto, Juan; Siegwart, Roland; Schmidt, Max; Cadena, Cesar

For autonomous driving applications it is critical to know which type of road users and road side infrastructure are present to plan driving manoeuvres accordingly. Therefore autonomous cars are equipped with different sensor modalities to robustly perceive its environment. However, for classification modules based on machine learning techniques it is challenging to overcome unseen sensor noise. This work presents an object classification module operating on unsupervised learned multi-modal features with the ability to overcome gradual or total sensor failure. A two stage approach composed of an unsupervised feature training and a uni-modal and multimodal classifiers training is presented. We propose a simple but effective decision module switching between uni-modal and multi-modal classifiers based on the closeness in the feature space to the training data. Evaluations on the ModelNet 40 data set show that the proposed approach has a 14% accuracy gain compared to a late fusion approach operating on a noisy point cloud data and a 6% accuracy gain when operating on noisy image data.

Reference

  • Published in: 2019 International Conference on Robotics and Automation (ICRA)
  • DOI: 10.1109/ICRA.2019.8793628
  • Date: 2019
Reference
Read the paper
  • Intranet
  • News
  • Events
  • Contact
Menu
  • Intranet
  • News
  • Events
  • Contact
  • Journalists and media
  • News bulletin archive
  • Newsletter archive
Menu
  • Journalists and media
  • News bulletin archive
  • Newsletter archive
Subscribe to our newsletter
Twitter Linkedin Youtube Instagram Facebook
Partners

Leading house

epfl_white

Co-Leading house

eth_white
unizuerich_white
idsia_white
unibe_all_white
empa-all-white
unibasel_white
SNSF logo

Copyright © 2021 NCCR Robotics. All rights reserved.