Search
Close this search box.
  • About Us
    • Governance
    • Our Team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying Robots
      • Legged robots
      • Collaboration, Learning and Tests
    • Educational robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for Kids
      • R2t2 Mars Mission
    • Graduate Programs in Robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for Girls
    • Master students
    • Young Researchers
    • Building Equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Master Students Exchange Program
    • PhD/Postdoc exchange program
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • Women keynote speakers
    • Best Paper Award
    • Ukrainian researchers
  • Outreach
    • Swiss Drone Days
    • Cybathlon
    • Swiss Robotics Days
    • Other Outreach Events
  • Contact
Menu
  • About Us
    • Governance
    • Our Team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying Robots
      • Legged robots
      • Collaboration, Learning and Tests
    • Educational robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for Kids
      • R2t2 Mars Mission
    • Graduate Programs in Robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for Girls
    • Master students
    • Young Researchers
    • Building Equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Master Students Exchange Program
    • PhD/Postdoc exchange program
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • Women keynote speakers
    • Best Paper Award
    • Ukrainian researchers
  • Outreach
    • Swiss Drone Days
    • Cybathlon
    • Swiss Robotics Days
    • Other Outreach Events
  • Contact
Search
Close this search box.
  • NCCR Robotics
    • Highlights
    • Governance
    • Our team
    • Labs
    • Past programs
    • Alumni
    • Open positions in robotics
  • Research
    • Wearable Robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying robots
      • Legged robots
      • Collaborations, learning and tests
    • Educational Robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
    • Research resources
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for kids
      • R2t2 Mars mission
    • Graduate programs in robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Building equality
    • Women in Robotics
    • Resources
  • Outreach
    • Swiss Robotics Days
    • Swiss Drone Days
    • Cybathlon
    • Photo exhibit
    • Other Outreach Events
Menu
  • NCCR Robotics
    • Highlights
    • Governance
    • Our team
    • Labs
    • Past programs
    • Alumni
    • Open positions in robotics
  • Research
    • Wearable Robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying robots
      • Legged robots
      • Collaborations, learning and tests
    • Educational Robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
    • Research resources
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for kids
      • R2t2 Mars mission
    • Graduate programs in robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Building equality
    • Women in Robotics
    • Resources
  • Outreach
    • Swiss Robotics Days
    • Swiss Drone Days
    • Cybathlon
    • Photo exhibit
    • Other Outreach Events

DDD20 End-to-End Event Camera Driving Dataset: Fusing Frames and Events with Deep Learning for Improved Steering Prediction

Publication date:

Authors:

Yuhuang Hu
Jonathan Binas
Daniel Neil
Shih-Chii Liu
Tobi Delbruck
Abstract

Neuromorphic event cameras are useful for dynamic vision problems under difficult lighting conditions. To enable studies of using event cameras in automobile driving applications, this paper reports a new end-to-end driving dataset called DDD20. The dataset was captured with a DAVIS camera that concurrently streams both dynamic vision sensor (DVS) brightness change events and active pixel sensor (APS) intensity frames. DDD20 is the longest event camera end-to-end driving dataset to date with 51h of DAVIS event+frame camera and vehicle human control data collected from 4000km of highway and urban driving under a variety of lighting conditions. Using DDD20, we report the first study of fusing brightness change events and intensity frame data using a deep learning approach to predict the instantaneous human steering wheel angle. Over all day and night conditions, the explained variance for human steering prediction from a Resnet-32 is significantly better from the fused DVS+APS frames (0.88) than using either DVS (0.67) or APS (0.77) data alone.

Reference

  • Published in: The 23rd IEEE International Conference on Intelligent Transportation Systems (ITSC) Rhodes, Greece.
  • Read paper
  • Video
  • Date: 2020
Reference
Read the paper
  • Innovation Booster Robotics
  • News
  • Past Events
  • Contact
  • Innovation Booster Robotics
  • News
  • Past Events
  • Contact
  • Journalists and media
  • News bulletin archive
  • Newsletter archive
  • Journalists and media
  • News bulletin archive
  • Newsletter archive
Twitter Linkedin Youtube
NCCR Robotics partner institutions

Leading house

epfl_white

Co-Leading house

eth_white
unizuerich_white
idsia_white
unibe_all_white
empa-all-white
unibasel_white

This website was built by NCCR Robotics and provides useful information on Swiss Robotics. From December 2022, it is no longer updated.

Copyright © 2022 NCCR Robotics. All rights reserved.