Search
Close
  • About Us
    • Governance
    • Our Team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying Robots
      • Legged robots
      • Collaboration, Learning and Tests
    • Educational robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for Kids
      • R2t2 Mars Mission
    • Graduate Programs in Robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for Girls
    • Master students
    • Young Researchers
    • Building Equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Master Students Exchange Program
    • PhD/Postdoc exchange program
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • Women keynote speakers
    • Best Paper Award
    • Ukrainian researchers
  • Outreach
    • Swiss Drone Days
    • Cybathlon
    • Swiss Robotics Days
    • Other Outreach Events
  • Contact
Menu
  • About Us
    • Governance
    • Our Team
    • Labs
    • Open positions
    • Alumni
  • Research
    • Wearable robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying Robots
      • Legged robots
      • Collaboration, Learning and Tests
    • Educational robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for Kids
      • R2t2 Mars Mission
    • Graduate Programs in Robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Robotics for Girls
    • Master students
    • Young Researchers
    • Building Equality
    • Women in Robotics
    • Resources
  • Awards & Programs
    • Spin-Fund
    • Master Students Exchange Program
    • PhD/Postdoc exchange program
    • Award for Career Development
    • Swiss Robotics Masters Award
    • Award for Scientific Visibility
    • Women keynote speakers
    • Best Paper Award
    • Ukrainian researchers
  • Outreach
    • Swiss Drone Days
    • Cybathlon
    • Swiss Robotics Days
    • Other Outreach Events
  • Contact
Search
Close
  • NCCR Robotics
    • Highlights
    • Governance
    • Our team
    • Labs
    • Past programs
    • Alumni
    • Open positions in robotics
  • Research
    • Wearable Robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying robots
      • Legged robots
      • Collaborations, learning and tests
    • Educational Robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
    • Research resources
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for kids
      • R2t2 Mars mission
    • Graduate programs in robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Building equality
    • Women in Robotics
    • Resources
  • Outreach
    • Swiss Robotics Days
    • Swiss Drone Days
    • Cybathlon
    • Photo exhibit
    • Other Outreach Events
Menu
  • NCCR Robotics
    • Highlights
    • Governance
    • Our team
    • Labs
    • Past programs
    • Alumni
    • Open positions in robotics
  • Research
    • Wearable Robotics
      • ReGait++
      • Third Arm
    • Rescue Robotics
      • Flying robots
      • Legged robots
      • Collaborations, learning and tests
    • Educational Robotics
      • Cellulo
      • Thymio
    • Publications
    • Open Science
    • Research resources
  • Education
    • How to get into robotics
      • How our professors got into robotics
      • How our researchers got started
    • Robotics for kids
      • Activities for kids
      • R2t2 Mars mission
    • Graduate programs in robotics
    • Resources
  • Tech Transfer
    • Researchers expertise
    • Spin-Offs
    • Swiss Robotics Day
    • Swiss Robotics Ecosystem
    • Resources
  • Equal Opportunities
    • Building equality
    • Women in Robotics
    • Resources
  • Outreach
    • Swiss Robotics Days
    • Swiss Drone Days
    • Cybathlon
    • Photo exhibit
    • Other Outreach Events

Human-Piloted Drone Racing: Visual Processing and Control

Publication date:

  • 08 March 2021

Authors:

Christian Pfeiffer
Davide Scaramuzza

Abstract:

Humans race drones faster than algorithms, despite being limited to a fixed camera angle, body rate control, and response latencies in the order of hundreds of milliseconds. A better understanding of the ability of human pilots of selecting appropriate motor commands from highly dynamic visual information may provide key insights for solving current challenges in vision-based autonomous navigation. This work investigates the relationship between human eye movements, control behavior, and flight performance in a drone racing task. We collected a multimodal dataset from 21 experienced drone pilots using a highly realistic drone racing simulator, also used to recruit professional pilots. Our results show task-specific improvements in drone racing performance over time. In particular, we found that eye gaze tracks future waypoints (i.e., gates), with first fixations occurring on average 1.5 seconds and 16 meters before reaching the gate. Moreover, human pilots consistently looked at the inside of the future flight path for lateral (i.e., left and right turns) and vertical maneuvers (i.e., ascending and descending). Finally, we found a strong correlation between pilots’ eye movements and the commanded direction of quadrotor flight, with an average visual-motor response latency of 220 ms. These results highlight the importance of coordinated eye movements in human-piloted drone racing. We make our dataset publicly available.
Reference
Doi: 10.1109/LRA.2021.3064282
Published in: IEEE Robotics and Automation Letters ,
 Volume 6,
 Issue 2,
 Pages 3467 – 3474
Read the paper
Version: Published
Access: Open Access
Download
  • Innovation Booster Robotics
  • News
  • Past Events
  • Contact
  • Innovation Booster Robotics
  • News
  • Past Events
  • Contact
  • Journalists and media
  • News bulletin archive
  • Newsletter archive
  • Journalists and media
  • News bulletin archive
  • Newsletter archive
Twitter Linkedin Youtube
NCCR Robotics partner institutions

Leading house

epfl_white

Co-Leading house

eth_white
unizuerich_white
idsia_white
unibe_all_white
empa-all-white
unibasel_white

This website was built by NCCR Robotics and provides useful information on Swiss Robotics. From December 2022, it is no longer updated.

Copyright © 2022 NCCR Robotics. All rights reserved.