idw – Informationsdienst Wissenschaft

Nachrichten, Termine, Experten

Grafik: idw-Logo
Grafik: idw-Logo

idw - Informationsdienst
Wissenschaft

Science Video Project
idw-Abo

idw-News App:

AppStore

Google Play Store



Instance:
Share on: 
03/19/2020 14:15

This Drone Can Play Dodgeball – And Win

Melanie Nyfeler Kommunikation
Universität Zürich

    Using a novel type of cameras, researchers from the University of Zurich have demonstrated a flying robot that can detect and avoid fast-moving objects. A step towards drones that can fly faster in harsh environments, accomplishing more in less time.

    Drones can do many things, but avoiding obstacles is not their strongest suit yet – especially when they move quickly. Although many flying robots are equipped with cameras that can detect obstacles, it typically takes from 20 to 40 milliseconds for the drone to process the image and react. It may seem quick, but it is not enough to avoid a bird or another drone, or even a static obstacle when the drone itself is flying at high speed. This can be a problem when drones are used in unpredictable environments, or when there are many of them flying in the same area.

    Reaction of a few milliseconds

    In order to solve this problem, researchers at the University of Zurich have equipped a quadcopter (a drone with four propellers) with special cameras and algorithms that reduced its reaction time down to a few milliseconds – enough to avoid a ball thrown at it from a short distance. The results, published in the journal Science Robotics, can make drones more effective in situations such as the aftermath of a natural disaster. The work was funded by the Swiss National Science Foundation through the National Center of Competence in Research (NCCR) Robotics.

    “For search and rescue applications, such as after an earthquake, time is very critical, so we need drones that can navigate as fast as possible in order to accomplish more within their limited battery life” explains Davide Scaramuzza, who leads the Robotics and Perception Group at the University of Zurich as well as the NCCR Robotics Search and Rescue Grand Challenge. “However, by navigating fast drones are also more exposed to the risk of colliding with obstacles, and even more if these are moving. We realised that a novel type of camera, called Event Camera, are a perfect fit for this purpose”.

    Event cameras have smart pixels

    Traditional video cameras, such as the ones found in every smartphone, work by regularly taking snapshots of the whole scene. This is done by exposing the pixels of the image all at the same time. This way, though, a moving object can only be detected after all the pixels have been analysed by the on-board computer. Event cameras, on the other hand, have smart pixels that work independently of each other. The pixels that detect no changes remain silent, while the ones that see a change in light intensity immediately send out the information. This means that only a tiny fraction of the all pixels of the image will need to be processed by the onboard computer, therefore speeding up the computation a lot.

    Event cameras are a recent innovation, and existing object-detection algorithms for drones do not work well with them. So the researchers had to invent their own algorithms that collect all the events recorded by the camera over a very short time, then subtracts the effect of the drone’s own move-ment - which typically account for most of the changes in what the camera sees.

    Only 3.5 milliseconds to detect incoming objects

    Scaramuzza and his team first tested the cameras and algorithms alone. They threw objects of vari-ous shapes and sizes towards the camera, and measured how efficient the algorithm was in detecting them. The success rate varied between 81 and 97 per cent, depending on the size of the object and the distance of the throw, and the system only took 3.5 milliseconds to detect incoming objects.

    Then the most serious test began: putting cameras on an actual drone, flying it both indoor and out-door and throwing objects directly at it. The drone was able to avoid the objects – including a ball thrown from a 3-meter distance and travelling at 10 meters per second – more than 90 per cent of the time. When the drone “knew” the size of the object in advance, one camera was enough. When, in-stead, it had to face objects of varying size, two cameras were used to give it stereoscopic vision.

    According to Scaramuzza, these results show that event cameras can increase the speed at which drones can navigate by up to ten times, thus expanding their possible applications. “One day drones will be used for a large variety of applications, such as delivery of goods, transportation of people, aerial filmography and, of course, search and rescue,” he says. “But enabling robots to perceive and make decision faster can be a game changer for also for other domains where reliably detecting incoming obstacles plays a crucial role, such as automotive, good delivery, transportation, mining, and remote inspection with robots”.

    Nearly as reliable as human pilots
    In the future, the team aims to test this system on an even more agile quadrotor. “Our ultimate goal is to make one day autonomous drones navigate as good as human drone pilots. Currently, in all search and rescue applications where drones are involved, the human is actually in control. If we could have autonomous drones navigate as reliable as human pilots we would then be able to use them for missions that fall beyond line of sight or beyond the reach of the remote control”, says Davide Falanga, the PhD student who is the primary author of the article.

    Literature:
    Davide Falanga, Kevin Kleber, Davide Scaramuzza, “Dynamic Obstacle Avoidance for Quadrotors with Event Cameras”, Science Robotics, March 18, 2020. DOI: 10.1126/scirobotics.aaz9712

    YouTube: https://youtu.be/BzykucxFddI


    Contact for scientific information:

    Prof. Dr. Davide Scaramuzza
    Institute of Informatics
    University of Zurich
    Phone +41 044 635 24 07
    Phone +49 172 662 78 02
    E-mail: sdavide@ifi.uzh.ch


    Original publication:

    Literature:
    Davide Falanga, Kevin Kleber, Davide Scaramuzza, “Dynamic Obstacle Avoidance for Quadrotors with Event Cameras”, Science Robotics, March 18, 2020. DOI: 10.1126/scirobotics.aaz9712


    More information:

    http://YouTube: u.be/BzykucxFddI


    Images

    The drone is able to successfully dodge - even if the ball is approaching it from a distance of three meters at 10 m/s.
    The drone is able to successfully dodge - even if the ball is approaching it from a distance of thre ...
    (Image: UZH)
    None

    The camera captures the approaching ball.
    The camera captures the approaching ball.
    (Image: UZH)
    None


    Criteria of this press release:
    Journalists
    Electrical engineering, Information technology, Traffic / transport
    transregional, national
    Research results, Transfer of Science or Research
    English


     

    Help

    Search / advanced search of the idw archives
    Combination of search terms

    You can combine search terms with and, or and/or not, e.g. Philo not logy.

    Brackets

    You can use brackets to separate combinations from each other, e.g. (Philo not logy) or (Psycho and logy).

    Phrases

    Coherent groups of words will be located as complete phrases if you put them into quotation marks, e.g. “Federal Republic of Germany”.

    Selection criteria

    You can also use the advanced search without entering search terms. It will then follow the criteria you have selected (e.g. country or subject area).

    If you have not selected any criteria in a given category, the entire category will be searched (e.g. all subject areas or all countries).