HyperAIHyperAI

Command Palette

Search for a command to run...

Reducing the Sim-to-Real Gap for Event Cameras

Timo Stoffregen Cedric Scheerlinck Davide Scaramuzza Tom Drummond Nick Barnes Lindsay Kleeman Robert Mahony

Abstract

Event cameras are paradigm-shifting novel sensors that report asynchronous,per-pixel brightness changes called 'events' with unparalleled low latency.This makes them ideal for high speed, high dynamic range scenes whereconventional cameras would fail. Recent work has demonstrated impressiveresults using Convolutional Neural Networks (CNNs) for video reconstruction andoptic flow with events. We present strategies for improving training data forevent based CNNs that result in 20-40% boost in performance of existingstate-of-the-art (SOTA) video reconstruction networks retrained with ourmethod, and up to 15% for optic flow networks. A challenge in evaluating eventbased video reconstruction is lack of quality ground truth images in existingdatasets. To address this, we present a new High Quality Frames (HQF) dataset,containing events and ground truth frames from a DAVIS240C that arewell-exposed and minimally motion-blurred. We evaluate our method on HQF +several existing major event camera datasets.


Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp