HyperAIHyperAI

Command Palette

Search for a command to run...

HyperE2VID: Improving Event-Based Video Reconstruction via Hypernetworks

Burak Ercan Onur Eker Canberk Saglam Aykut Erdem, Senior Member, IEEE Erkut Erdem, Senior Member, IEEE

Abstract

Event-based cameras are becoming increasingly popular for their ability tocapture high-speed motion with low latency and high dynamic range. However,generating videos from events remains challenging due to the highly sparse andvarying nature of event data. To address this, in this study, we proposeHyperE2VID, a dynamic neural network architecture for event-based videoreconstruction. Our approach uses hypernetworks to generate per-pixel adaptivefilters guided by a context fusion module that combines information from eventvoxel grids and previously reconstructed intensity images. We also employ acurriculum learning strategy to train the network more robustly. Ourcomprehensive experimental evaluations across various benchmark datasets revealthat HyperE2VID not only surpasses current state-of-the-art methods in terms ofreconstruction quality but also achieves this with fewer parameters, reducedcomputational requirements, and accelerated inference times.


Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp