HyperAIHyperAI

Command Palette

Search for a command to run...

Few-Shot Classification of Interactive Activities of Daily Living (InteractADL)

Durante Zane ; Harries Robathan ; Vendrow Edward ; Luo Zelun ; Kyuragi Yuta ; Kozuka Kazuki ; Fei-Fei Li ; Adeli Ehsan

Abstract

Understanding Activities of Daily Living (ADLs) is a crucial step fordifferent applications including assistive robots, smart homes, and healthcare.However, to date, few benchmarks and methods have focused on complex ADLs,especially those involving multi-person interactions in home environments. Inthis paper, we propose a new dataset and benchmark, InteractADL, forunderstanding complex ADLs that involve interaction between humans (andobjects). Furthermore, complex ADLs occurring in home environments comprise achallenging long-tailed distribution due to the rarity of multi-personinteractions, and pose fine-grained visual recognition tasks due to thepresence of semantically and visually similar classes. To address these issues,we propose a novel method for fine-grained few-shot video classification calledName Tuning that enables greater semantic separability by learning optimalclass name vectors. We show that Name Tuning can be combined with existingprompt tuning strategies to learn the entire input text (rather than onlylearning the prompt or class names) and demonstrate improved performance forfew-shot classification on InteractADL and 4 other fine-grained visualclassification benchmarks. For transparency and reproducibility, we release ourcode at https://github.com/zanedurante/vlm_benchmark.


Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing

HyperAI Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp