HalluAudio: Hallucinate frequency as concepts for few-shot audio classification
Zhongjie Yu (Wyze Labs, Inc.); Shuyang Wang (Shiseido Americas); Lin Chen (Wyze Labs Inc.); Zhongwei Cheng (Wyze Labs, Inc.)
-
SPS
IEEE Members: $11.00
Non-members: $15.00
Few-shot audio classification is an emerging topic that attracts more and more attention from the research community, while most existing work ignores the specificity of the form of the audio spectrogram and focuses largely on the embedding space, borrowed from image tasks. In this work, we aim to take advantage of this special audio format and propose a new method by hallucinating high-frequency and low-frequency parts as structured concepts. Extensive experiments on ESC-50 and our curated balanced Kaggle18 dataset show the proposed method outperforms the baseline by a notable margin. The way that our method hallucinates high-frequency and low-frequency parts also enables its interpretability and opens up new potentials for the few-shot audio classification.