Skip to main content

POST-TRAINED LANGUAGE MODEL ADAPTIVE TO EXTRACTIVE SUMMARIZATION OF LONG SPOKEN DOCUMENTS

Hyunjong Ok (Kyung Hee University); Seong-Bae Park (Kyung Hee University)

  • SPS
    Members: Free
    IEEE Members: $11.00
    Non-members: $15.00
10 Jun 2023

The General Meeting Understanding and Generation Challenge challenge track 2 in ICASSP 2023 Signal Processing Grand Challenge aims at extractive summarization of meeting transcripts. The main characteristic of this challenge is abridged as long spoken documents that are extremely difficult to manipulate with pre-trained language models. In this paper, we propose a post-trained DeBERTA which does not only adapt to spoken language but also manages long documents. According to the experimental results, the proposed method shows a 6% higher test score than the challenge baseline model.

More Like This

  • SPS
    Members: Free
    IEEE Members: $11.00
    Non-members: $15.00
  • SPS
    Members: Free
    IEEE Members: $11.00
    Non-members: $15.00