Hierarchical attention interpretation: an interpretable speech-level transformer for bi-modal depression detection
Mirrored from arXiv — NLP / Computation & Language for archival readability. Support the source by reading on the original site.
Computer Science > Computation and Language
arXiv:2309.13476 (cs)
This paper has been withdrawn by Qingkun Deng
[Submitted on 23 Sep 2023 (v1), last revised 18 Sep 2026 (this version, v3)]
Title:Hierarchical attention interpretation: an interpretable speech-level transformer for bi-modal depression detection
View a PDF of the paper titled Hierarchical attention interpretation: an interpretable speech-level transformer for bi-modal depression detection, by Qingkun Deng and 2 other authors
No PDF available, click to view other formats
Abstract:Depression is a common mental disorder. Automatic depression detection tools using speech, enabled by machine learning, help early screening of depression. This paper addresses two limitations that may hinder the clinical implementations of such tools: noise resulting from segment-level labelling and a lack of model interpretability. We propose a bi-modal speech-level transformer to avoid segment-level labelling and introduce a hierarchical interpretation approach to provide both speech-level and sentence-level interpretations, based on gradient-weighted attention maps derived from all attention layers to track interactions between input features. We show that the proposed model outperforms a model that learns at a segment level ($p$=0.854, $r$=0.947, $F1$=0.897 compared to $p$=0.732, $r$=0.808, $F1$=0.768). For model interpretation, using one true positive sample, we show which sentences within a given speech are most relevant to depression detection; and which text tokens and Mel-spectrogram regions within these sentences are most relevant to depression detection. These interpretations allow clinicians to verify the validity of predictions made by depression detection tools, promoting their clinical implementations.
| Comments: | This work has been superseded by a later version, submitted as as 'https://arxiv.org/abs/2309.13476', and therefore bears no extra scientific contribution, and should be withdrawn to avoid being cited by the scientific community |
| Subjects: | Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS) |
| ACM classes: | F.2.2; I.2.7 |
| Cite as: | arXiv:2309.13476 [cs.CL] |
| (or arXiv:2309.13476v3 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2309.13476
arXiv-issued DOI via DataCite
|
Submission history
From: Qingkun Deng [view email][v1] Sat, 23 Sep 2023 20:48:58 UTC (2,148 KB)
[v2] Fri, 6 Oct 2023 11:46:11 UTC (2,148 KB)
[v3] Fri, 18 Sep 2026 09:22:06 UTC (1 KB) (withdrawn)
Full-text links:
Access Paper:
- Withdrawn
View a PDF of the paper titled Hierarchical attention interpretation: an interpretable speech-level transformer for bi-modal depression detection, by Qingkun Deng and 2 other authors
No license for this version due to withdrawn
Current browse context:
cs.CL
References & Citations
Loading...
Bookmark
Bibliographic Tools
Code, Data, Media
Demos
Related Papers
About arXivLabs
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
More from arXiv — NLP / Computation & Language
-
A Mechanistic Study of AI-Text Detection Neurons in Frozen BERT: Sparse Probing and Activation Patching on RAID
Sep 28
-
Manifold Projection and Iterative Autoencoder Refinement for Masked Language Modeling
Sep 28
-
Not All Memories Are Equal: Hierarchical Collaborative Memory for Validity-Aware Retrieval in LLM Agents
Sep 28
-
Auditing and Repairing LLM-as-Judge Failures in a Production Text-to-SQL Pipeline
Sep 28
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.