Deep Recurrent Attention Models for Histopathological Image Analysis

Alexandre Momeni; Marc Thibault; Olivier Gevaert

doi:10.1101/438341

CARVIEW

MOTORHOMES

Select Language

HTTP/2 301 date: Sun, 18 Jan 2026 20:45:27 GMT content-length: 0 location: https://doi.org/10.1101/438341 server: cloudflare vary: Origin expires: Mon, 19 Jan 2026 20:45:27 GMT permissions-policy: interest-cohort=(),browsing-topics=() cf-cache-status: DYNAMIC nel: {"report_to":"cf-nel","success_fraction":0.0,"max_age":604800} strict-transport-security: max-age=31536000; includeSubDomains; preload report-to: {"group":"cf-nel","max_age":604800,"endpoints":[{"url":"https://a.nel.cloudflare.com/report/v4?s=OIsrSEqdNdRSbjlhPFAXNmolXACkw%2FBdSNOzDSBD7eORx1IdythhMJ7cboYnRZ%2FHNJG49BInUbhD7mhcm%2F4d77%2BFgbtlhQ%3D%3D"}]} cf-ray: 9c00efa3e9c8c174-BLR alt-svc: h3=":443"; ma=86400 HTTP/2 302 date: Sun, 18 Jan 2026 20:45:27 GMT content-type: text/html;charset=utf-8 location: https://biorxiv.org/lookup/doi/10.1101/438341 server: cloudflare vary: Origin vary: Accept expires: Sun, 18 Jan 2026 21:11:00 GMT permissions-policy: interest-cohort=(),browsing-topics=() cf-cache-status: DYNAMIC nel: {"report_to":"cf-nel","success_fraction":0.0,"max_age":604800} strict-transport-security: max-age=31536000; includeSubDomains; preload report-to: {"group":"cf-nel","max_age":604800,"endpoints":[{"url":"https://a.nel.cloudflare.com/report/v4?s=aMRA6CxobxzRWri3qaNGW35YRxBHOBG95jS7agS%2FKI%2BISomqSqeNIFMxuITyrviV3Wm1uBHYJi4qLDBYdHlYXH8DVuJk3g%3D%3D"}]} cf-ray: 9c00efa449d9c174-BLR alt-svc: h3=":443"; ma=86400 HTTP/1.1 302 Found Date: Sun, 18 Jan 2026 20:45:27 GMT Content-Type: text/html; charset=iso-8859-1 Transfer-Encoding: chunked Connection: keep-alive server: cloudflare location: https://www.biorxiv.org/lookup/doi/10.1101/438341 cf-cache-status: DYNAMIC Nel: {"report_to":"cf-nel","success_fraction":0.0,"max_age":604800} Report-To: {"group":"cf-nel","max_age":604800,"endpoints":[{"url":"https://a.nel.cloudflare.com/report/v4?s=ot%2FIg%2BRFJIaUnXJ41lP0fdnZ7IZXtAOBowJjXxPGu0dT12U33NWdEQ6kSaFCbtUvl1o522IZ%2F2tyTqX2deuFN17%2FI4tSwAJH1EM0"}]} CF-RAY: 9c00efa4de636470-BOM alt-svc: h3=":443"; ma=86400 HTTP/2 301 date: Sun, 18 Jan 2026 20:45:28 GMT content-type: text/html; charset=UTF-8 location: https://www.biorxiv.org/content/10.1101/438341v1 cf-ray: 9c00efa80dd275e9-BLR x-content-type-options: nosniff x-content-type-options: nosniff x-drupal-cache: MISS expires: Sun, 18 Jan 2026 21:15:28 GMT cache-control: public, max-age=1800 x-varnish-ttl: pragma: no-cache vary: Accept-Encoding x-highwire-sitecode: biorxiv x-highwire-smart-code: biorxiv_production x-varnish: 1895374214 x-varnish-cache: via: 1.1 varnish cf-cache-status: MISS set-cookie: __cf_bm=eFjgAyZpsifYo2GddnwA3EkOzKtCq1C5q6.rOJCId3o-1768769128-1.0.1.1-rxTBTLvTPa64IJvzQEhuWnsG7E_WzOKlr8P_bZCg0MFhT2bDi2Ro6SD2ugCzIJu4qnWxN9WDsWDtJHqU2T1L9oRgYaJIORhIoWZmy4XS0Ck; path=/; expires=Sun, 18-Jan-26 21:15:28 GMT; domain=.www.biorxiv.org; HttpOnly; Secure; SameSite=None server: cloudflare HTTP/2 200 date: Sun, 18 Jan 2026 20:45:29 GMT content-type: text/html; charset=utf-8 content-encoding: gzip x-content-type-options: nosniff x-content-type-options: nosniff x-drupal-cache: MISS expires: Sun, 19 Nov 1978 05:00:00 GMT cache-control: no-cache, must-revalidate set-cookie: SSESS1dd6867f1a1b90340f573dcdef3076bc=H7_q95Co-ZvcftmVLtV67S_3ZIYS4Bl2V2uyiGgJ6Pg; expires=Wed, 11-Feb-2026 00:18:48 GMT; path=/; domain=.biorxiv.org; secure; HttpOnly content-language: en x-frame-options: SAMEORIGIN x-generator: Drupal 7 (https://drupal.org) link: ; rel="canonical",; rel="shortlink" vary: Accept-Encoding x-highwire-sitecode: biorxiv x-highwire-smart-code: biorxiv_production x-varnish: 697501997 age: 0 via: 1.1 varnish x-varnish-ttl: x-varnish-cache: cf-cache-status: DYNAMIC server: cloudflare cf-ray: 9c00efab6f5975e9-BLR Deep Recurrent Attention Models for Histopathological Image Analysis | bioRxiv

Abstract

Histopathology defines the gold standard in oncology. Automatic analysis of pathology images could thus have a significant impact on diagnoses, prognoses and treatment decisions for cancer patients. Recently, convolutional neural networks (CNNs) have shown strong performance in computational histopathology tasks. However, given it remains intractable to process pathology slides in their entirety, CNNs have traditionally performed inference on small individual patches extracted from the image. This often requires a significant amount of computation and can result in ignoring potentially relevant spatial and contextual information. Being able to process larger input patches and locating discriminatory regions more efficiently could help improve both computational and task specific performance. Inspired by the recent success of Deep Recurrent Attention Models (DRAMs) in image recognition tasks, we propose a novel attention-based architecture for classification in histopathology. Similar to CNNs, DRAMs have a degree of translation invariance built-in, but the amount of computation performed can be controlled independently from the input image size. The model is a deep recurrent neural network trained with reinforcement learning to attend to the most relevant areas of large input patches. We evaluate our model on histological and molecular subtype classification tasks for the glioma cohorts of The Cancer Genome Atlas (TCGA). Our results suggest that the DRAM has comparable performance to state-of-the-art CNNs despite only processing a select number of patches.

Footnotes

aamomeni{at}stanford.edu, marcthib{at}stanford.edu, ogevaert{at}stanford.edu

The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.