| CARVIEW |
Select Language
HTTP/2 200
date: Wed, 23 Jul 2025 14:51:43 GMT
content-type: text/html; charset=utf-8
cache-control: max-age=0, private, must-revalidate
content-security-policy: default-src 'none'; base-uri 'self'; child-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/; connect-src 'self' uploads.github.com www.githubstatus.com collector.github.com raw.githubusercontent.com api.github.com github-cloud.s3.amazonaws.com github-production-repository-file-5c1aeb.s3.amazonaws.com github-production-upload-manifest-file-7fdce7.s3.amazonaws.com github-production-user-asset-6210df.s3.amazonaws.com *.rel.tunnels.api.visualstudio.com wss://*.rel.tunnels.api.visualstudio.com objects-origin.githubusercontent.com copilot-proxy.githubusercontent.com proxy.individual.githubcopilot.com proxy.business.githubcopilot.com proxy.enterprise.githubcopilot.com *.actions.githubusercontent.com wss://*.actions.githubusercontent.com productionresultssa0.blob.core.windows.net/ productionresultssa1.blob.core.windows.net/ productionresultssa2.blob.core.windows.net/ productionresultssa3.blob.core.windows.net/ productionresultssa4.blob.core.windows.net/ productionresultssa5.blob.core.windows.net/ productionresultssa6.blob.core.windows.net/ productionresultssa7.blob.core.windows.net/ productionresultssa8.blob.core.windows.net/ productionresultssa9.blob.core.windows.net/ productionresultssa10.blob.core.windows.net/ productionresultssa11.blob.core.windows.net/ productionresultssa12.blob.core.windows.net/ productionresultssa13.blob.core.windows.net/ productionresultssa14.blob.core.windows.net/ productionresultssa15.blob.core.windows.net/ productionresultssa16.blob.core.windows.net/ productionresultssa17.blob.core.windows.net/ productionresultssa18.blob.core.windows.net/ productionresultssa19.blob.core.windows.net/ github-production-repository-image-32fea6.s3.amazonaws.com github-production-release-asset-2e65be.s3.amazonaws.com insights.github.com wss://alive.github.com api.githubcopilot.com api.individual.githubcopilot.com api.business.githubcopilot.com api.enterprise.githubcopilot.com; font-src github.githubassets.com; form-action 'self' github.com gist.github.com copilot-workspace.githubnext.com objects-origin.githubusercontent.com; frame-ancestors 'none'; frame-src viewscreen.githubusercontent.com notebooks.githubusercontent.com; img-src 'self' data: blob: github.githubassets.com media.githubusercontent.com camo.githubusercontent.com identicons.github.com avatars.githubusercontent.com private-avatars.githubusercontent.com github-cloud.s3.amazonaws.com objects.githubusercontent.com release-assets.githubusercontent.com secured-user-images.githubusercontent.com/ user-images.githubusercontent.com/ private-user-images.githubusercontent.com opengraph.githubassets.com copilotprodattachments.blob.core.windows.net/github-production-copilot-attachments/ github-production-user-asset-6210df.s3.amazonaws.com customer-stories-feed.github.com spotlights-feed.github.com objects-origin.githubusercontent.com *.githubusercontent.com; manifest-src 'self'; media-src github.com user-images.githubusercontent.com/ secured-user-images.githubusercontent.com/ private-user-images.githubusercontent.com github-production-user-asset-6210df.s3.amazonaws.com gist.github.com; script-src github.githubassets.com; style-src 'unsafe-inline' github.githubassets.com; upgrade-insecure-requests; worker-src github.githubassets.com github.com/assets-cdn/worker/ github.com/assets/ gist.github.com/assets-cdn/worker/
link: ; rel=preload; as=fetch; crossorigin=use-credentials
referrer-policy: no-referrer-when-downgrade
server-timing: issue_layout-fragment;desc="issue_layout fragment";dur=187.934064,issue_conversation_content-fragment;desc="issue_conversation_content fragment";dur=516.568579,issue_conversation_sidebar-fragment;desc="issue_conversation_sidebar fragment";dur=43.603952,nginx;desc="NGINX";dur=1.488241,glb;desc="GLB";dur=100.481237
strict-transport-security: max-age=31536000; includeSubdomains; preload
vary: X-PJAX, X-PJAX-Container, Turbo-Visit, Turbo-Frame, X-Requested-With, Accept,Accept-Encoding, Accept, X-Requested-With
x-content-type-options: nosniff
x-frame-options: deny
x-voltron-version: fd8fbbc
x-xss-protection: 0
server: github.com
content-encoding: gzip
accept-ranges: bytes
set-cookie: _gh_sess=bAtHdDNuhXqOo3I%2B1X4Y8Sb3m2bmJB%2B%2BNte95dJkDMFG41kXEO356z1sPlJN6EbtiWbKlf4NVlDDc%2Fw2coiCFMydQf8p8fTSHaWkmVlI3EIavdjMEDTCDUitQ90l2FxwkLIarriHopJ%2F%2Fym08c4Z6UAZFsXYv0BYWUH75v0QC%2BCTEfyNuNP1v9CrdzzkT2DSzkq3Ck4kDZ8r4bdeoJVD1FFNFzS8rDSqwihsHcFAvCwyIMgtGA%2FEwcqjaktKb%2BOYVnXubRkt2PdzzICrlBztPA%3D%3D--OV7sZvZdg%2FBNpPov--hXkkT%2BaIgfyrhyuXbgQNrQ%3D%3D; Path=/; HttpOnly; Secure; SameSite=Lax
set-cookie: _octo=GH1.1.965872404.1753282302; Path=/; Domain=github.com; Expires=Thu, 23 Jul 2026 14:51:42 GMT; Secure; SameSite=Lax
set-cookie: logged_in=no; Path=/; Domain=github.com; Expires=Thu, 23 Jul 2026 14:51:42 GMT; HttpOnly; Secure; SameSite=Lax
x-github-request-id: B834:3B93B0:D8DE77:1005A72:6880F6FE
New Extractor Idea: `scihub-dl` to auto-detect inline DOI numbers and download academic paper PDFs · Issue #720 · ArchiveBox/ArchiveBox · GitHub
No one assignedNo projectsNone yetNo branches or pull requests
Skip to content
Navigation Menu
{{ message }}
-
-
Notifications
You must be signed in to change notification settings - Fork 1.3k
Open
Open
New Extractor Idea:
scihub-dl to auto-detect inline DOI numbers and download academic paper PDFs#720Enhancement
Copy link
Labels
expected: release after nextsize: mediumstatus: wipWork is in-progress / has already been partially completedWork is in-progress / has already been partially completedtouches: API/CLI/Spectouches: configurationtouches: dependencies/packagingIssues or changes that add/remove/affect dependenciesIssues or changes that add/remove/affect dependenciestouches: docswhy: functionalityIntended to improve ArchiveBox functionality or featuresIntended to improve ArchiveBox functionality or features
Milestone
Description
New extractor idea: SCIHUB
e.g. take this academic paper for example: https://www.cell.com/current-biology/fulltext/S0960-9822(19)31469-1
If a full paper PDF is available on scihub, e.g.: https://sci-hub.se/https://www.cell.com/current-biology/fulltext/S0960-9822(19)31469-1 it could be downloaded to a ./archive/<timestmap>/scihub/ output folder.
# try downloading via verbatim URL first
$ scihub.py -d https://www.cell.com/current-biology/fulltext/S0960-9822(19)31469-1'
DEBUG:Sci-Hub:Successfully downloaded file with identifier https://www.cell.com/current-biology/fulltext/S0960-9822(19)31469-1We could also look for a DOI number in the page URL or page html contents e.g.: 10.1016/j.cub.2019.11.030 using a regex and try downloading that.
# otherwise try downloading via any regex-extracted bare DOI numbers on the page or in the URL
$ scihub.py -d '10.1016/j.cub.2019.11.030'
DEBUG:Sci-Hub:Successfully downloaded file with identifier 10.1016/j.cub.2019.11.030
$ ls
c28dc1242df6f931c29b9cd445a55597-.cub.2019.11.030.pdfNew Dependencies:
New Extractors:
extractors/scihub.py
New Config Options:
SAVE_SCIHUB=True
danisztls, siboehm and ivanmarribasFinkregh and virtadpt
Metadata
Metadata
Assignees
Labels
expected: release after nextsize: mediumstatus: wipWork is in-progress / has already been partially completedWork is in-progress / has already been partially completedtouches: API/CLI/Spectouches: configurationtouches: dependencies/packagingIssues or changes that add/remove/affect dependenciesIssues or changes that add/remove/affect dependenciestouches: docswhy: functionalityIntended to improve ArchiveBox functionality or featuresIntended to improve ArchiveBox functionality or features
Type
Projects
Milestone
Relationships
Development
Issue actions
You can’t perform that action at this time.