AhmadIbrahiim /Website-downloader
💡 Download the complete source code of any website (including all assets). [ Javascripts, Stylesheets, Images ] using Node.js
★ 6,130⑂ 1,411👁 45⑃ 49● 54▤ 0
+6
Daily
6,130
stars
1,411
forks
45
watchers
49
prs
54
issues
0
releases
README
Complete Website Downloader 💾 Download the complete source code of any website (including all assets) 🔨. 👉 Live Demo: https://website-downloader.onrender.com !enter image description here !CodeFactor Description 📒 Website downloader works with wget and archiver to download all websites assets and compress then sends it back to the user through socket channel wget params the being used wget --mirror --convert-links --adjust-extension --page-requisites --no-parent http://example.org Explanation of the various flags: - --mirror – Makes (among other things) the download recursive. - --convert-links – convert all the links (also to stuff like CSS stylesheets) to relative, so it will be suitable for offline viewing. - --adjust-extension – Adds suitable extensions to filenames (html or css) depending on their content-type. - --page-requisites – Download things like CSS style-sheets and images required to properly display the page offline. - --no-parent – When recursing do not ascend to the parent directory. It useful for restricting the download to only a portion of the site Deploy on cloud providers Requirements 📦 - Node.js 16 or newer - wget on the PATH. The app shells out to it, and nothing will download without it: - Debian/Ubuntu: apt install wget - macOS: brew install wget - Windows: winget install JernejSimoncic.Wget How to run it 🤔 - git clone https://github.com/AhmadIbrahiim/Website-downloader.git - cd Website-downloader - $ npm install - $ npm start - http://localhost:3000/ Optional settings | Variable | Default | What it does | | --- | --- | --- | | PORT | 3000 | Port the server listens on | | DOWNLOAD_QUOTA | 100m | Size ceiling passed to wget, so one request cannot fill the disk | | DOWNLOAD_TIMEOUT_MS | 300000 | How long a single download may run before it is stopped | How To Contribute: - Open Issue(s) with any bugs you notice. - Please create Pull Requests if you think it would be an added value towards our program. Liked it ? You can buy a coffee: Thank you, Email: [email protected] https://www.ahmed-ibrahim.com
Top issues
#75Website not working3 comments · 2024-06-23#69Web is down (again)3 comments · 2023-10-11#60404 Not Found on form submission3 comments · 2023-05-06#87Website shows "Service has been suspended"2 comments · 2024-11-14#112Service suspended1 comments · 2026-11-12#63Collapsible Menu not working1 comments · 2023-07-02#108kiran mirge0 comments · 2026-08-26#105Downloader always shows 0 files and "Compressing completed successfully !" for every URL and also the webiste doensot works0 comments · 2026-08-07