For years I’ve on and off looked for web archiving software that can capture most sites, including ones that are “complex” with lots of AJAX and require logins like Reddit. Which ones have worked best for you?

Ideally I want one that can be started up programatically or via command line, an opens a chromium instance (or any browser), and captures everything shown on the page. I could also open the instance myself and log into sites and install addons like UBlock Origin. (btw, archiveweb.page must be started manually).

  • Xanza@lemm.ee
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 days ago

    That’s not a bug. You literally told wget to follow links, so it did.

      • Xanza@lemm.ee
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 day ago

        There is. wget doesn’t follow recursive links by default. If it is, you’re using an option which is telling it to…