Wallhaven synchronization app (with disk files)

Posts: 4 · Views: 143
  • 10549

    Hi, so i made this small scraping application over the weekend where you can download or update changes in your fav folders on wallhaven ; ) You can select favourite folder and download it whole, or whatever is new there.

    I thought i would share since it's a life time saver for me.

    --updated--02.2017 [url]https://www.dropbox.com/s/c8y3wwjwxkgfvqg/Wallhaven%20Sync%2020170207.7z?dl=0[/url] [url]https://github.com/softhairspring/Wallhaven-Sync[/url]

    It should be server friendly, and currently will crash if you'll mess up your login info xD

    Last updated
  • 10559

    Heh, I have 250 lines of Python for that.

    Please use it responsibly! Large-scale scraping has a noticeable impact on our server, if you overdo it we will have to ban your IP.

    SoftHairspring Since you're trying to be nice to our server (appreciate the

    Thread.sleep

    ) you could check about using XMLHttpRequest headers for multi-page listings. It's probably not a big difference but we have to do a little less template rendering for ajax'd pages. You might also want to use

    "//ul[class='pagination']/Data-pagination"

    to get JSON formatted pagination information, which is probably a bit easier and more reliable than parsing

    .thumb-listing-page-header

    since our HTML is always subject to change.

    Last updated
  • 10562

    Nice work, dude! Thanks for this!

Message