Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

True nitter support #2696

Closed
foobar546 opened this issue Jun 21, 2022 · 9 comments
Closed

True nitter support #2696

foobar546 opened this issue Jun 21, 2022 · 9 comments

Comments

@foobar546
Copy link

If you pass gallery-dl a nitter URL, it redirects to twitter. Why does it do that? It should download directly from the nitter instance and not do any twitter accesses.

@jadedgnome
Copy link

I think their should be an "option" to download from a nitter instance directly.

@afterdelight
Copy link

I agree

@brsk93
Copy link

brsk93 commented Aug 24, 2022

I agree as well. Personally, I use Nitter instances to get around NSFW content blocking.
Not everyone wants to have a Twitter account, especially if they don't plan to use the site for anything other than scraping content.
Being able to download directly from Nitter would also greatly benefit users' privacy without resorting to proxies or VPNs. You can never be too careful with today's social media hunger for users' data.

@github-userx
Copy link

Good point, agreed. I just used gallery-dl on a Twitter user but got numerous warnings that the nsfw photos require log-in. :-(

@Hrxn
Copy link
Contributor

Hrxn commented Sep 17, 2022

Simply get an account just for scraping, you don't have to give twitter your address or something...

@rautamiekka
Copy link
Contributor

I did exactly that, and Twitter auto-banned me twice in a row right after logging in with gdl (TBF, I used a name like dummyacc), so had to contest the bans each time (I simply asked something simple like "why the ban ?"). At least they've left me alone ever since.

@shinji257
Copy link
Contributor

I'm going to request this as well and probably expand just a little bit.

  • When using a Nitter instance either use it as the primary source of images for a tweet or as a fallback (either works as long as it can grab it)
  • Allow a user to define a nitter instance base domain in the config for those not using the official domain. I built a copy with another nitter instance provided as an option and it was able to handle that as well but it can't grab age restricted tweets because gallery-dl goes through the twitter api to get everything anyways.

@mikf
Copy link
Owner

mikf commented Nov 15, 2022

Commit 6c15375 adds initial support for Nitter instances. Regular Tweets with images and videos work, but it might produce the wrong results for retweets/quotes and anything out of the ordinary.

It supports these six instances by default (should I add more?). It is possible to either prefix a URL with nitter: or add an entry to your config file to have gallery-dl recognize other instances.

        "nitter": {
            "twitter.censors.us": {"root": "https://twitter.censors.us"},
            "nitter.ca":          {"root": "https://nitter.ca"}
        }

@jadedgnome
Copy link

jadedgnome commented Nov 15, 2022

great! will it support filter flags as well?

please add this instance https://nitter.inpt.fr

consider these too.
https://bird.trom.tf
https://birdsite.xanny.family
https://canada.unofficialbird.com
https://fuckthesacklers.network
https://india.unofficialbird.com
https://n.l5.ca
https://n.ramle.be
https://nederland.unofficialbird.com
https://nitter.1d4.us
https://nitter.at
https://nitter.bird.froth.zone
https://nitter.bus-hit.me
https://nitter.ca
https://nitter.caioalonso.com
https://nitter.catalyst.sx
https://nitter.cutelab.space
https://nitter.cz
https://nitter.d420.de
https://nitter.dcs0.hu
https://nitter.domain.glass
https://nitter.drivet.xyz
https://nitter.esmailelbob.xyz
https://nitter.fdn.fr
https://nitter.fly.dev
https://nitter.foss.wtf
https://nitter.fprivacy.com
https://nitter.grimneko.de
https://nitter.hu
https://nitter.inpt.fr
https://nitter.ir
https://nitter.it
https://nitter.kavin.rocks
https://nitter.kylrth.com
https://nitter.lacontrevoie.fr
https://nitter.manasiwibi.com
https://nitter.mint.lgbt
https://nitter.moomoo.me
https://nitter.namazso.eu
https://nitter.net
https://nitter.nicfab.eu
https://nitter.nl
https://nitter.poast.org
https://nitter.priv.pw
https://nitter.privacy.com.de
https://nitter.privacydev.net
https://nitter.privacytools.io
https://nitter.projectsegfau.lt
https://nitter.pussthecat.org
https://nitter.pw
https://nitter.qwik.space
https://nitter.rawbit.ninja
https://nitter.sethforprivacy.com
https://nitter.slipfox.xyz
https://nitter.smnz.de
https://nitter.sneed.network
https://nitter.soopy.moe
https://nitter.spaceint.fr
https://nitter.tiekoetter.com
https://nitter.tokhmi.xyz
https://nitter.twei.space
https://nitter.unixfox.eu
https://nitter.weiler.rocks
https://nitter.winscloud.net
https://nitter:[email protected]
https://nittereu.moomoo.me
https://notabird.site
https://nt.vern.cc
https://ntr.odyssey346.dev
https://nttr.stream

@mikf mikf closed this as completed Nov 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants