Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Enable incremental data export #10497

Open
giomasce opened this issue Mar 7, 2021 · 18 comments
Open

[Feature Request] Enable incremental data export #10497

giomasce opened this issue Mar 7, 2021 · 18 comments

Comments

@giomasce
Copy link

giomasce commented Mar 7, 2021

Is your feature request related to a problem?

I periodically download all my Telegram data on my hard disk to keep a personal archive off-cloud. However, I need to redownload all the data each time, which can take quite some time (I have many videos, images and files on my Telegram account). This also unnecessarily puts stress on Telegram servers, because they have to send again data which I already have.

Describe the solution you'd like

I would like, when I export my Telegram data, to indicate a directory that is populated with the data I got from last export. The Telegram application would check the hashes of the files there and avoid downloading again the files that are already available, saving on time and bandwidth, both for me and for the servers.

Describe alternatives you've considered

For the moment I just download all my data every time, but every time this takes more time and more bandwidth, uselessly.

@AhyaH-YHWH
Copy link

AhyaH-YHWH commented Mar 7, 2021

Shouldn't copying tdata/user_data folder, and meging it with user_data folder, when you login to same Account

make Telegram just use Old downloaded files?
(Telegram Windows)

@stale
Copy link

stale bot commented Sep 3, 2021

Hey there!

This issue was inactive for a long time and will be automatically closed in 30 days if there isn't any further activity. We therefore assume that the user has lost interest or resolved the problem on their own.

Don't worry though; if this is an error, let us know with a comment and we'll be happy to reopen the issue.

Thanks!

@stale stale bot added the stale label Sep 3, 2021
@giomasce
Copy link
Author

giomasce commented Sep 5, 2021

Not lost interest at all!

@stale stale bot removed the stale label Sep 5, 2021
@stale
Copy link

stale bot commented Mar 5, 2022

Hey there!

This issue was inactive for a long time and will be automatically closed in 30 days if there isn't any further activity. We therefore assume that the user has lost interest or resolved the problem on their own.

Don't worry though; if this is an error, let us know with a comment and we'll be happy to reopen the issue.

Thanks!

@stale stale bot added the stale label Mar 5, 2022
@stale stale bot removed the stale label Mar 5, 2022
@giomasce
Copy link
Author

giomasce commented Mar 5, 2022

FTR, the user hasn't lost interest. They will never until the issue is solved.

@kocane
Copy link

kocane commented Apr 17, 2022

Telegram will certainly cease to exist one day, so it would be nice to be able to have our own archive of all our chats, and the data that comes with it.

I still have chat logs from 2005 because MSN Messenger made it so damn easy.

@giomasce
Copy link
Author

Telegram will certainly cease to exist one day, so it would be nice to be able to have our own archive of all our chats, and the data that comes with it.

I still have chat logs from 2005 because MSN Messenger made it so damn easy.

BTW, this is already possible: https://bugs.telegram.org/c/60

@Aokromes
Copy link
Collaborator

Telegram will certainly cease to exist one day, so it would be nice to be able to have our own archive of all our chats, and the data that comes with it.
I still have chat logs from 2005 because MSN Messenger made it so damn easy.

BTW, this is already possible: bugs.telegram.org/c/60

what they are asking for is INCREMENTAL exports, ie, make full export day 1, make export of changed data day 7, day 14, day 21, day 28, etc. (it can be done on hand way, but they want to do on automatic way)

@kocane
Copy link

kocane commented Apr 18, 2022

Telegram will certainly cease to exist one day, so it would be nice to be able to have our own archive of all our chats, and the data that comes with it.

I still have chat logs from 2005 because MSN Messenger made it so damn easy.

BTW, this is already possible: https://bugs.telegram.org/c/60

True but like you said, it's halfway useless to me if it's not at least incremental. Ideally something that could be scheduled.

@SpL1Ne
Copy link

SpL1Ne commented Apr 18, 2022

(it can be done on hand way,

Well technically yes, but actually no.(c)
Even if you want to export chat history for last 7 days, telegram still going through FULL chat history. So basically its useless.

@santanoce
Copy link

+1 for this!
Alternatively, it would be nice to have the possibility to choose specific data ranges to download, like in the "Export chat" feature. It would be great both for us and for the Telegram servers.

@jk-85
Copy link

jk-85 commented Jun 29, 2022

I want this incremental export-feature too! This will save huge amounts of bandwidth!

@VetaLioSTV
Copy link

Agreed, very useful feature!

@Doprintityourself
Copy link

Doprintityourself commented Sep 1, 2023

Since it floods my hard discs with again and again full backups that I cannot combine
please implement the incremental Data export feature soon.
Every backup of huge or old channels does create incredible data traffic and wasted space on hard discs
+1!

@scarlion1
Copy link

@ThatCoffeeGuy
Copy link

Definitely need to see this. Very inefficient that I can only export ALL of my groups and channels without even being able to select a from - to date interval. I'll need to download 250GBs+ from telegram every month. Or do it completely manually, select groups one by one and add a custom date. Either way, it's quite painful..

@ThatCoffeeGuy
Copy link

Any other options around?

@scarlion1
Copy link

@ThatCoffeeGuy I've been using https://github.com/knadh/tg-archive for a bit now and like it.  It connects via API and does incremental sync to a sqlite database which can then be read by various other apps, or use the build function to create a browsable webpage of the collected data.  I don't think it quite captures all the info a JSON export from Telegram does, but I think that could be accomplished by adding the right code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests