Slack database migration #332
Comments
|
we are glad to hear that you loved our app :D this migration makes sense but we haven't thought about it before. maybe when we get closer to 1.0 we should do it |
|
Awesome, thanks ! :D |
|
I guess this should be available with the slack-like API (#202) . Maybe it could be added to the v1.1 milestone as well. |
marceloschmidt
added
Feature: Request
|
This would be the best thing ever! I would really like to migrate all the information from my Slack team to Rocket.Chat |
|
btw, @graywolf336 was working on importing slack data, but I dont how it is going. |
|
Yes, currently working on and off with @geekgonecrazy to get the import framework complete and then finish the slack import. |
|
That's great news! I can't wait to test it! 😄 |
|
I've made some good progress, but need opinions. Currently when you upload the exported file (zip) it returns back the users and channels you had in Slack. It contains the deleted users along with the archived channels. My test export has 22 users and 28 channels, a small amount compared to other organizations I've heard about. I want to present a list of users and a list of channels then allow the person doing the importing to select which ones they want, but, and I am asking for opinions, I am unsure how to efficiently do this if the import data has a ton of users and channels. Should it just be a checklist with a |
|
@RocketChat/owners thoughts / feedback on this ? ^ |
|
Oh well, it really could be a pain when you have so much things to import. did you have import data to a temp collection after uploading the zip file? if so, it could be simple to create a page showing fewer results per page and setting a flag on that row on db.. |
|
A nice big button at the top that says "Just Import it All!" 😝 No they're not in a temporary collection or anything, just in memory but could easily be converted over or could be paged with how they're stored for now (nothing is final, just the beginnings). |
|
@graywolf336: I'd love to get my team trialling Rocket.Chat for business usage, is there any way I can give a hand? |
|
@liamdawson: Message me on Rocket.Chat demo server and we can discuss details 😄 |
|
Just a status update, I've got channels, users, and messages importing. Currently working on the special message types and importing files.
|
|
👍 this is awesome! |
|
@graywolf336 you are awesome!!!! |
|
Things left to do:
This sounds strange, but I am looking for someone with a rather large Slack export so that I can test with and verify it doesn't crash majorly when the exported zip file is larger than 1,627KB. |
|
@graywolf336 I've added your list to the issue description as a checklist. |
|
@engelgabriel Sounds good, I'll let you know when I complete the items since I can't check them off myself. If you happen to come across a community or someone interested, have them contact me so we can test it with other Slack exports besides mine...especially larger sized ones. |
|
@graywolf336 I've got a large-ish Slack export (about 8.5MB) that I could try out a Rocket.Chat import on if you're interested. |
|
@jimlawton I am extremely interested in that, as that's a great deal larger than mine. There's two options we can test with. First one is you clone the project where the code is and run it there then let me know if you have any issues. Second one would be to send me the file so I can test and have a first hands experience with the import along with any errors that occur so I can fix them. |
|
Unfortunately, I can't share the archive. I'm building the import-framework |
|
@jimlawton Did you manage to get it going? Any errors? Suggestions? |
|
I'm afraid I haven't had much time today. I cloned it and built it and ran On 13 November 2015 at 14:23, Bradley Hilton [email protected]
|
|
Not quite. Instead of letting Rocket.Chat create a new id for each message's record, we set the id to Slack's. Does that make more sense? |
|
Oh yes, of course! Sounds good. Thanks :) |
|
@patcon Shouldn't be too hard of a change to make, feel free to make a pull request for it and I will take a look at it! :) |
|
Ah wait. Seems there's not exactly an uid, but a timestamp ( |
|
Maybe just append a S to the front of the Slack Id so it will be always evaluated as STRING when using it. |
|
@patcon Yes, that is correct. The |
|
@engelgabriel wait what?! Full history or just messages not hit by the 10k message limit? Isn't that only for corporate accounts and not the free version?
|
|
OK, but the message id doesn't seem to be per-channel, but per-channel-month or something. So for our #general chat, it seems to reset every month on the 24th for January... EDIT: And the 28th for Dec. seems inconsistent. Curious whether it's the same in between exports. I'll check |
|
@patcon Should still be unique due to the timestamp if you do @mrplow I believe he meant you can't export private channels or direct messages from Slack. The only thing which gets exported in Slack is the public channels and messages, including those beyond the 10K limit on free accounts. |
|
@graywolf336 sorry, you're right. And I've confirmed that there don't seem to be any wonky changes in those id's between exports |
|
@patcon Awesome! 👍 This will be a neat change to have and very welcomed! |
|
From https://slack.com/privacy-policy
|
|
@engelgabriel Ah so that's changed since I last saw. If we can get our hands on an export which contains the private groups and direct messages, that would be great. But as it stands right now, the exports which contain those aren't supported and might even fail or would ignore the private groups and private messages. |
|
Looks like you can use the slack api to pull json data of private history |
|
Correct and that's totally possible but right now the importer doesn't use On Wed, Feb 17, 2016, 2:52 PM mrplow [email protected] wrote:
|
|
Hey @graywolf336, can you think of any reason why this sanitization couldn't go into |
|
@patcon The only reason I see that being an issue is that |
|
FYI should warn about memory overload ! just crashed my server trying to import the files. |
|
What is the spec of your server? |
|
1Gb RAM, I guess that is bearly enought for rocketchat to start with. |
|
How big is your slack export? |
|
100mb about |
|
Dear |
|
@skiseiju No, the Slack importer expects the entire Slack export and currently doesn't support private groups as we haven't had any export with private groups. |
|
@graywolf336 I'm trying to import a Slack data export zip and it says "the file uploaded isn't a valid slack export file." |
|
@doctorwho92 can you please open this as another issue, because this issue is already closed and we will forget to track it. |
* Smarti-203: Flag widget messages * Smarti-203: Rename widget message flag to skipAnalysis * Smarti-52: Add support for edited messages * redlink-gmbh/smarti#221: Set room topic as support area for conversation * Revert "redlink-gmbh/smarti#221: Set room topic as support area for conversation" This reverts commit c7966a3. * redlink-gmbh/smarti#225: Fix widget footer styling * redlink-gmbh/smarti#220: Improve error handling * SmartiWidgetBackend: Improve error handling
Hi, I just discovered RocketChat and I already love it! Keep it up!
As RocketChat claims itself as a Slack-like app, I think it would be great to let the admins to migrate theirs own Slack database (channels, user infos, etc) via the Slack export tool. The export is a bunch of JSON file ready to be used.
This would encourage people to use RocketChat instead of Slack, even if they've been using Slack before.
Thanks !
Items Left to Be Done:
**
Not Importing Right Now**Messages about file comments (file_comment)Messages about integrations being added to channels (bot_add)Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.
The text was updated successfully, but these errors were encountered: