Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Streams and BLOB escapes for large databases #14

Open
wants to merge 73 commits into
base: master
Choose a base branch
from
Open

Streams and BLOB escapes for large databases #14

wants to merge 73 commits into from

Conversation

BrandonRoehl
Copy link

  • io.Writer for streams
    • Works with go "compress"
  • Partial writes not stored in memory and stream monitoring
  • Singular Data structure
  • Support unquoted numbers
  • Support BLOB dumps
  • Ability to ignore tables
  • SQL string quoting / sanitation
    • Required for BLOBs and JSON
  • Concurrency in dump
    • Speeds up writing to os.File and stream chains

Linking to #13

@BrandonRoehl
Fork and get a direct stream to modify
57f1b81
@BrandonRoehl
Spring cleaning
c8118b2
@BrandonRoehl
Stream based writer
cd7bc12
@BrandonRoehl
Update to MySQL 8
846720a
@BrandonRoehl
readme update
6112651
@BrandonRoehl
Go concurrency and backticks
47914c6
@BrandonRoehl
Breaking things
011beef
@BrandonRoehl
No need to panic
9a9da92
@BrandonRoehl
0.3.0 for tag
3542d95
@BrandonRoehl
update readme
523f634
@BrandonRoehl
Sanitize and blob values
90fdf91
@BrandonRoehl
Version bump for the blob sanitization
46db301
@BrandonRoehl
Correct escaping
30b13cd
@BrandonRoehl
travis to newer go
f253cf7
@BrandonRoehl
Failing tests on mock
c9037df
@BrandonRoehl
Ability to ignore tables
fd3ebcf
@BrandonRoehl
Update docs
79fd69d
@BrandonRoehl
Remove vscode artifacts
36aed1d
@BrandonRoehl
0.3.3 release for ignoring tables
219da40
@BrandonRoehl
Update docs
53d026e
@BrandonRoehl
Update urls
5671c80
@BrandonRoehl
Missed an upcase
ac1de70
@BrandonRoehl
Collect error from goroutine
530393c
@BrandonRoehl
Clean up comments
06c8b9c
@BrandonRoehl
io.Closer will close any closable connection
c87ced3
@BrandonRoehl
Merge branch 'master' of github.com:jamf/go-mysqldump
fdc6a20
@BrandonRoehl
Data error to return out of execute
87c70ac
@BrandonRoehl
Lock on err
03b8ebd
@BrandonRoehl
Update readme
d5d8630
@BrandonRoehl BrandonRoehl mentioned this pull request Jan 31, 2019
Closed
@alikuru
Copy link

alikuru commented Jun 10, 2019

As far as I can tell from discussions on preceding PR requests, this will also fix #9. Seems like it has been quite some time since this PR is discussed; any ETA on its merge?

Couldn't find any other project that doesn't use mysqldump for backup, would love to see this project moving forward.

@BrandonRoehl
Copy link
Author

There is now an improved version from even this here at jamf/go-mysqldump

Greg0 and others added 21 commits June 26, 2019 23:07
@Greg0
Update README.md
c2fe4af
@BrandonRoehl
Merge pull request JamesStewy#4 from Greg0/patch-1
3ee6198 
Update README.md
@BrandonRoehl
Add the ability to lock all tables
53765f2
@BrandonRoehl
Merge branch 'master' into lock-tables-first
19bd136
@BrandonRoehl
Bump the version number
89292d2
@BrandonRoehl
Starting to transaction wrap
f00cfb1
@BrandonRoehl
Have all statments run on the same transaction
fdb7b50
@BrandonRoehl
There is no locking by default just a read transaction
4517c0a
@BrandonRoehl
Change the version down
adf372a
@BrandonRoehl
Convert to go mod
ca1be9d
@BrandonRoehl
Update comments and pointers
55278b1
@BrandonRoehl
Fix the comment
cfdd697
@BrandonRoehl
Merge pull request JamesStewy#5 from BrandonRoehl/lock-tables-first
cd198d0 
Add the ability to lock all tables
@BrandonRoehl
Merge branch 'master' into single-transaction
ecd436b
@BrandonRoehl
Consolidate the for loops
d725434
@BrandonRoehl
Merge branch 'single-transaction' of github.com:BrandonRoehl/go-mysql…
5c7d255 
…dump into single-transaction
@BrandonRoehl
Merge pull request JamesStewy#6 from BrandonRoehl/single-transaction
f25e26f 
Single transaction
@BrandonRoehl
Don't need to store the reflection type
b6b4ed7
@BrandonRoehl
Don't need to store the reflection type
f5bcf36
@BrandonRoehl
Don't need DEP
4f247b0
@BrandonRoehl
Merge pull request JamesStewy#7 from BrandonRoehl/dont-need-to-store-…
38ef509 
…the-reflection-type

Dont need to store the reflection type
@joseluisq
Copy link

joseluisq commented Jan 9, 2020 •
edited
Loading

Any updates on this? Looks like the project is a little asleep.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@JamesStewy JamesStewy JamesStewy left review comments

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@BrandonRoehl @JamesStewy @alikuru @joseluisq @Greg0