Skip to content

fix(deps): update dependencies on badger + ristretto #8365

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Nov 4, 2022

Conversation

joshua-goldstein
Copy link
Contributor

@joshua-goldstein joshua-goldstein commented Oct 16, 2022

Problem

Dgraph currently uses Ristretto v0.1.0 and Badger v3.2103.1. We encounter certain issues on arm64 machines that were patched in Ristretto v0.1.1 and Badger v3.2103.3. Badger v3.2103.4 also fixes a potential manifest corruption issue.

Solution

We bump up the dependencies.

> go get github.com/dgraph-io/[email protected]
go: upgraded github.com/dgraph-io/ristretto v0.1.0 => v0.1.1
go: upgraded golang.org/x/sys v0.0.0-20220728004956-3c1f35247d10 => v0.0.0-20221010170243-090e33056c14
> go get github.com/dgraph-io/badger/[email protected]
go: downloading github.com/dgraph-io/badger/v3 v3.2103.4
go: module github.com/golang/protobuf is deprecated: Use the "google.golang.org/protobuf" module instead.
go: upgraded github.com/dgraph-io/badger/v3 v3.2103.1 => v3.2103.4
> go mod tidy                                    

Remark

Changelog of Badger v3.2103.1 to v3.2103.2
Changelog of Badger v3.2103.2 to v3.2103.3
Changelog of Badger v3.2103.2 to v3.2103.4
Changelog of Ristretto v0.1.0 to v0.1.1

@skrdgraph
Copy link
Contributor

@joshua-goldstein lets wait for 24hrs before getting this in ... this looks okay to merge.

@coveralls
Copy link

coveralls commented Oct 17, 2022

Coverage Status

Coverage remained the same at 37.18% when pulling bfffff9 on joshua/update-badger-ristretto into c04ce80 on main.

@skrdgraph
Copy link
Contributor

Pushing this out to next release (marking draft temporarily)

@skrdgraph skrdgraph marked this pull request as draft October 21, 2022 10:16
@joshua-goldstein joshua-goldstein marked this pull request as ready for review November 2, 2022 19:56
@joshua-goldstein joshua-goldstein force-pushed the joshua/update-badger-ristretto branch from d6003db to 36ad2d3 Compare November 4, 2022 05:57
@joshua-goldstein
Copy link
Contributor Author

@skrdgraph I have rebased this PR and updated the dependency on Badger to v3.2103.4 (latest). So this is ready to merge.

Copy link
Contributor

@skrdgraph skrdgraph left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@skrdgraph skrdgraph merged commit 855974e into main Nov 4, 2022
@skrdgraph skrdgraph deleted the joshua/update-badger-ristretto branch November 4, 2022 23:18
skrdgraph pushed a commit that referenced this pull request Nov 4, 2022
## Problem

We would like to support arm64. Toward that end we want to add a ci job
that will run tests on an arm instance. This is a WIP because some tests
are failing (see remarks below)

## Solution
- Get the latest Ristretto and Badger versions that fixed certain arm64
issues. This is also in a PR #8365 that has not been merged yet.
```
go get github.com/dgraph-io/[email protected]
go get github.com/dgraph-io/badger/[email protected]
go mod tidy 
```
- Remove GOOS/GOARCH constraints in Makefile and CI workflow.

## Current test failures

These are all of the places we currently see failures. Unfortunately the
skip flag in t.go is unable to skip these particular tests in graphql.
All other tests are passing.


[graphql/e2e/normal](https://gist.github.com/joshua-goldstein/fcd4579ee7366a13b9e28eacad20a2b7)

[graphql/e2e/directives](https://gist.github.com/joshua-goldstein/a339d5a285c621aa3e4045f407a87804)

[graphql/e2e/custom_logic](https://gist.github.com/joshua-goldstein/48d91ac2969ddc29afd705d07186fb8b)

[systest/export](https://gist.github.com/joshua-goldstein/39eaa83e277eb53101c7edc46aca0b83)


## Remarks

I was experimenting with a fresh arm64 instance and running tests on
there (same or very similar environment to CI environment). These look
like nontrivial failures that need to be investigated.

I have a script that does all the setup (Go, Docker, etc.) in a similar
way to the CI environment but for arm (see
[here](https://gist.github.com/joshua-goldstein/2c0a90192ed46a4145e3d2495e4e1c48)).

## Todo

Set up Github actions to run these jobs on an arm instance
automatically, once we have a baseline.

Co-authored-by: adityasadalage <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Development

Successfully merging this pull request may close these issues.

4 participants