Update UCX-Py version to 0.21

[pentschev]

No description provided.

[pentschev]

Waiting for #1649 to be merged first.

[rlratzel]

Thanks!

[ajschmidt8]

this is a no-op, so we can remove this line.

[codecov-commenter]

Codecov Report

❗ No coverage uploaded for pull request base (branch-21.08@6b5079c). Click here to learn what that means.
The diff coverage is n/a.

@@               Coverage Diff               @@
##             branch-21.08    #1650   +/-   ##
===============================================
  Coverage                ?   59.68%           
===============================================
  Files                   ?       80           
  Lines                   ?     3542           
  Branches                ?        0           
===============================================
  Hits                    ?     2114           
  Misses                  ?     1428           
  Partials                ?        0           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6b5079c...62632c8. Read the comment docs.

[ajschmidt8]

@gpucibot merge

[pentschev]

Seems like there are several potentially legit cuGraph failures here, @rlratzel @BradReesWork could you take a look?

[pentschev]

Oh, actually those seem to be because we're installing Dask/Distributed 2021.5.1, but we need 2021.6.0 or main for branch-21.08. It seems that this was covered by

cugraph/ci/gpu/build.sh

Lines 75 to 77 in 6aab21f

	gpuci_logger "Install the master version of dask and distributed"
	pip install "git+https://github.com/dask/distributed.git" --upgrade --no-deps
	pip install "git+https://github.com/dask/dask.git" --upgrade --no-deps

but something is downgrading them after that, perhaps we need rapidsai/dask-cuda#645 first.

[pentschev]

Actually no, rapidsai/dask-cuda#645 won't help because it targets branch-21.06. I think something in the following block is downgrading Dask/Distributed:

cugraph/ci/gpu/build.sh

Lines 89 to 113 in 6aab21f

	################################################################################
	# BUILD - Build libcugraph and cuGraph from source
	################################################################################
	if [[ -z "$PROJECT_FLASH" || "$PROJECT_FLASH" == "0" ]]; then
	gpuci_logger "Build from source"
	$WORKSPACE/build.sh -v clean libcugraph cugraph
	else
	export LIBCUGRAPH_BUILD_DIR="$WORKSPACE/ci/artifacts/cugraph/cpu/conda_work/cpp/build"
	# Faiss patch
	echo "Update libcugraph.so"
	cd $LIBCUGRAPH_BUILD_DIR
	chrpath -d libcugraph.so
	patchelf --replace-needed `patchelf --print-needed libcugraph.so | grep faiss` libfaiss.so libcugraph.so
	CONDA_FILE=`find ${CONDA_ARTIFACT_PATH} -name "libcugraph*.tar.bz2"`
	CONDA_FILE=`basename "$CONDA_FILE" .tar.bz2` #get filename without extension
	CONDA_FILE=${CONDA_FILE//-/=} #convert to conda install
	echo "Installing $CONDA_FILE"
	conda install -c ${CONDA_ARTIFACT_PATH} "$CONDA_FILE"
	echo "Build cugraph..."
	$WORKSPACE/build.sh cugraph
	fi

I'm not sure what package is the cause for downgrade, but perhaps we could move the Dask install after cuGraph? Also, this will need to wait for rapidsai/dask-cuda#647, as rapidsai/dask-cuda#645 just got merged and that pins 2021.5.1 in Dask-CUDA.

[pentschev]

rerun tests

[pentschev]

Rerunning tests now that cuDF and integration repo have been updated.

[ajschmidt8]

looks like this might be blocked by #1637 now. that one should hopefully be merged soon.

[ajschmidt8]

@pentschev, can you pull the latest changes here now that #1637 is merged?

[pentschev]

can you pull the latest changes here now that #1637 is merged?

Done.