Skip to content

Distributed compute refactoring #1047

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 29 commits into
base: main
Choose a base branch
from

Merge branch 'main' into distributed-refactoring

fbf76f2
Select commit
Loading
Failed to load commit list.
Draft

Distributed compute refactoring #1047

Merge branch 'main' into distributed-refactoring
fbf76f2
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch failed May 5, 2025 in 1s

72.19% of diff hit (target 88.11%)

View this Pull Request on Codecov

72.19% of diff hit (target 88.11%)

Annotations

Check warning on line 40 in src/datachain/cli/__init__.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/cli/__init__.py#L40

Added line #L40 was not covered by tests

Check warning on line 315 in src/datachain/cli/__init__.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/cli/__init__.py#L315

Added line #L315 was not covered by tests

Check warning on line 317 in src/datachain/cli/__init__.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/cli/__init__.py#L317

Added line #L317 was not covered by tests

Check warning on line 662 in src/datachain/data_storage/metastore.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/metastore.py#L662

Added line #L662 was not covered by tests

Check warning on line 665 in src/datachain/data_storage/metastore.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/metastore.py#L665

Added line #L665 was not covered by tests

Check warning on line 1060 in src/datachain/data_storage/metastore.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/metastore.py#L1060

Added line #L1060 was not covered by tests

Check warning on line 1077 in src/datachain/data_storage/metastore.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/metastore.py#L1077

Added line #L1077 was not covered by tests

Check warning on line 1079 in src/datachain/data_storage/metastore.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/metastore.py#L1079

Added line #L1079 was not covered by tests

Check warning on line 1081 in src/datachain/data_storage/metastore.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/metastore.py#L1081

Added line #L1081 was not covered by tests

Check warning on line 1083 in src/datachain/data_storage/metastore.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/metastore.py#L1083

Added line #L1083 was not covered by tests

Check warning on line 1085 in src/datachain/data_storage/metastore.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/metastore.py#L1085

Added line #L1085 was not covered by tests

Check warning on line 206 in src/datachain/data_storage/warehouse.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/warehouse.py#L206

Added line #L206 was not covered by tests

Check warning on line 331 in src/datachain/data_storage/warehouse.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/warehouse.py#L331

Added line #L331 was not covered by tests

Check warning on line 335 in src/datachain/data_storage/warehouse.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/data_storage/warehouse.py#L335

Added line #L335 was not covered by tests

Check warning on line 230 in src/datachain/lib/udf.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/lib/udf.py#L230

Added line #L230 was not covered by tests

Check warning on line 456 in src/datachain/query/dataset.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dataset.py#L456

Added line #L456 was not covered by tests

Check warning on line 460 in src/datachain/query/dataset.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dataset.py#L460

Added line #L460 was not covered by tests

Check warning on line 465 in src/datachain/query/dataset.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dataset.py#L465

Added line #L465 was not covered by tests

Check warning on line 506 in src/datachain/query/dataset.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dataset.py#L505-L506

Added lines #L505 - L506 were not covered by tests

Check warning on line 95 in src/datachain/query/dispatch.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dispatch.py#L95

Added line #L95 was not covered by tests

Check warning on line 171 in src/datachain/query/dispatch.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dispatch.py#L171

Added line #L171 was not covered by tests

Check warning on line 176 in src/datachain/query/dispatch.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dispatch.py#L176

Added line #L176 was not covered by tests

Check warning on line 181 in src/datachain/query/dispatch.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dispatch.py#L181

Added line #L181 was not covered by tests

Check warning on line 198 in src/datachain/query/dispatch.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dispatch.py#L198

Added line #L198 was not covered by tests

Check warning on line 201 in src/datachain/query/dispatch.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

src/datachain/query/dispatch.py#L201

Added line #L201 was not covered by tests