Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
68 commits
Select commit Hold shift + click to select a range
190884f
builds
May 1, 2024
4b12fc7
remove duplicate license
May 1, 2024
3a25d17
uncomment and fix commented code
May 1, 2024
d8f574e
get more tests working. Still can build
May 1, 2024
e4b291f
builds, testhoodiefilegroupreaderonspark fails because of LZ4_RAW codec
May 1, 2024
d1de8c5
fix compression issue
May 1, 2024
d6fd984
all tests should pass hudi-common now
May 1, 2024
8c4a9b3
Merge branch 'master' into move_hadoop_readers_to_hadoop_module
May 1, 2024
9ad99ef
fix spark 2.4 and try to fix other spark versions
May 1, 2024
6c2925b
fix hadoop mr test
May 1, 2024
65e6b37
fix integration test
May 1, 2024
7e38f4e
fix failing test by commenting out org.apache.hudi.hadoop.fs.HadoopFS…
May 2, 2024
565a8c4
fix reflection wrong class path
May 2, 2024
385b66d
remove double copyright
May 2, 2024
c97daf2
fix some more tests
May 2, 2024
50b743d
Merge branch 'master' into move_hadoop_readers_to_hadoop_module
May 2, 2024
4e4a01a
fix failing java test
May 2, 2024
9ad3d3e
use try so writer closes and flushes buffer
May 2, 2024
b88fa88
add hudi-io dependency to another module
May 2, 2024
c0a81f2
try to fix testLocalFileSystemLoading which only fails in azure ci
May 2, 2024
834aad2
remove parquet dep from hadoop common
May 2, 2024
1a5e0d9
Merge branch 'master' into move_hadoop_readers_to_hadoop_module
May 6, 2024
7376b45
get building
May 6, 2024
f75268f
unify org config
May 6, 2024
d491f7e
get rid of duplicate copyright
May 6, 2024
ea258fe
fix flink issue
May 6, 2024
deaa09e
fix failing test
May 7, 2024
e78b401
Merge branch 'master' into move_hadoop_readers_to_hadoop_module
May 7, 2024
9c503b6
Merge branch 'move_hadoop_readers_to_hadoop_module' into create_hudi_…
May 7, 2024
7c72471
fix ci
May 7, 2024
b7f31f2
Merge branch 'move_hadoop_readers_to_hadoop_module' into create_hudi_…
May 7, 2024
158cc30
Merge branch 'master' into move_hadoop_readers_to_hadoop_module
May 7, 2024
2bde7d5
fix merge
May 7, 2024
253d52a
Merge branch 'move_hadoop_readers_to_hadoop_module' into create_hudi_…
May 7, 2024
5ae8da0
hfile bootstrap index de hadoop
May 7, 2024
27a6160
fix checkstyle
May 7, 2024
65d6f23
make writer not private
May 7, 2024
0de96bd
address some of the review feedback
May 8, 2024
94063d1
Merge branch 'master' into move_hadoop_readers_to_hadoop_module
May 8, 2024
3d33de3
fix integ test issue
May 8, 2024
532c386
address more review comments
May 8, 2024
bf97332
remove unnecessary changes
May 8, 2024
789308f
Merge branch 'master' into move_hadoop_readers_to_hadoop_module
May 8, 2024
ea50694
fix merge issue
May 8, 2024
a24b9db
move TestInProcessLockProvider to hadoop common
May 8, 2024
fbbe1d0
Merge branch 'master' into move_hadoop_readers_to_hadoop_module
May 9, 2024
1219237
remove extra license
May 9, 2024
c1f6b79
Merge branch 'move_hadoop_readers_to_hadoop_module' into create_hudi_…
May 9, 2024
8693b73
address most review comments
May 9, 2024
8e7d0a2
addressed review comments
May 9, 2024
e2abfbe
clean up
May 9, 2024
4272559
Merge branch 'create_hudi_io_factory' into hfile_bootstrap_index_remo…
May 9, 2024
c4eb3e7
clean up
May 9, 2024
c4dd659
address reveiw comments
May 9, 2024
e8f82c4
address review comments
May 9, 2024
b449d6e
Merge branch 'move_hadoop_readers_to_hadoop_module' into create_hudi_…
May 9, 2024
156917f
Merge branch 'create_hudi_io_factory' into hfile_bootstrap_index_remo…
May 9, 2024
5bf8143
change some naming
May 9, 2024
12faeb3
Merge branch 'master' into create_hudi_io_factory
May 9, 2024
692b8b0
Merge branch 'master' into hfile_bootstrap_index_remove_hadoop
May 9, 2024
0007f84
address review comments
May 9, 2024
01c2945
Merge branch 'create_hudi_io_factory' into hfile_bootstrap_index_remo…
May 10, 2024
7b819bd
Merge branch 'master' into hfile_bootstrap_index_remove_hadoop
May 10, 2024
d95c47b
fix issues found after doing read through
May 10, 2024
42da7a1
fix reflection string
May 10, 2024
887c9ab
fix build issue
May 10, 2024
f5243e9
address review comments
May 10, 2024
42fb200
address review comments on hfile_bootstrap_index_remove_hadoop
May 10, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ public String bootstrap(
@ShellOption(value = {"--rowKeyField"}, help = "Record key columns for bootstrap data") final String rowKeyField,
@ShellOption(value = {"--partitionPathField"}, defaultValue = "",
help = "Partition fields for bootstrap source data") final String partitionPathField,
@ShellOption(value = {"--bootstrapIndexClass"}, defaultValue = "org.apache.hudi.common.bootstrap.index.HFileBootstrapIndex",
@ShellOption(value = {"--bootstrapIndexClass"}, defaultValue = "org.apache.hudi.common.bootstrap.index.hfile.HFileBootstrapIndex",
help = "Bootstrap Index Class") final String bootstrapIndexClass,
@ShellOption(value = {"--selectorClass"}, defaultValue = "org.apache.hudi.client.bootstrap.selector.MetadataOnlyBootstrapModeSelector",
help = "Selector class for bootstrap") final String selectorClass,
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@
import org.apache.hudi.client.bootstrap.BootstrapMode;
import org.apache.hudi.client.bootstrap.selector.MetadataOnlyBootstrapModeSelector;
import org.apache.hudi.client.bootstrap.translator.IdentityBootstrapPartitionPathTranslator;
import org.apache.hudi.common.bootstrap.index.HFileBootstrapIndex;
import org.apache.hudi.common.bootstrap.index.hfile.HFileBootstrapIndex;
import org.apache.hudi.common.config.ConfigClassProperty;
import org.apache.hudi.common.config.ConfigGroups;
import org.apache.hudi.common.config.ConfigProperty;
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@
import java.util.Map;
import java.util.stream.Collectors;

import static org.apache.hudi.common.bootstrap.TestBootstrapIndex.generateBootstrapIndex;
import static org.apache.hudi.common.bootstrap.index.TestBootstrapIndex.generateBootstrapIndex;
import static org.apache.hudi.common.table.timeline.TimelineMetadataUtils.serializeCommitMetadata;
import static org.apache.hudi.common.testutils.HoodieTestTable.makeNewCommitTime;
import static org.junit.jupiter.api.Assertions.assertEquals;
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -7,13 +7,14 @@
* "License"); you may not use this file except in compliance
* with the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
* Unless required by applicable law or agreed to in writing,
* software distributed under the License is distributed on an
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
* KIND, either express or implied. See the License for the
* specific language governing permissions and limitations
* under the License.
*/

package org.apache.hudi.common.bootstrap.index;
Expand Down
Loading