File tree 11 files changed +14
-14
lines changed
11 files changed +14
-14
lines changed Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc"
4
4
slug : warc
5
5
url : /cmd/warc/
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc cat"
4
4
slug : warc_cat
5
5
url : /cmd/warc_cat/
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc completion"
4
4
slug : warc_completion
5
5
url : /cmd/warc_completion/
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc console"
4
4
slug : warc_console
5
5
url : /cmd/warc_console/
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc convert"
4
4
slug : warc_convert
5
5
url : /cmd/warc_convert/
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc convert arc"
4
4
slug : warc_convert_arc
5
5
url : /cmd/warc_convert_arc/
@@ -34,7 +34,7 @@ warc convert arc <files/dirs> [flags]
34
34
-c, --concurrency int number of input files to process simultaneously. The default value is 1.5 x <number of cpu cores> (default 24)
35
35
-C, --concurrent-writers int maximum concurrent WARC writers. This is the number of WARC-files simultaneously written to.
36
36
A consequence is that at least this many WARC files are created even if there is only one input file. (default 1)
37
- -t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-21 ")
37
+ -t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-22 ")
38
38
-S, --file-size int The maximum size for WARC files (default 1073741824)
39
39
--flush if true, sync WARC file to disk after writing each record
40
40
-h, --help help for arc
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc convert nedlib"
4
4
slug : warc_convert_nedlib
5
5
url : /cmd/warc_convert_nedlib/
@@ -34,7 +34,7 @@ warc convert nedlib <files/dirs> [flags]
34
34
-c, --concurrency int number of input files to process simultaneously. The default value is 1.5 x <number of cpu cores> (default 24)
35
35
-C, --concurrent-writers int maximum concurrent WARC writers. This is the number of WARC-files simultaneously written to.
36
36
A consequence is that at least this many WARC files are created even if there is only one input file. (default 1)
37
- -t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-21 ")
37
+ -t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-22 ")
38
38
-S, --file-size int The maximum size for WARC files (default 1073741824)
39
39
--flush if true, sync WARC file to disk after writing each record
40
40
-h, --help help for nedlib
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc convert warc"
4
4
slug : warc_convert_warc
5
5
url : /cmd/warc_convert_warc/
@@ -39,7 +39,7 @@ warc convert warc <files/dirs> [flags]
39
39
-c, --concurrency int number of input files to process simultaneously. The default value is 1.5 x <number of cpu cores> (default 24)
40
40
-C, --concurrent-writers int maximum concurrent WARC writers. This is the number of WARC-files simultaneously written to.
41
41
A consequence is that at least this many WARC files are created even if there is only one input file. (default 1)
42
- -t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-21 ")
42
+ -t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-22 ")
43
43
-S, --file-size int The maximum size for WARC files (default 1073741824)
44
44
--flush if true, sync WARC file to disk after writing each record
45
45
-h, --help help for warc
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc dedup"
4
4
slug : warc_dedup
5
5
url : /cmd/warc_dedup/
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc ls"
4
4
slug : warc_ls
5
5
url : /cmd/warc_ls/
Original file line number Diff line number Diff line change 1
1
---
2
- date : 2024-02-21T15:43:33 +01:00
2
+ date : 2024-02-22T10:56:13 +01:00
3
3
title : " warc validate"
4
4
slug : warc_validate
5
5
url : /cmd/warc_validate/
You can’t perform that action at this time.
0 commit comments