Skip to content

Commit

Permalink
version v2.0.1
Browse files Browse the repository at this point in the history
  • Loading branch information
johnerikhalse committed Feb 22, 2024
1 parent 3e2c6ee commit 3dd7b08
Show file tree
Hide file tree
Showing 11 changed files with 14 additions and 14 deletions.
2 changes: 1 addition & 1 deletion docs/content/cmd/warc.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc"
slug: warc
url: /cmd/warc/
Expand Down
2 changes: 1 addition & 1 deletion docs/content/cmd/warc_cat.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc cat"
slug: warc_cat
url: /cmd/warc_cat/
Expand Down
2 changes: 1 addition & 1 deletion docs/content/cmd/warc_completion.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc completion"
slug: warc_completion
url: /cmd/warc_completion/
Expand Down
2 changes: 1 addition & 1 deletion docs/content/cmd/warc_console.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc console"
slug: warc_console
url: /cmd/warc_console/
Expand Down
2 changes: 1 addition & 1 deletion docs/content/cmd/warc_convert.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc convert"
slug: warc_convert
url: /cmd/warc_convert/
Expand Down
4 changes: 2 additions & 2 deletions docs/content/cmd/warc_convert_arc.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc convert arc"
slug: warc_convert_arc
url: /cmd/warc_convert_arc/
Expand Down Expand Up @@ -34,7 +34,7 @@ warc convert arc <files/dirs> [flags]
-c, --concurrency int number of input files to process simultaneously. The default value is 1.5 x <number of cpu cores> (default 24)
-C, --concurrent-writers int maximum concurrent WARC writers. This is the number of WARC-files simultaneously written to.
A consequence is that at least this many WARC files are created even if there is only one input file. (default 1)
-t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-21")
-t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-22")
-S, --file-size int The maximum size for WARC files (default 1073741824)
--flush if true, sync WARC file to disk after writing each record
-h, --help help for arc
Expand Down
4 changes: 2 additions & 2 deletions docs/content/cmd/warc_convert_nedlib.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc convert nedlib"
slug: warc_convert_nedlib
url: /cmd/warc_convert_nedlib/
Expand Down Expand Up @@ -34,7 +34,7 @@ warc convert nedlib <files/dirs> [flags]
-c, --concurrency int number of input files to process simultaneously. The default value is 1.5 x <number of cpu cores> (default 24)
-C, --concurrent-writers int maximum concurrent WARC writers. This is the number of WARC-files simultaneously written to.
A consequence is that at least this many WARC files are created even if there is only one input file. (default 1)
-t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-21")
-t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-22")
-S, --file-size int The maximum size for WARC files (default 1073741824)
--flush if true, sync WARC file to disk after writing each record
-h, --help help for nedlib
Expand Down
4 changes: 2 additions & 2 deletions docs/content/cmd/warc_convert_warc.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc convert warc"
slug: warc_convert_warc
url: /cmd/warc_convert_warc/
Expand Down Expand Up @@ -39,7 +39,7 @@ warc convert warc <files/dirs> [flags]
-c, --concurrency int number of input files to process simultaneously. The default value is 1.5 x <number of cpu cores> (default 24)
-C, --concurrent-writers int maximum concurrent WARC writers. This is the number of WARC-files simultaneously written to.
A consequence is that at least this many WARC files are created even if there is only one input file. (default 1)
-t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-21")
-t, --default-date string fetch date to use for records missing date metadata. Fetchtime is set to 12:00 UTC for the date (default "2024-2-22")
-S, --file-size int The maximum size for WARC files (default 1073741824)
--flush if true, sync WARC file to disk after writing each record
-h, --help help for warc
Expand Down
2 changes: 1 addition & 1 deletion docs/content/cmd/warc_dedup.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc dedup"
slug: warc_dedup
url: /cmd/warc_dedup/
Expand Down
2 changes: 1 addition & 1 deletion docs/content/cmd/warc_ls.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc ls"
slug: warc_ls
url: /cmd/warc_ls/
Expand Down
2 changes: 1 addition & 1 deletion docs/content/cmd/warc_validate.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
---
date: 2024-02-21T15:43:33+01:00
date: 2024-02-22T10:56:13+01:00
title: "warc validate"
slug: warc_validate
url: /cmd/warc_validate/
Expand Down

0 comments on commit 3dd7b08

Please sign in to comment.