Skip to content

Docs: Enhance Spark pages#9920

Merged
nastra merged 1 commit intoapache:mainfrom
manuzhang:spark-docs
Mar 12, 2024
Merged

Docs: Enhance Spark pages#9920
nastra merged 1 commit intoapache:mainfrom
manuzhang:spark-docs

Conversation

@manuzhang
Copy link
Member

  1. Fix internal links
  2. Move Type Compatibility section from spark-writes.md to spark-getting-started.md

@nastra
Copy link
Contributor

nastra commented Mar 11, 2024

@manuzhang have you verified that all links works by locally running the site as described here?

1. Fix internal links
2. Move `Type Compatibility` section from spark-writes.md to spark-getting-started.md
@nastra nastra merged commit 71ff8a4 into apache:main Mar 12, 2024
@bitsondatadev
Copy link
Collaborator

bitsondatadev commented Mar 12, 2024

Oops

Apologies, as I sent this note and accidentally made a review instead of posted a comment. I generally don't dislike GH's UI but that one has bitten me quite a few times. I digress...

Original / Updated note

@manuzhang @nastra did you test the links locally? I realized after I asked this we haven't set up the nightly build yet, which would enable testing the current changes in docs and we can also run a link validator on that live build each day.

That said, I'm pretty sure this will break the links if we don't revert the link changes in the next build as it works on the site now, and did the day before when I originally posted this.

https://iceberg.apache.org/docs/latest/spark-configuration/#catalogs

Links are a bit strange at the moment so depending on if you're in a subproject or top-level site, it will change how you address internal links. This is due to the number of directories between versioned mkdocs projects and the top level site change from static code to build. Static code analysis that is common practice in mkdocs will fail, hence all the warnings when you build. We knew this wasn't perfect going into it, but we just needed to get this out incrementally and will be slowly addressing this.

So moving forward, I will create a PR to build locally so that any time we update docs, you will have an option to validate those changes in a local site, especially links, and I'll update the readme there.

I'll also work on another PR to add nightly builds that will run a link check on the live site after each nightly build and generate a report, while still hosting the nightly build.

@nastra, could you please revert just the links in this change and keep the content changes? Or if it's better, do the full revert and reapply only the content changes.

Thanks!

@manuzhang
Copy link
Member Author

@bitsondatadev @nastra
There is already #9939 reverting some of the links.
I can submit another PR fixing other link changes in the following PRs
#9819
#9919
#9920

@nastra
Copy link
Contributor

nastra commented Mar 13, 2024

Can we just have one single PR to fix all the broken links for the current version of the docs (main)? We would then also have to fix broken links for 1.4.0 / 1.4.1 / 1.4.2 / 1.4.3 / 1.5.0 as those doc versions have the same broken links.

This is for exameple all of the current warnings against the current docs:

INFO    -  Doc file 'docs/nightly/configuration.md' contains an unrecognized relative link '../../../spec/#format-versioning', it was left as is. Did you mean '../../spec.md#format-versioning'?
WARNING -  Doc file 'docs/nightly/configuration.md' contains a relative link '../metrics-reporting.md', but the target 'docs/metrics-reporting.md' is not found among documentation files. Did you mean 'metrics-reporting.md'?
WARNING -  Doc file 'docs/nightly/flink-actions.md' contains a relative link '../maintenance.md#compact-data-files', but the target 'docs/maintenance.md' is not found among documentation files. Did you mean 'maintenance.md#compact-data-files'?
WARNING -  Doc file 'docs/nightly/flink-connector.md' contains a relative link '../flink.md#adding-catalogs', but the target 'docs/flink.md' is not found among documentation files. Did you mean 'flink.md#adding-catalogs'?
WARNING -  Doc file 'docs/nightly/flink-connector.md' contains a relative link '../flink.md', but the target 'docs/flink.md' is not found among documentation files. Did you mean 'flink.md'?
WARNING -  Doc file 'docs/nightly/flink-connector.md' contains a relative link '../flink.md', but the target 'docs/flink.md' is not found among documentation files. Did you mean 'flink.md'?
WARNING -  Doc file 'docs/nightly/flink-ddl.md' contains a relative link '../configuration.md', but the target 'docs/configuration.md' is not found among documentation files. Did you mean 'configuration.md'?
WARNING -  Doc file 'docs/nightly/flink-queries.md' contains a relative link '../flink-configuration.md#read-options', but the target 'docs/flink-configuration.md' is not found among documentation files. Did you mean 'flink-configuration.md#read-options'?
INFO    -  Doc file 'docs/nightly/flink-writes.md' contains an unrecognized relative link '../flink-ddl.md/#primary-key', it was left as is. Did you mean 'flink-ddl.md#primary-key'?
WARNING -  Doc file 'docs/nightly/flink-writes.md' contains a relative link '../branching.md', but the target 'docs/branching.md' is not found among documentation files. Did you mean 'branching.md'?
WARNING -  Doc file 'docs/nightly/flink-writes.md' contains a relative link '../flink-configuration.md#write-options', but the target 'docs/flink-configuration.md' is not found among documentation files. Did you mean 'flink-configuration.md#write-options'?
WARNING -  Doc file 'docs/nightly/flink-writes.md' contains a relative link '../maintenance.md#expire-snapshots', but the target 'docs/maintenance.md' is not found among documentation files. Did you mean 'maintenance.md#expire-snapshots'?
WARNING -  Doc file 'docs/nightly/flink-writes.md' contains a relative link '../maintenance.md#delete-orphan-files', but the target 'docs/maintenance.md' is not found among documentation files. Did you mean 'maintenance.md#delete-orphan-files'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-ddl.md#create-catalog', but the target 'docs/flink-ddl.md' is not found among documentation files. Did you mean 'flink-ddl.md#create-catalog'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-ddl.md#create-database', but the target 'docs/flink-ddl.md' is not found among documentation files. Did you mean 'flink-ddl.md#create-database'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-ddl.md#create-table', but the target 'docs/flink-ddl.md' is not found among documentation files. Did you mean 'flink-ddl.md#create-table'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-ddl.md#create-table-like', but the target 'docs/flink-ddl.md' is not found among documentation files. Did you mean 'flink-ddl.md#create-table-like'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-ddl.md#alter-table', but the target 'docs/flink-ddl.md' is not found among documentation files. Did you mean 'flink-ddl.md#alter-table'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-ddl.md#drop-table', but the target 'docs/flink-ddl.md' is not found among documentation files. Did you mean 'flink-ddl.md#drop-table'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-queries.md#reading-with-sql', but the target 'docs/flink-queries.md' is not found among documentation files. Did you mean 'flink-queries.md#reading-with-sql'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-writes.md#insert-into', but the target 'docs/flink-writes.md' is not found among documentation files. Did you mean 'flink-writes.md#insert-into'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-writes.md#insert-overwrite', but the target 'docs/flink-writes.md' is not found among documentation files. Did you mean 'flink-writes.md#insert-overwrite'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-queries.md#reading-with-datastream', but the target 'docs/flink-queries.md' is not found among documentation files. Did you mean 'flink-queries.md#reading-with-datastream'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-writes.md#appending-data', but the target 'docs/flink-writes.md' is not found among documentation files. Did you mean 'flink-writes.md#appending-data'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-writes.md#overwrite-data', but the target 'docs/flink-writes.md' is not found among documentation files. Did you mean 'flink-writes.md#overwrite-data'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-queries.md#inspecting-tables', but the target 'docs/flink-queries.md' is not found among documentation files. Did you mean 'flink-queries.md#inspecting-tables'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../flink-actions.md#rewrite-files-action', but the target 'docs/flink-actions.md' is not found among documentation files. Did you mean 'flink-actions.md#rewrite-files-action'?
WARNING -  Doc file 'docs/nightly/flink.md' contains a relative link '../branching.md', but the target 'docs/branching.md' is not found among documentation files. Did you mean 'branching.md'?
WARNING -  Doc file 'docs/nightly/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/rest/RESTMetricsReporter.html', but the target 'javadoc/1.5.0/org/apache/iceberg/rest/RESTMetricsReporter.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/spark-configuration.md' contains a relative link '../configuration.md#catalog-properties', but the target 'docs/configuration.md' is not found among documentation files. Did you mean 'configuration.md#catalog-properties'?
WARNING -  Doc file 'docs/nightly/spark-configuration.md' contains a relative link '../api.md#table-metadata', but the target 'docs/api.md' is not found among documentation files. Did you mean 'api.md#table-metadata'?
WARNING -  Doc file 'docs/nightly/spark-configuration.md' contains a relative link '../spark-queries.md#snapshots', but the target 'docs/spark-queries.md' is not found among documentation files. Did you mean 'spark-queries.md#snapshots'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../spark-getting-started.md#spark-type-to-iceberg-type', but the target 'docs/spark-getting-started.md' is not found among documentation files. Did you mean 'spark-getting-started.md#spark-type-to-iceberg-type'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../configuration.md', but the target 'docs/configuration.md' is not found among documentation files. Did you mean 'configuration.md'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../partitioning.md', but the target 'docs/partitioning.md' is not found among documentation files. Did you mean 'partitioning.md'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../spark-configuration.md#catalog-configuration', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#catalog-configuration'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../spark-configuration.md#replacing-the-session-catalog', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#replacing-the-session-catalog'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../spark-configuration.md#catalog-configuration', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#catalog-configuration'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../spark-configuration.md#replacing-the-session-catalog', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#replacing-the-session-catalog'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../spark-configuration.md#sql-extensions', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#sql-extensions'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../configuration.md', but the target 'docs/configuration.md' is not found among documentation files. Did you mean 'configuration.md'?
WARNING -  Doc file 'docs/nightly/spark-ddl.md' contains a relative link '../spark-configuration.md#sql-extensions', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#sql-extensions'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-configuration.md#catalogs', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#catalogs'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-ddl.md#create-table', but the target 'docs/spark-ddl.md' is not found among documentation files. Did you mean 'spark-ddl.md#create-table'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-ddl.md#create-table', but the target 'docs/spark-ddl.md' is not found among documentation files. Did you mean 'spark-ddl.md#create-table'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-ddl.md#create-table-as-select', but the target 'docs/spark-ddl.md' is not found among documentation files. Did you mean 'spark-ddl.md#create-table-as-select'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-ddl.md#alter-table', but the target 'docs/spark-ddl.md' is not found among documentation files. Did you mean 'spark-ddl.md#alter-table'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-ddl.md#drop-table', but the target 'docs/spark-ddl.md' is not found among documentation files. Did you mean 'spark-ddl.md#drop-table'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-writes.md#insert-into', but the target 'docs/spark-writes.md' is not found among documentation files. Did you mean 'spark-writes.md#insert-into'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-writes.md#merge-into', but the target 'docs/spark-writes.md' is not found among documentation files. Did you mean 'spark-writes.md#merge-into'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-writes.md#delete-from', but the target 'docs/spark-writes.md' is not found among documentation files. Did you mean 'spark-writes.md#delete-from'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-writes.md#writing-with-dataframes', but the target 'docs/spark-writes.md' is not found among documentation files. Did you mean 'spark-writes.md#writing-with-dataframes'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-queries.md#inspecting-tables', but the target 'docs/spark-queries.md' is not found among documentation files. Did you mean 'spark-queries.md#inspecting-tables'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-queries.md#querying-with-dataframes', but the target 'docs/spark-queries.md' is not found among documentation files. Did you mean 'spark-queries.md#querying-with-dataframes'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-ddl.md', but the target 'docs/spark-ddl.md' is not found among documentation files. Did you mean 'spark-ddl.md'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-queries.md', but the target 'docs/spark-queries.md' is not found among documentation files. Did you mean 'spark-queries.md'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-writes.md', but the target 'docs/spark-writes.md' is not found among documentation files. Did you mean 'spark-writes.md'?
WARNING -  Doc file 'docs/nightly/spark-getting-started.md' contains a relative link '../spark-procedures.md', but the target 'docs/spark-procedures.md' is not found among documentation files. Did you mean 'spark-procedures.md'?
WARNING -  Doc file 'docs/nightly/spark-procedures.md' contains a relative link '../spark-configuration.md', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md'?
WARNING -  Doc file 'docs/nightly/spark-procedures.md' contains a relative link '../spark-configuration.md#sql-extensions', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#sql-extensions'?
WARNING -  Doc file 'docs/nightly/spark-procedures.md' contains a relative link '../configuration.md#table-behavior-properties', but the target 'docs/configuration.md' is not found among documentation files. Did you mean 'configuration.md#table-behavior-properties'?
WARNING -  Doc file 'docs/nightly/spark-procedures.md' contains a relative link '../configuration.md#write-properties', but the target 'docs/configuration.md' is not found among documentation files. Did you mean 'configuration.md#write-properties'?
WARNING -  Doc file 'docs/nightly/spark-procedures.md' contains a relative link '../configuration.md#write-properties', but the target 'docs/configuration.md' is not found among documentation files. Did you mean 'configuration.md#write-properties'?
WARNING -  Doc file 'docs/nightly/spark-queries.md' contains a relative link '../spark-configuration.md', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md'?
WARNING -  Doc file 'docs/nightly/spark-queries.md' contains a relative link '../spark-configuration.md#using-catalogs', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#using-catalogs'?
WARNING -  Doc file 'docs/nightly/spark-structured-streaming.md' contains a relative link '../spark-ddl.md#create-table', but the target 'docs/spark-ddl.md' is not found among documentation files. Did you mean 'spark-ddl.md#create-table'?
WARNING -  Doc file 'docs/nightly/spark-structured-streaming.md' contains a relative link '../spark-writes.md#writing-distribution-modes', but the target 'docs/spark-writes.md' is not found among documentation files. Did you mean 'spark-writes.md#writing-distribution-modes'?
WARNING -  Doc file 'docs/nightly/spark-structured-streaming.md' contains a relative link '../maintenance.md#expire-snapshots', but the target 'docs/maintenance.md' is not found among documentation files. Did you mean 'maintenance.md#expire-snapshots'?
WARNING -  Doc file 'docs/nightly/spark-structured-streaming.md' contains a relative link '../spark-procedures.md#expire_snapshots', but the target 'docs/spark-procedures.md' is not found among documentation files. Did you mean 'spark-procedures.md#expire_snapshots'?
WARNING -  Doc file 'docs/nightly/spark-structured-streaming.md' contains a relative link '../maintenance.md#compact-data-files', but the target 'docs/maintenance.md' is not found among documentation files. Did you mean 'maintenance.md#compact-data-files'?
WARNING -  Doc file 'docs/nightly/spark-structured-streaming.md' contains a relative link '../spark-procedures.md#rewrite_data_files', but the target 'docs/spark-procedures.md' is not found among documentation files. Did you mean 'spark-procedures.md#rewrite_data_files'?
WARNING -  Doc file 'docs/nightly/spark-structured-streaming.md' contains a relative link '../maintenance.md#rewrite-manifests', but the target 'docs/maintenance.md' is not found among documentation files. Did you mean 'maintenance.md#rewrite-manifests'?
WARNING -  Doc file 'docs/nightly/spark-structured-streaming.md' contains a relative link '../spark-procedures.md#rewrite_manifests', but the target 'docs/spark-procedures.md' is not found among documentation files. Did you mean 'spark-procedures.md#rewrite_manifests'?
WARNING -  Doc file 'docs/nightly/spark-writes.md' contains a relative link '../spark-configuration.md', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md'?
WARNING -  Doc file 'docs/nightly/spark-writes.md' contains a relative link '../spark-configuration.md#sql-extensions', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#sql-extensions'?
WARNING -  Doc file 'docs/nightly/spark-writes.md' contains a relative link '../branching.md', but the target 'docs/branching.md' is not found among documentation files. Did you mean 'branching.md'?
WARNING -  Doc file 'docs/nightly/spark-writes.md' contains a relative link '../spark-configuration.md#write-options', but the target 'docs/spark-configuration.md' is not found among documentation files. Did you mean 'spark-configuration.md#write-options'?
WARNING -  Doc file 'docs/nightly/spark-writes.md' contains a relative link '../configuration.md#write-properties', but the target 'docs/configuration.md' is not found among documentation files. Did you mean 'configuration.md#write-properties'?
WARNING -  Doc file 'docs/nightly/docs/index.md' contains a relative link '../../spec.md', but the target 'docs/spec.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/index.md' contains a relative link '../../community.md', but the target 'docs/community.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/api.md' contains a relative link '../../javadoc/1.5.0/index.html?org/apache/iceberg/Table.html', but the target 'docs/javadoc/1.5.0/index.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/api.md' contains a relative link '../../javadoc/1.5.0/index.html?org/apache/iceberg/PendingUpdate.html', but the target 'docs/javadoc/1.5.0/index.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/api.md' contains a relative link '../../javadoc/1.5.0/index.html?org/apache/iceberg/types/package-summary.html', but the target 'docs/javadoc/1.5.0/index.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/api.md' contains a relative link '../../javadoc/1.5.0/index.html?org/apache/iceberg/expressions/Expressions.html', but the target 'docs/javadoc/1.5.0/index.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/aws.md' contains a relative link '../../blogs.md', but the target 'docs/blogs.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/branching.md' contains a relative link '../../spec.md#snapshot-retention-policy', but the target 'docs/spec.md' is not found among documentation files.
INFO    -  Doc file 'docs/nightly/docs/configuration.md' contains an unrecognized relative link '../../../spec/#format-versioning', it was left as is. Did you mean '../../../spec.md#format-versioning'?
WARNING -  Doc file 'docs/nightly/docs/delta-lake-migration.md' contains a relative link '../../javadoc/latest/org/apache/iceberg/delta/DeltaLakeToIcebergMigrationActionsProvider.html#snapshotDeltaLakeTable(java.lang.String)', but the target
           'docs/javadoc/latest/org/apache/iceberg/delta/DeltaLakeToIcebergMigrationActionsProvider.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/delta-lake-migration.md' contains a relative link '../../javadoc/latest/org/apache/iceberg/delta/SnapshotDeltaLakeTable.html#as(org.apache.iceberg.catalog.TableIdentifier)', but the target 'docs/javadoc/latest/org/apache/iceberg/delta/SnapshotDeltaLakeTable.html' is not found
           among documentation files.
WARNING -  Doc file 'docs/nightly/docs/delta-lake-migration.md' contains a relative link '../../javadoc/latest/org/apache/iceberg/delta/SnapshotDeltaLakeTable.html#icebergCatalog(org.apache.iceberg.catalog.Catalog)', but the target 'docs/javadoc/latest/org/apache/iceberg/delta/SnapshotDeltaLakeTable.html' is not
           found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/delta-lake-migration.md' contains a relative link '../../javadoc/latest/org/apache/iceberg/delta/SnapshotDeltaLakeTable.html#deltaLakeConfiguration(org.apache.hadoop.conf.Configuration)', but the target 'docs/javadoc/latest/org/apache/iceberg/delta/SnapshotDeltaLakeTable.html'
           is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/delta-lake-migration.md' contains a relative link '../../javadoc/latest/org/apache/iceberg/delta/SnapshotDeltaLakeTable.html', but the target 'docs/javadoc/latest/org/apache/iceberg/delta/SnapshotDeltaLakeTable.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/flink-actions.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/flink/actions/RewriteDataFilesAction.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/flink/actions/RewriteDataFilesAction.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/flink-queries.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/flink/source/FlinkSource.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/flink/source/FlinkSource.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/flink-queries.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/flink/source/IcebergSource.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/flink/source/IcebergSource.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/flink-queries.md' contains a relative link '../../spec.md#manifest-lists', but the target 'docs/spec.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/flink-queries.md' contains a relative link '../../spec.md#manifest-lists', but the target 'docs/spec.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/flink-writes.md' contains a relative link '../../spec.md#identifier-field-ids', but the target 'docs/spec.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/flink.md' contains a relative link '../../multi-engine-support.md#apache-flink', but the target 'docs/multi-engine-support.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/hive-migration.md' contains a relative link '../../releases.md#downloads', but the target 'docs/releases.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/hive.md' contains a relative link '../../spec.md#sort-orders', but the target 'docs/spec.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/hive.md' contains a relative link '../../javadoc/1.5.0/index.html?org/apache/iceberg/catalog/Catalog.html', but the target 'docs/javadoc/1.5.0/index.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/hive.md' contains a relative link '../../javadoc/1.5.0/index.html?org/apache/iceberg/Tables.html', but the target 'docs/javadoc/1.5.0/index.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/java-api-quickstart.md' contains a relative link '../../javadoc/1.5.0/index.html?org/apache/iceberg/catalog/Catalog.html', but the target 'docs/javadoc/1.5.0/index.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/java-api-quickstart.md' contains a relative link '../../javadoc/1.5.0/index.html?org/apache/iceberg/Tables.html', but the target 'docs/javadoc/1.5.0/index.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/java-api-quickstart.md' contains a relative link '../../spec.md#partitioning', but the target 'docs/spec.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/maintenance.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/Table.html#expireSnapshots--', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/Table.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/maintenance.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/ExpireSnapshots.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/ExpireSnapshots.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/maintenance.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/actions/DeleteOrphanFiles.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/actions/DeleteOrphanFiles.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/maintenance.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/actions/RewriteDataFiles.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/actions/RewriteDataFiles.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/maintenance.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/actions/RewriteManifests.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/actions/RewriteManifests.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReporter.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReporter.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReport.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReport.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/metrics/ScanReport.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/metrics/ScanReport.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/metrics/CommitReport.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/metrics/CommitReport.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/metrics/LoggingMetricsReporter.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/metrics/LoggingMetricsReporter.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/rest/RESTMetricsReporter.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/rest/RESTMetricsReporter.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/rest/RESTCatalog.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/rest/RESTCatalog.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReporter.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReporter.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReport.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReport.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReporter.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReporter.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/metrics-reporting.md' contains a relative link '../../javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReporter.html', but the target 'docs/javadoc/1.5.0/org/apache/iceberg/metrics/MetricsReporter.html' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/partitioning.md' contains a relative link '../../spec.md#partition-transforms', but the target 'docs/spec.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/reliability.md' contains a relative link '../../terms.md#snapshot', but the target 'docs/terms.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/spark-ddl.md' contains a relative link '../../view-spec.md', but the target 'docs/view-spec.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/spark-getting-started.md' contains a relative link '../../releases.md', but the target 'docs/releases.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/spark-getting-started.md' contains a relative link '../../multi-engine-support.md', but the target 'docs/multi-engine-support.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/spark-queries.md' contains a relative link '../../spec.md#manifest-lists', but the target 'docs/spec.md' is not found among documentation files.
WARNING -  Doc file 'docs/nightly/docs/spark-queries.md' contains a relative link '../../spec.md#manifest-lists', but the target 'docs/spec.md' is not found among documentation files.

@manuzhang
Copy link
Member Author

Yes, after merging in #9943 and #9939, I will submit a fix

@nastra
Copy link
Contributor

nastra commented Mar 13, 2024

I don't think we want to merge #9939 because it only fixes some links.

@manuzhang
Copy link
Member Author

@Fokko is fixing it in #9965

@manuzhang manuzhang deleted the spark-docs branch June 4, 2024 11:05
zachdisc pushed a commit to zachdisc/iceberg that referenced this pull request Dec 23, 2024
1. Fix internal links
2. Move `Type Compatibility` section from spark-writes.md to spark-getting-started.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants