Skip to content

docs: add troubleshooting step for clickhouse and aquasec - #628

Merged
Mukil Loganathan (langchain-infra) merged 6 commits into
mainfrom
infra/add-aquasec
Sep 23, 2025
Merged

docs: add troubleshooting step for clickhouse and aquasec#628
Mukil Loganathan (langchain-infra) merged 6 commits into
mainfrom
infra/add-aquasec

Conversation

@langchain-infra

Copy link
Copy Markdown
Contributor

Overview

Update langsmith self hosted documentation with a troubleshooting guide when running in environments with AquaSec.

Type of change

Type: [Replace with: New documentation page / Update existing documentation / Fix typo/bug/link/formatting / Remove outdated content / Other]

Related issues/PRs

  • GitHub issue:
  • Feature PR:
  • Linear issue:
  • Slack thread:

Checklist

  • I have read the contributing guidelines
  • I have tested my changes locally using docs dev
  • All code examples have been tested and work correctly
  • I have used root relative paths for internal links
  • I have updated navigation in src/docs.json if needed
  • I have gotten approval from the relevant reviewers
  • (Internal team members only / optional) I have created a preview deployment using the Create Preview Branch workflow

Additional notes

Copilot AI review requested due to automatic review settings September 23, 2025 15:28
@github-actions github-actions Bot added the langsmith For docs changes to LangSmith label Sep 23, 2025

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds a troubleshooting section to the LangSmith self-hosted documentation to help users resolve ClickHouse startup issues when running in environments with AquaSec security software.

  • Adds a new troubleshooting section for ClickHouse and AquaSec compatibility issues
  • Provides configuration solutions for both Kubernetes and Docker environments
  • Documents the use of AQUA_SKIP_LD_PRELOAD environment variable to bypass AquaSec interference

Comment thread src/langsmith/troubleshooting.mdx Outdated
@github-actions

Copy link
Copy Markdown
Contributor

Preview ID generated: preview-infraa-1758641348-47d5dbf

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings September 23, 2025 15:43

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 2 comments.

Comment thread src/langsmith/troubleshooting.mdx Outdated
docker compose up
```

### *ClickHouse Fails to Startup when running a Cluster with AquaSec*

Copilot AI Sep 23, 2025

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The heading uses inconsistent formatting with asterisks around the title. Remove the asterisks to match the standard heading format used elsewhere in the documentation.

Suggested change
### *ClickHouse Fails to Startup when running a Cluster with AquaSec*
### ClickHouse Fails to Startup when running a Cluster with AquaSec

Copilot uses AI. Check for mistakes.
Comment thread src/langsmith/troubleshooting.mdx Outdated
```

#### Docker
1. Edit your `docker-compose.yaml` and set the `AQUA_SKIP_LD_PRELOAD` environment variable. This might look something like this:

Copilot AI Sep 23, 2025

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing space after the numbered list marker. Should be '1. Edit' with proper spacing for consistency with the Kubernetes section above.

Copilot uses AI. Check for mistakes.
@github-actions

Copy link
Copy Markdown
Contributor

Preview ID generated: preview-infraa-1758642275-05c410c

@katmayb Kathryn May (katmayb) left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Made a few suggestions, but looks good!

Comment thread src/langsmith/troubleshooting.mdx Outdated
Comment thread src/langsmith/troubleshooting.mdx Outdated
Comment thread src/langsmith/troubleshooting.mdx Outdated
Comment thread src/langsmith/troubleshooting.mdx Outdated
Co-authored-by: Kathryn May <44557882+katmayb@users.noreply.github.com>
Copilot AI review requested due to automatic review settings September 23, 2025 15:52
Co-authored-by: Kathryn May <44557882+katmayb@users.noreply.github.com>
Co-authored-by: Kathryn May <44557882+katmayb@users.noreply.github.com>
Co-authored-by: Kathryn May <44557882+katmayb@users.noreply.github.com>

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 1 out of 1 changed files in this pull request and generated 1 comment.

### *ClickHouse fails to start up when running a cluster with AquaSec*

In some environments, AquaSec may prevent ClickHouse from starting up correctly. This may manifest as the ClickHouse pod not emitting any logs and failing to get marked as ready.
Generally this is due to `LD_PRELOAD` being set by AquaSec, which interferes with ClickHouse. To resolve this, you can add the following environment variable to your ClickHouse deployment:

Copilot AI Sep 23, 2025

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[nitpick] The explanation could be clearer about what AquaSec is and why this conflict occurs. Consider adding a brief explanation that AquaSec is a security platform that uses LD_PRELOAD to inject security monitoring, which conflicts with ClickHouse's startup process.

Suggested change
Generally this is due to `LD_PRELOAD` being set by AquaSec, which interferes with ClickHouse. To resolve this, you can add the following environment variable to your ClickHouse deployment:
This issue is generally caused by AquaSec, a security platform that uses the `LD_PRELOAD` environment variable to inject security monitoring libraries into running processes. ClickHouse's startup process is incompatible with this kind of dynamic library injection, which can prevent it from starting correctly. To resolve this, you can add the following environment variable to your ClickHouse deployment:

Copilot uses AI. Check for mistakes.
@github-actions

Copy link
Copy Markdown
Contributor

Preview ID generated: preview-infraa-1758642841-8609d75

@langchain-infra
Mukil Loganathan (langchain-infra) merged commit c58d6d6 into main Sep 23, 2025
12 checks passed
@langchain-infra
Mukil Loganathan (langchain-infra) deleted the infra/add-aquasec branch September 23, 2025 15:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

langsmith For docs changes to LangSmith

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants