diff --git a/docs/en/stack/monitoring/how-monitoring-works.asciidoc b/docs/en/stack/monitoring/how-monitoring-works.asciidoc deleted file mode 100644 index e11f402e3..000000000 --- a/docs/en/stack/monitoring/how-monitoring-works.asciidoc +++ /dev/null @@ -1,43 +0,0 @@ -[role="xpack"] -[[how-monitoring-works]] -== How monitoring works - -Monitoring collects data from {es} nodes, Logstash nodes, and {kib} instances. - -In general, the {es} cluster you are monitoring controls where the monitoring -metrics for the stack are stored. By default, they are stored in local indices. - -TIP: In production, we strongly recommend using a separate monitoring -Elasticsearch cluster. Using a separate monitoring cluster -prevents production cluster outages from impacting your ability to access your -monitoring data. It also prevents monitoring activities from impacting the -performance of your production cluster. For the same reason, we also -recommend to use a separate Kibana instance that is connected to the separate -monitoring cluster. - -The following diagram illustrates a typical monitoring architecture with separate -production and monitoring clusters: - -image::monitoring/images/architecture10.png["A typical monitoring environment"] - -In 6.4 and later, you can use {metricbeat} to collect and ship data about -{kib}, rather than routing it through {es}. In 6.5 and later, you can also use -{metricbeat} to collect and ship data about {es}. For example: - -image::monitoring/images/architecture20.png[A typical monitoring environment that includes {metricbeat}] - -If you have at least a gold license, you can route data from multiple production -clusters to a single monitoring cluster. For more information about the -differences between various subscription levels, see: https://www.elastic.co/subscriptions - -IMPORTANT: In general, the monitoring cluster and the clusters being monitored -should be running the same version of the stack. A monitoring cluster cannot -monitor production clusters running newer versions of the stack. If necessary, -the monitoring cluster can monitor production clusters running the latest -release of the previous major version. - -If you use {kib} to visualize data and administer the cluster, you might want to -create a dedicated {kib} instance for monitoring, rather than using a single -{kib} instance to access both your production cluster and monitoring cluster: - -image::monitoring/images/architecture30.png["A separate {kib} instance accesses the monitoring cluster"] diff --git a/docs/en/stack/monitoring/index.asciidoc b/docs/en/stack/monitoring/index.asciidoc index da045a734..faa5e9a3a 100644 --- a/docs/en/stack/monitoring/index.asciidoc +++ b/docs/en/stack/monitoring/index.asciidoc @@ -1,4 +1,2 @@ include::intro.asciidoc[] -include::how-monitoring-works.asciidoc[] -include::production.asciidoc[] include::esms.asciidoc[] diff --git a/docs/en/stack/monitoring/intro.asciidoc b/docs/en/stack/monitoring/intro.asciidoc index 0231a15b3..514c7a494 100644 --- a/docs/en/stack/monitoring/intro.asciidoc +++ b/docs/en/stack/monitoring/intro.asciidoc @@ -14,9 +14,7 @@ can set up custom alerts based on the data in the monitoring indices. For more information, see: -* <> -* <> -* {ref}/es-monitoring.html[Monitoring {es}] +* {ref}/monitor-elasticsearch-cluster.html[Monitor a cluster] * {kibana-ref}/xpack-monitoring.html[Monitoring {kib}] * {logstash-ref}/monitoring-logstash.html[Monitoring Logstash] * Monitoring Beats: diff --git a/docs/en/stack/monitoring/production.asciidoc b/docs/en/stack/monitoring/production.asciidoc deleted file mode 100644 index 2efa337a3..000000000 --- a/docs/en/stack/monitoring/production.asciidoc +++ /dev/null @@ -1,127 +0,0 @@ -[role="xpack"] -[[monitoring-production]] -== Monitoring in a production environment - -By default, monitoring agents store data in the cluster where they're running. -In production, you should -send data to a separate _monitoring cluster_ so that historical monitoring -data is available even when the nodes you are monitoring are not. If you are -sending your data to the ESMS, see <>. - -In 6.4 and later, you can use {metricbeat} to ship monitoring data about -{kib} to a separate monitoring cluster. In 6.5 and later, you can do the same -for {es}. - -If you have at least a gold license, using a dedicated monitoring cluster also -enables you to monitor multiple clusters from a central location. - -To store monitoring data in a separate cluster: - -. Set up the {es} cluster you want to use as the monitoring cluster. -For example, you might set up a two host cluster with the nodes `es-mon-1` and -`es-mon-2`. -+ --- -[IMPORTANT] -=============================== -* To monitor an {es} 7.x cluster, you must run {es} -7.x on the monitoring cluster. -* There must be at least one {ref}/ingest.html[ingest node] in the monitoring -cluster; it does not need to be a dedicated ingest node. -=============================== --- - -.. (Optional) Verify that the collection of monitoring data is disabled on the -monitoring cluster. By default, the `xpack.monitoring.collection.enabled` setting -is `false`. -+ --- -For example, you can use the following APIs to review and change this setting: - -[source,js] ----------------------------------- -GET _cluster/settings - -PUT _cluster/settings -{ - "persistent": { - "xpack.monitoring.collection.enabled": false - } -} ----------------------------------- -// CONSOLE --- - -.. If the {es} {security-features} are enabled on the monitoring cluster, create -users that can send and retrieve monitoring data. -+ --- -NOTE: If you plan to use {kib} to view monitoring data, username and password -credentials must be valid on both the {kib} server and the monitoring cluster. - --- - -*** If you plan to use {metricbeat} to collect data about {es} or {kib}, -create a user that has the `remote_monitoring_collector` built-in role and a -user that has the `remote_monitoring_agent` -<>. Alternatively, use the -`remote_monitoring_user` <>. - -*** If you plan to use HTTP exporters to route data through your production -cluster, create a user that has the `remote_monitoring_agent` -<>. -+ --- -For example, the -following request creates a `remote_monitor` user that has the -`remote_monitoring_agent` role: - -[source, sh] ---------------------------------------------------------------- -POST /_security/user/remote_monitor -{ - "password" : "changeme", - "roles" : [ "remote_monitoring_agent"], - "full_name" : "Internal Agent For Remote Monitoring" -} ---------------------------------------------------------------- -// CONSOLE -// TEST[skip:needs-gold+-license] - -Alternatively, use the `remote_monitoring_user` <>. --- - -. Configure your production cluster to collect data and send it to the -monitoring cluster. - -** {ref}/configuring-metricbeat.html[Use {metricbeat}]. This option -is available in 6.5 and later versions. - -** {ref}/configuring-monitoring.html[Use HTTP exporters]. - -. (Optional) -{logstash-ref}/configuring-logstash.html[Configure {ls} to collect data and send it to the monitoring cluster]. -+ --- -NOTE: You must configure HTTP exporters in the production cluster to route this -data to the monitoring cluster. It cannot be accomplished by using {metricbeat}. - --- - -. (Optional) Configure {kib} to collect data and send it to the monitoring cluster: - -** {kibana-ref}/monitoring-metricbeat.html[Use {metricbeat}]. This -option is available in 6.4 and later versions. - -** {kibana-ref}/monitoring-kibana.html[Use HTTP exporters]. - -. (Optional) Create a dedicated {kib} instance for monitoring, rather than using -a single {kib} instance to access both your production cluster and monitoring -cluster. - -.. (Optional) Disable the collection of monitoring data in this {kib} instance. -Set the `xpack.monitoring.kibana.collection.enabled` setting to `false` in the -`kibana.yml` file. For more information about this setting, see -{kibana-ref}/monitoring-settings-kb.html[Monitoring settings in {kib}]. - -. {kibana-ref}/monitoring-data.html[Configure {kib} to retrieve and display the monitoring data]. diff --git a/docs/en/stack/monitoring/troubleshooting.asciidoc b/docs/en/stack/monitoring/troubleshooting.asciidoc deleted file mode 100644 index f4e2ccf69..000000000 --- a/docs/en/stack/monitoring/troubleshooting.asciidoc +++ /dev/null @@ -1,21 +0,0 @@ -[[monitoring-troubleshooting]] -== Troubleshooting monitoring -++++ -Monitoring -++++ - -See also -{logstash-ref}/monitoring-troubleshooting.html[Troubleshooting monitoring in {ls}]. - -*Symptoms*: -There is no information about your cluster on the *Stack Monitoring* page in -{kib}. - -*Resolution*: -Check whether the appropriate indices exist on the monitoring cluster. For -example, use the {ref}/cat-indices.html[cat indices] command to verify that -there is a `.monitoring-kibana*` index for your {kib} monitoring data and a -`.monitoring-es*` index for your {es} monitoring data. If you are collecting -monitoring data by using {metricbeat} the indices have `-mb` in their names. If -the indices do not exist, review your configuration: <>. - diff --git a/docs/en/stack/redirects.asciidoc b/docs/en/stack/redirects.asciidoc index b2e8721bc..2f007afd5 100644 --- a/docs/en/stack/redirects.asciidoc +++ b/docs/en/stack/redirects.asciidoc @@ -448,3 +448,21 @@ This page has moved. This page has moved. See {ref}/separating-node-client-traffic.html[Separating node-to-node and client traffic]. + +[role="exclude",id="how-monitoring-works"] +=== How monitoring works + +This page has moved. +See {ref}/monitoring-production.html[Monitoring in a production environment]. + +[role="exclude",id="monitoring-production"] +=== Monitoring in a production environment + +This page has moved. +See {ref}/how-monitoring-works.html[How monitoring works]. + +[role="exclude",id="monitoring-troubleshooting"] +=== Troubleshooting monitoring + +This page has moved. +See {ref}/monitoring-troubleshooting.html[Troubleshooting monitoring]. \ No newline at end of file diff --git a/docs/en/stack/troubleshooting.asciidoc b/docs/en/stack/troubleshooting.asciidoc index 07accd7f5..fac7104dd 100644 --- a/docs/en/stack/troubleshooting.asciidoc +++ b/docs/en/stack/troubleshooting.asciidoc @@ -8,7 +8,6 @@ Having trouble? Here are solutions to common problems you might encounter. * <> * <> -* <> * <> * <> @@ -35,6 +34,4 @@ GET /_xpack include::security/troubleshooting.asciidoc[] -include::monitoring/troubleshooting.asciidoc[] - include::ml/anomaly-detection/troubleshooting.asciidoc[]