Correct rebuilt persian analyzer (#38724) (#38744) (#39250)

benwtrent · web-flow · commit 4a8d18ba0c67 · 2019-02-21T09:37:45.000-06:00
Make substitution of \u200C with a space explicit The problem with this symbol `\u200C` in a test string, that **SHOULD** be substituted with space in the rebuilt Persian analyzer, but it is not. Correcting this line `"mappings": [ "\\u200C=> "] <1>` to `"mappings": [ "\\u200C=>\\u0020"] <1>` in solves the problem. This change explicitly says to substitute ZWNJ with a space. Closes #38188
diff --git a/docs/reference/analysis/analyzers/lang-analyzer.asciidoc b/docs/reference/analysis/analyzers/lang-analyzer.asciidoc
@@ -1358,7 +1358,7 @@ PUT /persian_example
       "char_filter": {
         "zero_width_spaces": {
             "type":       "mapping",
-            "mappings": [ "\\u200C=> "] <1>
+            "mappings": [ "\\u200C=>\\u0020"] <1>
         }
       },
       "filter": {

Original file line number	Diff line number	Diff line change
`@@ -1358,7 +1358,7 @@ PUT /persian_example`
`1358`	`1358`	`"char_filter": {`
`1359`	`1359`	`"zero_width_spaces": {`
`1360`	`1360`	`"type": "mapping",`
`1361`		`- "mappings": [ "\\u200C=> "] <1>`
	`1361`	`+ "mappings": [ "\\u200C=>\\u0020"] <1>`
`1362`	`1362`	`}`
`1363`	`1363`	`},`
`1364`	`1364`	`"filter": {`