Support "SpaceAfter=No" for Untokenized Text

[KoichiYasuoka]

Support "SpaceAfter=No" for Untokenized Text

[BramVanroy]

Probably should test whether the .whitespace_ attribute is present in stanfordnlp because otherwise this might break the module.

[KoichiYasuoka]

import stanfordnlp
from spacy_stanfordnlp import StanfordNLPLanguage
en=StanfordNLPLanguage(stanfordnlp.Pipeline(lang="en"))
s=en("Yes, it's on-going.")
for t in s:
  print("\t".join([str(t.i+1),t.orth_,t.lemma_,t.pos_,t.tag_,"_",str(0 if t.head==t else t.head.i+1),t.dep_,"_","_" if t.whitespace_ else "SpaceAfter=No"]))

The script shown above worked well in my Linux (Debian), and produced CONLL below.

1	Yes	yes	INTJ	UH	_	7	discourse	_	SpaceAfter=No
2	,	,	PUNCT	,	_	7	punct	_	_
3	it	it	PRON	PRP	_	7	nsubj	_	SpaceAfter=No
4	's	be	AUX	VBZ	_	7	cop	_	_
5	on	on	ADV	RB	_	7	advmod	_	SpaceAfter=No
6	-	-	PUNCT	HYPH	_	7	punct	_	SpaceAfter=No
7	going	go	VERB	VBG	_	0	root	_	SpaceAfter=No
8	.	.	PUNCT	.	_	7	punct	_	SpaceAfter=No

[BramVanroy]

LGTM, thanks!