Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question]: Why is the response in English or garbled when using the Doubao model of ByteDance? There is no problem with other models, such as DeepSeek R1 and DeepSeek V3. #6727

Open
4 tasks
myplxdm opened this issue Apr 1, 2025 · 3 comments
Labels
🙋‍♀️ question Further information is requested

Comments

@myplxdm
Copy link

myplxdm commented Apr 1, 2025

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (Language Policy).
  • Non-english title submitions will be closed directly ( 非英文标题的提交将会被直接关闭 ) (Language Policy).
  • Please do not modify this template :) and fill in all the required fields.

Describe your problem

Why is the response in English or garbled when using the Doubao model of ByteDance? There is no problem with other models, such as DeepSeek R1 and DeepSeek V3.

The following are the logs of Langfuse:

output: "### I. Case Fact Organization and Timeline Restoration

A. For Ye Mou:

  • February - December, February - December , February - December , February - December , February - December , February - December , February - December , February - December , February - December , February - December , year: Invited by Yang Mou with an intention to work at an overseas casino, arranged by Long Mousheng; Ye Mou sneaked across Yunnan border into Myanmar from late Feburary .
    • From Feburary to Decmeber , Ye worked at a fraud den named "Jia Hotel" (phonetic) in Mengneng County, Myanmar; assigned to "Ding Group". Conducted fraud by pretending to be army officers named "Wang Mou" or "Zhang Mochi", adding single women in China through social platforms like Century Jiayuan, Douyin and Momo; gaining their trust through false romantic relationships; then guiding them to invest in a fake platform called "Ya Mo Mo Dai". As a salesman responsible for adding victims as friends and chatting with them directly; Ye earned a profit of RMB$ $ yuan during this period .
    • On April $^{th}$, $$, when entering China at Baiyun Exit-Entry Frontier Inspection Station, Ye was arrested; upon arrival at case handling place he truthfully confessed his crimes of illegally crossing national (border) boundaries and fraud .

B.For Ran Mouzhong:
- In August $$, invited by Li Mobing with an intention to work at an overseas casino under others' arrangements,Ran Mouzhong sneaked across Yunnan border into Myanmar .
- From August $^{}$to Decmeber $^{}$, Ran participated in an overseas telecom network fraud criminal group mentioned above together with Ye Mou etc.,in “Ding Group”. As a salesman,Ran carried out online chat fraud against victims .
- In Decmeber $^{}$, Ran sneaked back from Myanmar into China again .
- On March $^{rd}$, $^{}$, Ran was arrested by public security organs; upon arrival,he truthfully confessed his crimes of illegally crossing national (border) boundaries and fraud .

II.Legal Analysis

A.Crimes Committed:
According to Article $$\text{III}$$.$\text{II}$.$\text{II}$.$\text{II}$ $\text{III}$.$\text{II}$.$\text{II}$ $\text{III}$. $\text{I}$. $\text{I}$. $\text{I}$. $\text{I}$. $\text{I}$. $\text{I}$. $\text{I}$. $\text{Nineteen }$of Criminal Law ($$\mathrm{\left( \mathrm {amended} \mathrm {in} \mathrm { } \right)} $$), both Ye Mou and Ran Mouzhong violated border management regulations by secretly crossing national borders,which meets constitutive elements of crime of illegally crossing national (border) boundaries since they crossed borders without legal procedures,and their acts were considered serious due to engaging in subsequent illegal activities such as telecom network fraud after crossing borders ##6$$ ##7$$ ##8$$ ##9$$$. Also,based on Article $$\mathrm{\left( \mathrm {amended} \mathrm {in} \mathrm { } \right)} $$,$$\cdot\text{Nineteen }$. They used false pretenses like fake identities,fake investment platforms etc.,to defraud domestic residents which conforms crime constitution requirements for crime of fraud,as they had subjective intent to defraud others property rights through false means,causing harm results such as financial losses potentially suffered by victims,so they should be convicted respectively according these two charges simultaneously,and punished accordingly based on combined punishment principles for multiple crimes stipulated by law##6$$ ##7$$ ##8$$ ##9$$$$$.

B.Sentencing Considerations:
For Ran Mouzhong,who was convicted as recidivist according Article $$\cdot\text{Nineteen }$. Since he had been sentenced imprisonment before ($$\cdot\text{Nineteen }$),and committed new crimes punishable imprisonment within five years after completion execution previous sentence,he should be given heavier punishment legally##6$$$$$. While both defendants were regarded as accessory offenders during process committing fraud crime because they played secondary roles within criminal groups,they could get mitigated punishment according relevant laws##6$$$$$. Moreover,both truthfully confessed their crimes after being caught,which met conditions lenient treatment provided law,i.e.,they could get lighter punishment based Article $$\cdot\text{Nineteen }$##6$$$$$. And considering that they voluntarily pleaded guilty accepted punishment,they enjoyed leniency treatment according relevant provisions Criminal Procedure Law ($$\cdot\text{Nineteen }$). Overall,the first instance court comprehensively considered various circumstances defendants when sentencing,and second instance court also affirmed legality rationality first instance judgment after review,safeguarding fairness justice judicial process##7$$$$$."

@myplxdm myplxdm added the 🙋‍♀️ question Further information is requested label Apr 1, 2025
Copy link

dosubot bot commented Apr 1, 2025

The issue with the Doubao model producing responses in English or garbled text might be related to its default language settings. The Doubao model's default language is determined by the environment variable LANG. If "zh_CN" is present in os.getenv("LANG", ""), the default language is set to "Chinese"; otherwise, it defaults to "English" [1].

To address this, you can check and modify the LANG environment variable to ensure it is set to "zh_CN" if you want the output in Chinese. Additionally, you can manually set the language attribute of the Dialog class instance to "Chinese" if needed. This might help resolve the issue with the language output.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@myplxdm
Copy link
Author

myplxdm commented Apr 1, 2025

@dosubot In the yml file, - LANG=zh_CN is configured in the environment: of ragflow, but the output becomes in both Chinese and English. The output is as follows:

output: "### “重庆一中院 ( ( ( ( ( ( ( ) ) ) ) ) )

“重庆一中院 ((()))))))) ((((()) (()))) () () () () () () () (())(())()))))))))))) (())(())()))))))))))) ((()))))))) ((((()) (()))) () () () () () () ((()))))))) ((((()) (()))) ((()))))))) ((()))))))) ”

“(((())(())()))))))))))) ”

“(((())(())()))))))))))) ”

“(((())(())()))))))))))) ”

“(((())(())()))))))))))) ”

“(((())(())()))))))))))) ”

Case Fact Organization and Timeline Restoration

  • In late February **** , Ye was invited by Yang with the purpose of working at an overseas casino , arranged by Long , Ye sneaked across Yunnan border to Myanmar . From February **** to December **** , Ye was assigned to Ding group in a fraud den located at Jia hotel in Mengneng County , Myanmar . He pretended to be an army officer named Wang or Zhang Chichi , added single women in China as friends through social platforms like Century Jiayuan , Douyin , Momo etc., gained their trust through false romantic relationships and then induced them to invest in a fake investment platform called Yaomoudai . As a salesman , Ye specifically engaged in adding victims as friends and chatting with them , making a profit of RMB *** yuan . On April *th **** , Ye was caught when entering China at Baiyun Exit - Entry Frontier Inspection Station . After arriving at case - handling place , he truthfully confessed his acts of illegally crossing national border and fraud .
  • In August **** , Ran was invited by Li Bing with the purpose of working at an overseas casino . Arranged by others , Ran sneaked across Yunnan border to Myanmar through Yunnan border . From August **** to December **** , Ran participated in the above - mentioned overseas telecom network fraud criminal group together with Ye et al., all being in Ding group . As a salesman , Ran carried out online chat fraud against victims . In December **** , Ran sneaked back from Myanmar to China again . On March *th **** , Ran was caught by public security organs ; after arriving at case - handling place he truthfully confessed his acts of illegally crossing national border and fraud too .
  • On December th **** : The Tongnan District People ’s Court made judgment on charges including fraud and illegal crossing national border against Ran Zhongzhong and Ye Moumou according to No. Criminal Judgment [(****) Yu * Xingchu ***].
  • After that : Defendant Ran Zhongzhong refused to accept this judgment thus appealed ; Chongqing First Intermediate People ’s Court accepted this appeal case later formed collegial panel decided not hold court session after reviewing files interrogating appellant due clear facts determination during trial process hereof finally made final ruling hereinafter based upon review results thereof hereinafter accordingly so forth so on etc..
  • On March *th **** : Chongqing First Intermediate People ’s Court made final ruling hereinbelow namely rejecting appeal maintaining original judgment hereof finally ending this second instance trial procedure hereof accordingly so forth so on etc..

Legal Analysis

  • According to Article *** Section III Crimes Against Management Of National Borders Chapter VI Offenses Against Social Administration Order Part II Specific Provisions Criminal Law Of PRC [^***], both Ye Moumou ’s act from late February *** sneaking across national border into Myanmar then back until April *th *** being caught when entering China again & Ran Zhongzhong ’s act from August *** sneaking across national border into Myanmar then back until March *th *** being caught when entering China again violated relevant regulations regarding management over national borders which belongs illegal crossing national borders behavior reaching serious circumstances level thus constituting crime of illegally crossing national borders respectively [^***]. And they should be punished according provisions thereof such as imprisonment within one year or criminal detention or control plus fine payment etc.. Considering their confession attitude after being caught which can be regarded as leniency circumstance during sentencing process according relevant laws regulations judicial interpretations etc..
  • According Article *** Fraud Crime Chapter IV Crimes Of Infringing Upon Citizens’ Personal Rights And Democratic Rights Part II Specific Provisions Criminal Law Of PRC [^***], both defendants’ behaviors during period from February / August *** respectively until December *** carrying out telecom network fraud activities targeting domestic residents via pretending identities inducing investment via fake platforms belong fraudulent behaviors reaching serious circumstances level thus constituting crime of fraud respectively [^***]. They should be punished according provisions thereof such as imprisonment between three years & ten years plus fine payment etc.. Considering they played secondary role during joint crime process which belongs mitigating circumstance ; also considering their confession attitude after being caught which belongs leniency circumstance during sentencing process according relevant laws regulations judicial interpretations etc..
  • Regarding defendant Ran Zhongzhong who had been sentenced life imprisonment due intentional crimes before released from prison on February *nd *** then committed new crimes within five years since release date meeting conditions defined by Article *** Recidivism Chapter IV Penalty Application Part I General Provisions Criminal Law Of PRC [^***], should be given heavier punishment compared non - recidivist under same circumstances during sentencing process accordingly so forth so on etc..
  • During second instance trial stage appellant Ran Zhongzhong claimed coercion participation without profit gain heavy sentence imposed originally however evidence collected including stable confessions made by himself during investigation stage statements provided by related persons proved that he knew clearly about engaging fraudulent activities yet actively participated therein without evidence proving coercion participation claim ; original judgment comprehensively considered various factors such as nature harm degree recidivism accessory offender confession attitude thus imposing penalty already taking mitigation factors into account showing appropriate penalty decision no improperness existing therefore appellate reasons put forward were not established rejected finally maintaining original judgment correctly legally reasonably justly objectively impartially appropriately timely efficiently effectively orderly smoothly successfully perfectly completely entirely thoroughly fully adequately sufficiently properly correctly accurately precisely exactly strictly severely harshly gently softly mildly moderately fairly equitably evenly proportionally rationally logically coherently consistently systematically methodically orderly neatly tidily cleanly clearly vividly lively interestingly attractively appealingly charmingly fascinatingly enchantingly magically wonderfully marvelously amazingly astonishingly incredibly unbelievably surprisingly shockingly alarmingly terrifyingly frighteningly horribly awfully terribly badly poorly inadequately insufficiently improperly incorrectly inaccurately imprecisely inexactly loosely roughly approximately generally commonly usually typically ordinarily normally regularly frequently often sometimes occasionally seldom rarely hardly scarcely never ever always forever permanently temporarily briefly shortly instantly immediately promptly quickly rapidly swiftly speedily slowly gradually steadily continuously constantly incessantly repeatedly alternately alternatively randomly arbitrarily optionally selectively deliberately intentionally consciously unconsciously accidentally incidentally unexpectedly fortunately unfortunately luckily unluckily hopefully hopelessly probably possibly presumably presumably apparently obviously evidently clearly undoubtedly certainly surely definitely positively negatively neutrally objectively subjectively emotionally rationally irrationally logically illogically coherently inconsistently systematically unsystematically methodically unmethodically orderly disorderly neatly messily clean dirty tidy untidy fresh stale new old young old big small large small long short tall short high low wide narrow thick thin fat thin heavy light fast slow hot cold warm cool dry wet sunny rainy cloudy windy snowy foggy clear unclear bright dark dull shiny matte smooth rough hard soft sharp blunt strong weak powerful powerless rich poor wealthy poor healthy sick ill well good bad excellent terrible wonderful awful great horrible nice ugly beautiful ugly smart stupid intelligent foolish clever dull wise unwise knowledgeable ignorant experienced inexperienced skilled unskilled trained untrained qualified unqualified professional amateur formal informal official unofficial public private open closed secret hidden visible invisible audible inaudible tangible intangible real imaginary true false right wrong correct incorrect accurate inaccurate precise imprecise exact inexact legal illegal legitimate illegitimate moral immoral ethical unethical honest dishonest fair unfair just unjust reasonable unreasonable rational irrational logical illogical coherent incoherent systematic unsystematic methodical unmethodical orderly disorderly neat messy clean dirty tidy untidy fresh stale new old young old big small large small long short tall short high low wide narrow thick thin fat thin heavy light fast slow hot cold warm cool dry wet sunny rainy cloudy windy snowy foggy clear unclear bright dark dull shiny matte smooth rough hard soft sharp blunt strong weak powerful powerless rich poor wealthy poor healthy sick ill well good bad excellent terrible wonderful awful great horrible nice ugly beautiful ugly smart stupid intelligent foolish clever dull wise unwise knowledgeable ignorant experienced inexperienced skilled unskilled trained untrained qualified unqualified professional amateur formal informal official unofficial public private open closed secret hidden visible invisible audible inaudible tangible intangible real imaginary true false right wrong correct incorrect accurate inaccurate precise imprecise exact inexact legal illegal legitimate illegitimate moral immoral ethical unethical honest dishonest fair unfair just unjust reasonable unreasonable rational irrational logical illogical coherent incoherent systematic unsystematic methodical unmethodical orderly disorderly neat messy clean dirty tidy untidy fresh stale new old young old big small large small long short tall short high low wide narrow thick thin fat thin heavy light fast slow hot cold warm cool dry wet sunny rainy cloudy windy snowy foggy clear unclear bright dark dull shiny matte smooth rough hard soft sharp blunt strong weak powerful powerless rich poor wealthy poor healthy sick ill well good bad excellent terrible wonderful awful great horrible nice ugly beautiful ugly smart stupid intelligent foolish clever dull wise unwise knowledgeable ignorant experienced inexperienced skilled unskilled trained untrained qualified unqualified professional amateur formal informal official unofficial public private open closed secret hidden visible invisible audible inaudible tangible intangible real imaginary true false right wrong correct incorrect accurate inaccurate precise imprecise exact inexact legal illegal legitimate illegitimate moral immoral ethical unethical honest dishonest fair unfair just unjust reasonable unreasonable rational irrational logical illogical coherent incoherent systematic unsystematic methodical umethodical orderly disorderl"

Copy link

dosubot bot commented Apr 1, 2025

The issue you're experiencing with mixed-language output in the Doubao model, despite setting LANG=zh_CN, might be related to how the model processes language settings internally. The Doubao model uses the LANG environment variable to determine the default language, setting it to "Chinese" if "zh_CN" is detected [1]. However, if the output is still mixed or garbled, it could be due to other factors such as:

  1. Language Code Conversion: The gen_lang method in the agent/component/rewrite.py file is responsible for converting language codes to language names. Ensure that the language code is correctly mapped to "Chinese" in this method [2].

  2. Character Encoding: Check if there are any character encoding issues in the input or output data that might cause garbled text.

  3. Model Configuration: Verify if there are any other configurations or settings in the model that might override the language settings.

  4. Dependencies: Ensure that all dependencies and libraries used by the model are correctly installed and configured, as they might influence language processing.

If these steps do not resolve the issue, further investigation into the model's codebase and configurations might be necessary to identify any underlying problems.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🙋‍♀️ question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant