Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Arabic fallback shaping #63

Open
floppyhammer opened this issue Jan 7, 2023 · 8 comments
Open

Support Arabic fallback shaping #63

floppyhammer opened this issue Jan 7, 2023 · 8 comments

Comments

@floppyhammer
Copy link

floppyhammer commented Jan 7, 2023

Test text:
ح ب ا حبا
It consists of two parts (separated with a space):
حبا
ح ب ا
The second part is basically the first part with every character delimited with space (in order to cancel ligatures).

Related buffer config:

buffer.set_direction(rustybuzz::Direction::RightToLeft);
buffer.set_language(rustybuzz::Language::from_str("ar").unwrap());
buffer.set_script(rustybuzz::script::ARABIC);

Test case 1 (unifont-15.0.01.ttf)
Shaped glyph id:
harfbuzz 56721 56725 56237 35 56720 35 56722 35 56740
rustybuzz 1578 1579 1584 35 1578 35 1579 35 1584

So firstly, I had tested with unifont, and rustybuzz failed to handle the ligatures. I thought I must had got something wrong, but then I tested with another font.

Test case 2 (HONORSansArabicUI-B.ttf)
Shaped glyph id:
harfbuzz 7 33 97 1 5 1 30 1 93
rustybuzz 7 33 97 1 5 1 30 1 93

And the result is correct and conforms to that of harfbuzz.

There might be something off with rustybuzz.

@behdad
Copy link
Member

behdad commented Jan 7, 2023

It is probably because Unifont doesn't have OpenType shaping rules for Arabic, and HarfBuzz synthesizes those, implementing fallback Arabic shaping, which rustybuzz currently doesn't. This is documented behavior.

@behdad
Copy link
Member

behdad commented Jan 7, 2023

From README:

  • No Arabic fallback shaper, since it requires subsetting.

@floppyhammer
Copy link
Author

@behdad Thanks for the answer! I didn't realize that.

@RazrFalcon
Copy link
Collaborator

Yes, this particular feature is not implemented. I wasn't expecting it to be that common. I guess I would have to figure it out after all.

@LaurenzV
Copy link
Collaborator

Could you further explain why implementing this requires subsetting? I don't understand how a shaping feature would require implementing subsetting?

@RazrFalcon
Copy link
Collaborator

It doesn't "require" subsetting per se, but it requires part of it. At least this is how it is implemented in HB.
I do not remember details, it was nearly 5 years ago, but I assume this is hb-ot-shaper-arabic-fallback.hh. And as you can see HB creates temporary tables using subsetting code and them passes them to the shaper.
Meaning we have to implement this part of subsetting as well.

@behdad
Copy link
Member

behdad commented Jun 30, 2024

It needs the code to serialize SingleSubst and LigatureSubst tables. Alternatively you can implement the logic in code...

@LaurenzV
Copy link
Collaborator

Good to know, thanks! I guess it should be doable...

@khaledhosny khaledhosny changed the title Different shaping results compared to harfbuzz Support Arabic fallback shaping Oct 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants