Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LATEX Extractor #29643

Closed
boyen-cell opened this issue Nov 2, 2023 · 3 comments
Closed

LATEX Extractor #29643

boyen-cell opened this issue Nov 2, 2023 · 3 comments
Labels
Idea-Enhancement New feature or request on an existing product Needs-Author-Feedback The original author of the issue/PR needs to come back and respond to something Product-Text Extractor This refers to the Text Extractor PowerToy

Comments

@boyen-cell
Copy link

Description of the new feature / enhancement

Similar to Text Extractor, but it would read in a LATEX equation and paste the respective LATEX into clipboard

Example:
Website shows
M R S = α 1 α ( x 2 x 1 ) 1 r

Then eg WIN+SHIFT+L opens the screenshot UI, user creates a rectangle around the equation and
"$MRS={\alpha \over {1-\alpha}} ({x_2 \over x_1})^{1-r}$" gets pasted into the clipboard

Scenario when this would be used?

When needing to copy already rendered LATEX.

Supporting information

No response

@boyen-cell boyen-cell added the Needs-Triage For issues raised to be triaged and prioritized by internal Microsoft teams label Nov 2, 2023
@davidegiacometti davidegiacometti added Idea-Enhancement New feature or request on an existing product Product-Text Extractor This refers to the Text Extractor PowerToy labels Nov 2, 2023
@TheJoeFin
Copy link
Collaborator

I would love to enable this, but building our own models is beyond the scope of this project. If you can suggest an alternative then this will remain open, but otherwise I will close this as Not Planned. /needinfo

@microsoft-github-policy-service microsoft-github-policy-service bot added Needs-Author-Feedback The original author of the issue/PR needs to come back and respond to something and removed Needs-Triage For issues raised to be triaged and prioritized by internal Microsoft teams labels Nov 5, 2023
@boyen-cell
Copy link
Author

I've found this online service that recognizes hand-written formulas really well
https://webdemo.myscript.com/

For already rendered LaTeX I found the following github project:
https://github.com/lukas-blecher/LaTeX-OCR
However, I have no idea at all whether it would be easy to merge eg the lukas-blecher/LaTeX-OCR project with PowerToys -- sorry if this actually seems completely infeasible.

(https://tex.stackexchange.com/questions/116863/image-equation-to-tex here are other github projects about LaTeX OCR as well)

@boyen-cell boyen-cell reopened this Nov 5, 2023
@TheJoeFin
Copy link
Collaborator

Unfortunately, all of those tools are either

  1. Python based with no C# support
  2. Send data to the cloud for process (no go)

Again, I would love to add this feature, but today the available models for this application just don't fit. I am going to close this issue because of these reasons, but if a C# compatible, on device model becomes freely available please reopen.

@TheJoeFin TheJoeFin closed this as not planned Won't fix, can't repro, duplicate, stale Nov 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Idea-Enhancement New feature or request on an existing product Needs-Author-Feedback The original author of the issue/PR needs to come back and respond to something Product-Text Extractor This refers to the Text Extractor PowerToy
Projects
None yet
Development

No branches or pull requests

3 participants