New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Detect automatically what is the type of document that will be parsed. #194

Open

Urahara opened this issue Jun 12, 2020 · 1 comment · May be fixed by #234

Labels

Urahara commented Jun 12, 2020

Today when user don't provide a type on construct we always fallback to html parser type.

parsel/parsel/selector.py

Lines 38 to 42 in 7ed4b24

    
           def _st(st): 
        
               if st is None: 
        
                   return 'html' 
        
               elif st in _ctgroup: 
        
                   return st

The text was updated successfully, but these errors were encountered:

Gallaecio added the enhancement label

shivamshan linked a pull request

that will close this issue

modified _st function to detect doc type #234

Open

Member

Gallaecio commented Mar 2, 2022

I wonder if we should be using https://github.com/scrapy/xtractmime to implement this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment