HtmlWeb.Load not work correct

[Risbot]

Here is what to include in your request to make sure we implement a solution as quickly as possible.

1. Description

I can not parse web https://www.seznam.cz using HtmlWeb I see unreadable html content, because I get compresed content. In header of the response I see this:

TransferEncoding: {chunked}
TransferEncodingChunked: true

2. Fiddle or Project

https://dotnetfiddle.net/UpHU4w

[JonathanMagnan]

Hello @Risbot ,

Thank you for reporting, we will look to add an option for the decompression. We quickly tested it with your page and it worked.

Best Regards,

Jon

---

Sponsorship
Help us improve this library

Performance Libraries
context.BulkInsert(list, options => options.BatchSize = 1000);
Entity Framework Extensions • Bulk Operations • Dapper Plus

Runtime Evaluation
Eval.Execute("x + y", new {x = 1, y = 2}); // return 3
C# Eval Function • SQL Eval Function

[JonathanMagnan]

Hello @Risbot ,

The v1.11.38 has been released.

We added the option HtmlWeb.AutomaticDecompression in this version.

You can use this option this way:

 var html = @"https://www.seznam.cz/";
HtmlWeb web = new HtmlWeb();
web.AutomaticDecompression = DecompressionMethods.GZip;
var htmlDoc = web.Load(html);
var t = htmlDoc.DocumentNode.InnerHtml;

Let me know if everything is now working for your scenario.

Best Regards,

Jon

[Risbot]

Hello @JonathanMagnan thank you for your great work. Now it work good.

[JonathanMagnan]

Awesome @Risbot !

Don't hesitate to contact us with any questions, issues, or assistance!

Bets Regards,

Jon