Any plans to configure for Scrapy middleware like V1?

[Swordyjohn]

I use incapsula cracker alot and its great script, it would be nice to incorporate it into scrapy as a middleware, are there any plans to do so? Please let me know.

[johndoe11111]

Do you use bypass_crack=True flag? it depends..

[Swordyjohn]

Hello Johndoe11111, no i am not using bypass_crack=True, just running incapsula-cracker-py3 to generate the session, then getting the url. I am, trying to reverse engineer this to be a scrapy middleware right now, any pointers?

[johndoe11111]

The thing is I don't see how it manages to bypass Incapsula with the bypass_crack=False, since when I try to run it as described in the main page of this repository I get an error that says 'max retries exceeded when attempting to crack incapsula'.
Could you write a small snippet of how you run it?

[jvv8]

Excited about this package, but saddened that Scrapy middleware is no longer supported.
What are the challenges to implementing the Scrapy middleware in python 3 as was done in 2.7?
If not, are there any working examples with a parameterized class that emulate calls such as:

scrapy crawl MySpider -a queries="something to search for" -o- -t json

[caffeinatedMike]

I would very much appreciate having the Scrapy Middleware capability as well!

[frapercan]

great work, but I were also looking for the Scrapy Middleware capability.

Let's see what can I do