shodan struggles with multiple queries

[bongobongoland]

In the queries file for shodan I have about 100 similar requests. I can cram them all into a single query and shodan works (slowly) just fine but if brake them up into shorter queries, the module struggles:

As you can see, shodan returns 503 and 429.

# number of times to retry a failed request
retry: 10

^^^
I have edited the config file to try to address the issue but the edit seems to be irrelevant in this particular case. Basically, in order to extract all results I have to pack multiple requests into a single one.

[ehsandeep]

@bongobongoland Can you retry with the latest release? new changes were made to ensure to have a default rate limit for all sources.

uncover/sources/session.go

Lines 16 to 19 in a3800a0

	// DefaultRateLimits of all/most of sources are hardcoded by default to improve performance
	// engine is not present in default ratelimits then user given ratelimit from cli options is used
	var DefaultRateLimits = map[string]*ratelimit.Options{
	"shodan": {Key: "shodan", MaxCount: 1, Duration: time.Second},

[ehsandeep]

also looks it was an issue because of - #188

[bongobongoland]

I confirm. The issue has been fixed. thanks!