Idea: Remote Search on a local peer could search solr index as well

[okybaca]

If I understand it well, when a remote search is done on a local peer, only RWI index is searched.

The remote search could search also in solr index, which, in many cases, can be larger and is designed as a permanent. RWI index entry would be created after the search, so it could be distributed by DHT-OUT later.

RWI index is shrinking on each host, so older links are unreachable by search (and available for local search). Some people delete RWIs from reasons like memory-consuption or speed as well.

Impact:

• all the pages indexed on a local host would be available for remote search
• most popular queries would be distributed by DHT-out and available on more instances