You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We've discussed using the SCRAPER category to indicate crawlers that are just downloading any data on the internet for their various business use case. However, SCRAPER could be used to describe anything on the list so maybe we want something like DATA_COLLECTION or something else that they are strictly ingesting data for no particular public-facing purpose.
The text was updated successfully, but these errors were encountered:
We've discussed using the
SCRAPER
category to indicate crawlers that are just downloading any data on the internet for their various business use case. However,SCRAPER
could be used to describe anything on the list so maybe we want something likeDATA_COLLECTION
or something else that they are strictly ingesting data for no particular public-facing purpose.The text was updated successfully, but these errors were encountered: