| title | created | modified |
|---|---|---|
web scraping logic |
2022-12-13T18:15:41.589Z |
2022-12-13T18:18:21.103Z |
select targets for scraping. it could be your browsing history, package indexs, social media (dynamic contents, with different accessing methods than web scraping)
if not accessible, access it with proxies, cookies.
finally store the content into compat and usable formats, categorized and linked