forked from VishnuDileesh/NewsScrape
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
7ef4a68
commit 2be0d55
Showing
1 changed file
with
10 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,10 @@ | ||
# NewsScrape | ||
### Personal Project built on Python, using Flask and Newspaper3k | ||
|
||
I love reading cyber tech news, and i wanted to create a single web page to skim through all the latest cyber sec news from more than one hacking news sites. | ||
I decided to build a web scraper which would go and check through the site links provided, and will get the latest articles links using BeautifulSoup. | ||
The links are passed through Newspaper3k to grab the title and author of every article. | ||
Newspaper3k is used along Natural Language Processing function to create a summary of the complete article. | ||
All the individually scraped articles are stored in the sqlite3 database. | ||
Python Flask web app will grab the data from the database and display the articles title, author and summary of all the articles from the passed in site urls scraped in above step and saved to the db. | ||
Scraping function is set to run every day at 12:00 AM using the Schedule package. |