Skip to content

Commit

Permalink
Create README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
VishnuDileesh authored Feb 3, 2020
1 parent 7ef4a68 commit 2be0d55
Showing 1 changed file with 10 additions and 0 deletions.
10 changes: 10 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
# NewsScrape
### Personal Project built on Python, using Flask and Newspaper3k

I love reading cyber tech news, and i wanted to create a single web page to skim through all the latest cyber sec news from more than one hacking news sites.
I decided to build a web scraper which would go and check through the site links provided, and will get the latest articles links using BeautifulSoup.
The links are passed through Newspaper3k to grab the title and author of every article.
Newspaper3k is used along Natural Language Processing function to create a summary of the complete article.
All the individually scraped articles are stored in the sqlite3 database.
Python Flask web app will grab the data from the database and display the articles title, author and summary of all the articles from the passed in site urls scraped in above step and saved to the db.
Scraping function is set to run every day at 12:00 AM using the Schedule package.

0 comments on commit 2be0d55

Please sign in to comment.