This is a collection of the extracted narratives from TED talks, that has been parsed and cleaned.
TED is an incredible organization that has brought stunning stories about the human race, its evolution, its advancements and challenges to the masses. And, I want to help spread these stories. (BTW, thank you Chris for changing our world!)
With over 2500 (at the time of this writing) talks, TED has recorded over an incredible 34500 minutes (give or take), which is 24 days of listening/viewing.
Unlike A/V files, text has few advantages:
- Reading is faster than listening.
- I can search text to find patterns, and then use those results to find more info.
- We are way better technologically at organizing and extracting nuggets from text than from A/V.
What is more interesting to me is how this can help not only in spreading the word, but interesting story telling products on top of this data.
For instance, here are few ideas, some of which I am currently exploring.
- we can build a visualization or a query engine which is connected to Google's knowledge graph and presents relevant contextual information.
- we can extract summaries of these talks, or create versions of these stories for children.
- use NLP to understand the anatomy of telling good stories by exploring the grammar of what constitutes good stories.
- ...
There are a lot of things we can do with it. Let's do it.
- I am in the process of aggregating other story telling datasets, starting with TEDx and TEDed. It will be added to this repo.
- Various NLP and data viz scripts (Though, I am not completely convinced they should be part of this repo.)
Spread the story, build cool stuff using this data, contribute data or scripts to this repository, parse this in interesting ways, help spread stories that inspire, make the world a better place...you get it.
Issues, PRs welcome.
- The folder structure is weird because Github only allows 1000 files per folder. So, I tried to logically break the folders in alphabetical order.
- I will add a Table of contents at the root data folder for easy navigation along with a source JSON that has metadata for a talk.
And, be sure to watch this space :)