CS341
Project in Mining Massive Data Sets
Spring 2018
When dealing with these datasets please be careful and responsible. The datasets are meant to be used strictly for the purposes of the class project and nothing else. This means: (1) Do not do anything ''funny'' with the dataset; (2) Do not try to break the anonymization; (3) Do not share that data outside the class; (4) do not copy the data off the Amazon EC2; (4) After the class is over destroy all data.
Stanford CS341 only datasets
- See the slides from the info session for more information about what datasets are available to work with.
Other datasets
- New: Traffice and weather data from Didi (Didi Chuxing). The dataset is available at this but is password protected.Please contact the course staff for username and password details.
- New: Jasper Ridge Biological Preserve 200,000 images of motion-triggered day-and-night photos of animals in the Preserve, and terabytes of ultrasound recordings to identify bats. More information is available here.
- DBpedia. Richly labeled network containing extracted
data from Wikipedia (based on infoboxes). Labeled network of multiple
types of nodes and edges
About 2.6 million concepts described by 247 million triples, including
abstracts in 14 different languages. http://dbpedia.org. Some project ideas:
- Detecting of missing links (and relation types)
- Classification of nodes into the onthology.
- SNAP network datasets. 60 large social and information network datasets
- Wikipedia
- Complete edit history of Wikipedia articles: Which user edited what article at what time.
- Wikipedia page to page link data
- DBpedia: A richly labeled graph of Wikipedia entities.
- Freebase: An entity graph of people, places and things.
- Ratings and purchases (movies, music, etc.)
- Amazon product co-purchasing network: 600k products and all their metadata.
- KDD Cup 2011: 300M ratings from 1M users on 600k songs, albums and artists.
- IMDB database: Everything about every movie ever made.
- Movielens: User movie rating data.
- Yahoo! Webscope Catalog of datasets
- Yahoo! Webscope dataset collection. Contains Language Data, Graph and Social Data, Ratings Data, Advertising and Market Data, Competition Data
- Note: Jure Leskovec will have to apply for any sets you want, and we must agree not to distribute them further. There may be a delay, so get requests in early.
- 1.usa.gov data set
It would enable questions around link propagation, half-life by referrer, geographical analysis, and I'm sure a ton of other fun stuff! 1.usa.gov