Course Information

Meeting Times and Locations

Wednesday 11:30 - 13:20 in Skilling Auditorium, Room 80

Course description

This course will talk about Apache Hadoop and the projects in the Hadoop ecosystem in the context of (massive scale) data mining. The objective is to give students a foundation in Apache Hadoop and related technologies. The class will be lecture-only with a few small assignments to help students cement the concepts discussed in lecture.

Topics will include Apache Hadoop, MapReduce, HDFS, Apache Spark, Apache Hive, Apache Impala, Apache Sqoop, Apache Flume, and Apache Kafka.

CS246H is intended as a supplementary section to CS246.

The content of this class is derived largely from the Cloudera Developer Training for Spark and Hadoop and Cloudera Data Analyst Training , which are made available to Stanford through the Cloudera Academic Parntership program. Additional content has been developed specifically for this course in conjunction with Cloudera.

Course outline

Tentative list of topics to be covered. These topics may change slightly as the quarter progresses.

Apache Hadoop
Apache Sqoop
Apache Flume
Apache Impala
Apache Hive
Apache Spark
Apache Kafka

Quizzes

This course will include eight weekly Gradiance quizzes to check that students are learning the concepts. Some of the quizzes will require students to complete short programming assignments to produce the answers.

Each quiz can be tried only three times, with a 10 minute delay between submissions. There is no penalty for wrong answers. Your best score out of the (up to) three submissions will be the score used.

The Gradiance token for this class is CDE125C0.

Gradiance quiz	Out on	Due on
Quiz 1: Writing MapReduce Jobs	Wed, January 16 13:20	Wed, January 23 11:30
Quiz 2: Spark	Wed, January 23 13:20	Wed, January 30 11:30
Quiz 3: Parallelism	Wed, January 30 23:59	Wed, February 6 11:30
Quiz 4: DataFrames and DataSets	Wed, February 6 23:59	Wed, February 13 11:30
Quiz 5: Spark Streaming	Wed, February 13 13:20	Wed, February 20 11:30
Quiz 6: SparkML	Wed, February 20 13:20	Wed, February 28 11:30
Quiz 7: Data Management	Wed, February 27 13:20	Wed, March 6 11:30
Quiz 8: SQL and Data Managament	Wed, March 6 13:20	Wed, March 13 11:30
Bonus Quiz!	Wed, March 13 13:20	Wed, March 22 23:59

Course materials

Slides will be posted on-line.

Course handouts and other reading materials can be downloaded here.

Course work and grading

The coursework for the course will consist of:

Quizzes: short quizzes to check understanding. Some may require short programming assignments to find the answers. 100% of the final grade.

The grade for this course is pass/fail. To pass, a student must score at least 50% on the 8 weekly quizzes.

Gradiance quizzes

With regard to the weekly quizzes on Gradiance. Here are the instructions:

Go to http://www.newgradiance.com/services
Register and use the class token 5D72F278
Make sure you register using your Stanford email (SUNet ID) so we can match enrollment records
There is a MapReduce quiz assigned (see under the Homeworks tab) with 4 quick questions.
To answer some of them you will need access to the Mining Massive Datasets book
You will have exactly 1 week to complete the quiz. (There are no late days!)

Gradiance quizzes are generally out on Wednesday afternoon and due exactly a week later. Note that we cannot under any circumstances extend the quiz deadline. Once the deadline has passed students will not be able to submit their quizzes.

Communication

General course questions should be posted Piazza.

If you need to reach the course staff, you can reach us at cs246h-win1819-staff@lists.stanford.edu (consists of the TAs and the professor).