Tentative Course Schedule (This may be updated without prior notice)

Week	Day	Topics	Readings	HW Assignments& Project
1	1/9	Introduction and Overviews	An evaluation of the ninth SOSP submissions -or- How (and how not) to write a good systems paper “How to write a good research paper", Simon Peyton Jones Common Bugs in Writing "How to give a good research talk", Simon Peyton Jones, John Launchbury, John Hughes. Video of me giving the talk at the Technical University of Vienna, October 2004. Giving a talk by Mike Ernst Hints on making presentations by Jeff Offutt	Computer System Paper Evaluation, Common Bugs in Writing, Presentation Skills
1	1/11	Fundamentals of Computing in the past and at present	NIST definition of cloud computing. Peter Mell and Tim Grance. (linked here (with other information)) State of Public Sector Cloud Computing. Vivek Kundra. Report at CIO.gov. (executive summary and pdf) Recommended optional reading/materials: Randy Bryant's conceptual overview of DISC and keynote talk: pdf of overview, pdf of slides, video. Written testimony and video from Congressional hearing on cloud computing: hearing webpage
2	1/16	No Class in memory of Martin Luther King Jr. Day
2	1/18	Data-intensive Scalable Computing and Cloud, and HPC	Data-Intensive Supercomputing: The case for DISC. Randal E. Bryant. Carnegie Mellon University technical report CMU-CS-07-128(pdf ). Join Datanami Editor Nicole Hemsoth and a team of industry experts to examine the Big Data phenomenon and discuss how the trends in data intensive computing will impact the future direction of HPC. Watch Video Making the Connection: Big Data and HPC	As organizations of all types struggle to keep pace with explosion of data deluging their daily operations, deciphering the complexities involved in data mining, analytics, and data processing will require the utilization of advanced HPC technologies.
3	1/23	Quantitative principals of Computing	Textbook, Distributed and Cloud Computing, from parallel processing to the Internet of things, Chapter 1 Reference Textbook, Computer Architecture, Chapter 6
3	1/25	MapReduce	#1: MapReduce: Simplified Data Processing on Large Clusters. Jeffrey Dean and Sanjay Ghemawat. OSDI 2004. (Qiangju Xiao) Recommended optional reading/materials: Applying performance models to understand data-intensive computing efficiency. Elie Krevat, Tomer Shiran, et al. Carnegie Mellon Technical Report #CMU-PDL-10-108. (available here)
4	1/30	Updates on MapReduce	#2: Improving MapReduce Performance in Heterogeneous Environments. Matei Zaharia, Andy Konwinski, et al. OSDI 2008. (Junyao Zhang) #3: MapReduce Online. T. Condie, N. Conway, et al. NSDI 2010. (Fuentes)
4	2/1	Other data processing models	#4. PrIter: A Distributed Framework for Prioritized Iterative Computations SOCC11. (Bao) #5: Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. Michael Isard, Mihai Budiu, Yuan Yu, Andrew Birrell, and Dennis Fetterly. Eurosys 2007. (Mendez)
5	2/6	Parallel I/O in Practice	#6 Hadoop (Jie Chen) #7 POSIX-IO and MPI-IO (Junyao Zhang)
5	2/8	Data-intensive HPC Analytics	#9 MRAP: A Novel MapReduce-based Framework to Support HPC Analytics Applications with Access Patterns, ACM High Performance Distributed Computing. June 2010, Chicago, IL, USA. (Mendez ) #8 Parallel Virtual File System (Jie Chen)
6	2/13	Data-intensive File System	#10 DOT: a matrix model for analyzing, optimizing and deploying software for big data analytics in distributed systems. SOCC 2011(Carcheri) #11 The duality of PVFS and HDFS, SC11 (Xiao)
6	2/15	Data Placement	#13: Volley: Automated Data Placement for Geo-Distributed Cloud Services. S. Agarwal, J. Dunagan, et al. NSDI 2010. (Zittrower) #14 RCFile: A Fast and Space-efficient Data Placement Structure in MapReduce-based Warehouse Systems ICDE11. (Carcheri).	Term Project Proposal Due
7	2/20	Term Project Proposal Presentation
7	2/22	Term Project Proposal Presentation
8	2/27	Scientific Workflows	#15. Auto-Scaling to Minimize Cost and Meet Application Deadlines in Cloud Workflows, SC11 (Bai) #16. Scientific workflows and clouds, ACM Spring 2010 (Zittrower)
8	2/29	Beyond Cloud Computing	#17: Beyond Server Consolidation. Werner Vogels. ACM Queue, Jan/Feb 2008. (Ball) #18: Above the Clouds: A Berkeley View of Cloud Computing. Michael Armbrust, Armando Fox, et al. University of California at Berkeley Technical Report No. UCB/EECS-2009-28, Feb 2009. (Ball) Recommended optional reading/materials: Berkeley cloud report gets mixed reviews. James Urguhart. CNET News, Feb 2009. (available here) A conversation with Werner Vogels. ACM Queue. June 2006. (available here) All Things Distributed. Werner Vogels. A Weblog. (available here)
9	3/5-3/10	No Class Spring Break
10	3/12	Reserved for Guest Lectures	Prof. Shaojie Zhang’s guest talk
10	3/14	Virtual Machines	#19: Memory Resource Management in VMware ESX Server. Carl A. Waldspurger. OSDI 2002. (Luna) #20: Differential Virtual Time (DVT): Rethinking I/O Service Differentiation for Virtual Machines. Mukil Kesavan, Ada Gavrilovska, Karsten Schwan. SOCC 2010. (Luna)
11	3/19	Not meet
11	3/21	Cloud provider building blocks/Amazon AWS	#21: The eucalyptus open-source cloud-computing system. Daniel Nurmi, Rich Wolski, et al. CCGRID 2009. (Wertz) #22: Beyond Virtual Data Centers: Toward an Open Resource Control Architecture. Jeff Chase, Laura Grit, et al. ICVCI 2007. (Muhmud)
12	3/26	Microsoft Windows Azure	#23 Amazon Web Services Links and Resources (textbook pp231, links) (Kwok) #24 Windows Azure Storage: A Highly Available Cloud Storage Service with Strong Consistency SOSP2011 (pdf, ppt) (Kwok)
12	3/28	Berkeley cluster scheduling papers	#25: Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center. B. Hindman, A. Konwinski, et al. UCB Tech Report Sept 30, 2010. (Yin) #26: Delay Scheduling: A Simple Technique for Achieving Locality and Fairness in Cluster Scheduling. M. Zaharia, D. Borthakur, et al. Eurosys 2010. (Yin) Recommended optional reading/materials: More papers on Mesos (previously called Nexos) project available here.
13	4/2	More cluster/scalable OSs/schedulers	#27: An Operating System for Multicore Clouds: Mechanisms and Implementation. D. Wentzlaff, C. Gruenwald, et al. SOCC 2010. (Wertz) #28: Quincy: fair scheduling for distributed computing clusters. M. Isard, V. Prabhakaran, et al. SOSP 2009. (Zhang) Recommended optional reading/materials: More papers on fos project available here. Hive: Fault Containment for Shared-Memory Multiprocessors. J. Chapin, M. Rosenblum, et al. SOSP 1995. (PDF linked here) Platform Enterprise Grid Orchestrator. A two page marketing description: PDF linked here
13	4/4	Not Meet
14	4/9	VM image storage	#30: The Collective: A Cache-Based System Management Architecture. R. Chandra, N. Zeldovich, et al. NSDI 2005. (Luna) #31: Parallax: Virtual Disks for Virtual Machines. D. Meyer, G. Aggarwal, et al. Eurosys 2008. (Muhmud) Recommended optional reading/materials: VMware's Virtual machine disk format (information available here). Microsoft's Virtual hard disk image format (information available here).
14	4/11	Cloud storage	#32: Lithium: Virtual Machine Storage for the Cloud. J. Hansen, E. Jul. SOCC 2010. (Muhmud) #33 Availability in Globally Distributed Storage Systems. D. Ford, F. Labelle, et al. OSDI 2010. (Zittrower) Recommended optional reading/materials: SNIA Cloud Storage Initiative (info here) SNIA Cloud Storage for Cloud Computing white paper (PDF available here)
15	4/16	Final project presentation
15	4/18	Final project presentation
16	4/23			Term Project Due

Hadoop acceleration through network levitated merge, SC11

In situ data processing for extreme scale computing, DOE SCIDAC 2011

Cloud Versus In-house Cluster: Evaluating Amazon Cluster Compute Instances for Running MPI Applications, SC11

SciMATE: A Novel MapReduce-Like Framework for Multiple Scientific Data Formats, Yi Wang, Wei Jiang and Gagan Agrawal. IEEE/ACM CCGrid (CCGrid'12), May 2012, Ottawa, Canada.