Complexity
Theory Spring 2012
|

email: ceh@cs.ucf.edu
Structure: TR 1330-1445
(1:30PM-2:45PM); COMM-114;
28 class periods, each 75 minutes long.
Go To Week 1, 2, 3, 4,
5, 6, 7,
8, 9, 10,
11, 12, 13,
14, 15
Instructor: Charles Hughes; Harris Engineering Center 247C;
823-2762
Office Hours: TR 3:15PM-4:30PM
GTA: Syed Zain Masood, HEC-234
Office Hours: MW 3:15PM-4:30PM
Required Reading: Notes
Recommended Reading:
Arora & Barak, Computational Complexity: A Modern Approach, Cambridge University Press, 2009.
Sipser, Introduction to the Theory of Computation 2nd Ed.,
Course Technologies, 2005
Garey & Johnson, Computers and Intractability: A guide to the
Theory of NP-Completeness, W. H. Freeman & Co., 1979.
Papadimitriou & Lewis, Elements of the Theory of Computation,
Prentice-Hall, 1997.
Hopcroft, Motwani&Ullman, Intro to Automata Theory, Languages
and Computation 2nd Ed., Addison-Wesley, 2001
Davis, Sigal and Weyuker, Computability, Complexity and Languages
2nd Ed., Academic Press (Morgan Kaufmann), 1994.
Web Pages:
Base URL: http://www.eecs.ucf.edu/courses/cot6410/spr2012
Notes
URL: http://www.eecs.ucf.edu/courses/cot6410/spr2012/Notes/COT6410NotesSpring2012.pdf
Assignments: Around 6 to 10; Paper + Presentation
Exams: midterm and a final.
Exam Dates (Tentative): Exam#1 – Tuesday, February 28; Spring Break – March 5-10; Withdraw Deadline – Tuesday, March 20;
Final – Tues., April 24, 1:00PM–3:50PM
Evaluation (Tentative):
- Mid Term – 125 points; Final Exam – 175 points (balance between weights will be adjusted in your favor)
- Assignments – 100 points; Paper and Presentation – 75 points
- Extra -- 25 points used to increase weight of exams or assignments, always to your benefit
- Total Available: 500
- Grading will be A >= 90%, B+ >= 85%, B >= 80%, C+
>= 75%, C >= 70%, D >= 50%, F < 50%; minus grades may be used
.
Weeks#1: (1/10, 1/12) -- Notes pp. 2-46; Syllabus
- Ground rules
- Decision problems
- Solving vs checking
- Procedures vs algorithms
- Introduction to theory of compuation
- Terminology, goals and some historical perspective
- Basic notions of computability and complexity
- Existence of unsolvable problems (counting and
diagonalization)
Assignment #1
Review of some closure properties of formal languages
Due: 1/19 (Key)
Week#2: (1/17,
1/19) -- Notes
pp. 47-69
- Solved, solvable, unsolved, unsolvable, re, non-re
- Hilbert's Tenth
- Undecidable problems made a bit more concrete
- Lots about problems and their complexity
Assignment #2
Closure properties of Recursive, RE and non-RE sets
Due: 1/31 (Key)
Week#3: (1/24, 1/26) -- Notes pp. 70-131
- Models of computation
- Turing machines
- Register machines
- Factor replacement systems (FRS)
- RM simulated by Ordered FRS
- Systems related to FRS (Petri Nets, Vector Addition,
Abelian Semi-Groups)
- Primitive Recursive Functions (prf)
- Initial functions
- Closure under composition and recursion
- Addition and multiplication examples
- Sample functions and predicates
- Closure under cases
- Bounded minimization
- Arithmetic fuctions that use bounded search
- Pairing functions
- Limitations of primitive recursive
- mu-recursion and the partial recursive functions

Week#4: (1/31, 2/2) -- Notes pp. 132-159
- Notions of instantaneous descriptions
- Encodings
- Equivalence of models
- TMs to Register Machines
- RM to Factor Replacement Systems
- Factor Replacement to Recursive Functions
Assignment #3
a. Prove that the primitive recursive functions are clsed under multual recursion. Mutual recusrion is defined by:
Assume g1, g2, h1 and h2 are know to be primitive recursive. Define
f1(x,0) = g1(x); f1(x,y+1) = h1(f2(x,y)); f2(x,0) = g2(x); f2(x,y+1) = h2(f1(x,y))
b. Redo the construction that shows a universal recursive function
associated with FRS, but use the pairing
function, not the factor
encoding
Due: 2/14 (Key)

Week#5: (2/7, 2/9) -- Notes pp. 156-196
- Gory deatils on FRS to REC
- Universal machines
- Recursive Functions to TMs
- Consequences of equivalence
- Review Undecidability (Halting Problem, shown by diagonalization)
- Notation matching (mine versus Davis's)
- RE sets and semidecidability
- Enumeration Theorem
- The set K = { n | n is in the
n-th re set } is re, non-recursive
- Alternative characterizations of re sets
- Parameter Theorem (aka Sm,n Thearem)
- Quantification and re sets
Week#6: (2/14, 2/16) -- Notes pp. 197-216
- Quantification and non-re sets
- Diagonalization revisited (set of algorithms, Ko or Lu,
is non-re)
- Reduction
- Classic sets Ko (Lu), NON-EMPTY (Lne), EMPTY
(Le)
- Reducibility and degrees (many-one, one-one, Turing)
- Complete re set (K and Ko as examples)
- Rice's Theorem
Week#7: (2/21, 2/23) -- Notes pp. 217-253
- "Picture" proofs for Rice's Theorem
- Constant Time and Mortal Machines
- END OF MATERIAL FOR Midterm
- Sample Midterm
- Introduction to rewriting systems (Thue, Post)
- Post Canonical Forms
- Review and go over sample questions
- Sample Midterm Key
Week#8: (2/28, 3/1) -- Notes pp. 254-265
- Midterm (Tuesday)
- Semi-Thue systems
- Word problems
- Simulating Turing Machine by Semi-Thue System
- Simulating by Thue Systems
- Grammars and re sets
- Unsolvable problems related to context-free
grammars/languages
- Post Correspondence Problem
Week#9: (3/13, 3/15) -- Notes pp. 264-297; 298-314 (optional); 315-335
- Key to Midterm
-
Post Correspondence Problem
- Ambiguity of CFGs
- Non-Emptiness of CFL Intersections
- Context-Sensitive Grammars and Unsolvability Results
- Valid (CSL) and Invalid Traces (CFL)
- Intersection and Quotients of CFLs
- Details on Valid (CSL) and Invalid Traces (CFL)
- Intersection of CFLs revisited
- Quotients of CFLs revisited
- Type 0 grammars and Traces
- L = all string over an alphabet
- L=L^2 for L a CFL
- Revisit Set Real-Time (Constant-Time)
- Real-Time and Mortal Machines
- Finite Power Problem for CFLs
- Propositional Calculus
Assignment #4
1. Present a decision procedure for the word problem for Semi-Thue Systems over one-letter alpahabets.
2. Present a decision procedure for the Post Correspondence Problem over one-letter alpahabets.
Due: 3/22
Assignment #5
Proposed team presentations (preferably 3 members per team)
Topic, abstract, team members, resources (papers, texts, people)
Details and Suggestions
Due: 3/22
Week#10: (3/20 (Withdrawal Deadline), 3/22) --
Notes pp. 336-452
- Optional Midterm2 on 3/19
- Note: 3/20 is the Withdraw Deadline
- Fast Review of Order Analysis
- Basics of Complexity Theory
- Decision vs Optimization Problems (achieving a goal vs achieving min cost)
- Polynomial == Easy; Exponential == Hard
- Polynomial reducibility
- Verifiers versus solvers
- P as solvable in deterministic
polynomial time
- NP as solvable in
non-deterministic polynomial time
- NP as verifiable in
deterministic polynomial time
- Concepts of NP-Complete and
NP-Hard
- Canonical NP-Complete problem:
SAT (Satisfiability)
- Some NP problems that do not
appear to be in P: SubsetSum, Hamiltonian Path, k-Clique
- Million dollar question: P = NP ?
- Construction that maps every
problem solvable in non-deterministic polynomial time on TM to SAT
- Optional Midterm2 Key

Week#11: (3/27, 3/29) -- Notes pp. 453-474
- SAT is polynomial reducible to (<=P) 3SAT
- 3SAT as a second NP-Complete problem
- 3SAT <=P SubsetSum
- SubsetSum <=P Partition
- Partition
equivalence to SubsetSum
- Knapsack (relation to SubsetSum), Bin Packing
- Bin packing (fixed capacity, minimize number of bins)
- Pseudo polynomial-time solution for Knapsack
- using dynamic programming with changed parameters, n*W versus 2^n
- Reduction techniques
- Reduction
of 3SAT to k-Vertex Cover
Week#12: (4/3, 4/5) -- Notes pp. 475-518
- Note that you must send me your
presentations at least 2 days before you present)
- 3-SAT to 3-Coloring
- Isomophism
of k-Coloring with k-Register Aloocation of live variables
- Scheduling problems introduced
- Scheduling on multiprocessor
systems
- Scheduling problems (fixed number of processors, minimize final finishing time)
- N processors, M tasks, no
constraints
- Partition and scheduling problems
- Greedy heuristics
- 2 processor scheduling -- greedy
first fit, greedy best fit, sorted, optimalGreedy versus optimal (N/(N+1))
- Scheduling anomalies, level strategy for UET trees, level strategy for UET dags
- Precedences (lists, delays,
preemption)
- Anomalies (reducing
preceeedence, increasing processors, reducing times)
- Unit Execution Time: Trees,
forest, anti forests
- UET: DAGs and m=2
- co-NP
- P = co-P ; P contained in
intersection of NP and co-NP
- NP-Hard
- QSAT as an example of NP-Hard,
possibly not NP
- More NP-Complete poroblems (fun ones)

Week#13: (4/10,
4/12)
- Presentations 20 minutes + 5
- 4/10 Philip Shibly, Jose Sanchez
- 4/10 Frank Plochan, Andrew Yee, Deli Zhang
- 4/10 Jeff Cashion, Chris Zorn
- 4/12 Greg Morse, Charles Synyder
- 4/12 Jun Ding, Ying Wang
- Clean-up (NP-Easy, NP-Equivalent, FP, FNP)
- Sample Final exam Questions
Week#14:(4/17, 4/19)
- 4/17 Sarah Buchanan, Juliet Norton
- 4/17 Rahmatollah Beheshti, Haroon Idrees, Ashkan Paya
- 4/17 Vera Kasakova, Anthony Wehrer
- Sample papers in Projects/Samples/
- All papers related to presentations are due by 11:59 on 4/23.
- I prefer just electronic versions of word or pdf files. If a pdf, I
would also like the files used to create it in a zip or rar.
- Your papers must include one or two questions you would ask of
your audience
- Sample
Final Exam Key
- Review for Final Exam

Final Exam; Tuesday
April 24; 1:00PM to 3:50PM in COMM-114
© UCF (Charles E. Hughes)
-- Last Modified April 18, 2012