We review recent theoretical progress in finding ways to perform quantum processing with optics using photon encoded qubits, qudits and continuous variables. We discuss the requirements, advantages and disadvantages of each approach and show that optics holds significant promise for computation.