Exploiting solution structure, particularly solution sparsity, has become a common task in computational sciences including image processing, compressed sensing, machine learning, and several other fields. Starting from some application problems with structured solutions, this talk surveys recent optimization techniques that are designed for quickly recovering structured solutions.