Paperclip Maximizer

Nick Bostrom's thought experiment: an AI tasked with making paperclips, given sufficient capability, could convert all matter in the universe into paperclips — not from malice, but from single-minded optimization of a poorly specified goal.