Theories state that some black holes could have formed within the first second of the Big Bang.

NASA/ESA and G. Bacon (STScI)