Usually is built into the bumper, which needs to be strong enough to support the tire carrier. There are places that offer spindles for use with swingout carriers. I used to run a single pivot/single latch tire carrier and it worked OK, but my new bumper with have a double pivot and double latch carrier:
http://www.4crawler.com/4x4/4R_bumpers.shtml