There'd really be no reason to ever pedal this road, other than the very top half-mile when climbing Ghost Town. It is useful, however, if you're interested in shuttling Secret Trail or Broken Arrow.
All of that said, you'll need a high-clearance 4x4 vehicle and a lot of time to spare to accomplish a shuttle (it can take upwards of an hour to drive this road). Access Glorieta Baldy Road via County Road 63A (also dirt, but graded). There's a ton of dispersed camping along the way.