It's a cool idea, but it probably would have killed the crew due to radiation exposure.
Edit: Some additional info. The Apollo crews had very little radiation protection, basically just the hulls of their spacecraft. This was thick enough to give them protection against the van allen belts as they zipped through them (not coincidentally where the ships were going near their highest speeds) but it wasn't enough to protect against an errant solar flare. Fortunately, the missions were short duration and we just plain got lucky. Venturing into the inner Solar System near Venus would have exposed crews to higher levels of radiation (due to proximity to the Sun) and combined with the longer duration trip would have virtually guaranteed being exposed to high doses from a CME or solar flare.
Edit: Some additional info. The Apollo crews had very little radiation protection, basically just the hulls of their spacecraft. This was thick enough to give them protection against the van allen belts as they zipped through them (not coincidentally where the ships were going near their highest speeds) but it wasn't enough to protect against an errant solar flare. Fortunately, the missions were short duration and we just plain got lucky. Venturing into the inner Solar System near Venus would have exposed crews to higher levels of radiation (due to proximity to the Sun) and combined with the longer duration trip would have virtually guaranteed being exposed to high doses from a CME or solar flare.