Just mount the pole off-center, then you can get around the clearance problem somewhat. I only have one monitor mounted centrally, and my laptop to the side on the second arm. The desk is almost flush to the wall at 2cm (~1 inch) and the monitor and laptop are around 15cm (~6 inches) away from the wall.
Yeah, I had 3x 32" monitors mounted on arms (one twin arm and one single arm) on a desk pushed almost right up to the wall this way. The arms can go sideways in one direction and then sideways in the other right behind the monitor, as long as the base is not centred.
