As often stated, it would be easier to actually go to the moon, then to maintain the silence of the thousands of people who would be in on the conspiracy.

Also, if the US didn't go, does anyone really think the USSR wouldn't have called them on it? They were tracking it all too.