Without looking it up I'd say the usual response is that the stars we see at night with the naked eye are nearby, in our own galaxy. Those stars aren't moving away from us, but are locked in rotation with us around the galactic center. Also, a few thousand years of recorded history is not long enough to see a difference on a galactic timescale (millions of years).