47% of retirees leave work earlier than expected, but just 31% say they could afford to