Financial fears could be holding back millions of retirement dreams