Unstable inverses: when more data does not mean a better reconstruction