Caution returned to the stock market ahead of the long Memorial Day weekend, with bond markets set to close early on Friday.