U.S. stocks finished mostly lower Monday in the wake of a large investment fund being forced to sell massive holdings in stocks.