Disable this option, the live chat agents will only have access to new conversations and conversations that are assigned to them.