Why do the conspirators want Cicero and then leave him out?

The men then discuss whether they should invite Cicero, the great orator, to join their plot, but Brutus convinces them against it because Cicero isn't one to follow the idea of others; he is a leader and philosopher...... not a follower.