There needs to be a "blue card" option where a player who cops one has to sit out for ten or fifteen minutes and cops no further penalty. Red cards IMO should be reserved for outright dangerous play.
The fact is that a ref at the moment can have an undue influence over a game that they are not presiding over (which is a huge flaw with the system). A judiciary like what happens in the AFL or League would be much better IMO. Imagine the uproar if Sachin Tendulkar was barred from a key World Cup match because he got out handled ball (for example).