Irvine's power is risk to human rights, says Lords