The clerk of the supreme court and registers in chancery may be removed from office by the justices of the supreme court, and by the chancellors, respectively, for cause, to be entered at length upon the minutes of the court.