Are the Gorosei really all that bad ?

while going back threw the enies lobby arc. When the explained robin back story. Right before they have the order to kill prof clover when clover was explaining they seemed more interested in what he had to say instead of pissed off. Until they order to kill him. But right after 1 of them seemed distraught about killing everyone almost like it pained him about giving the order. He was truly upset that they had to whipe this place place out.

Are they truly bad people? Or are the ways they've...

Are the Gorosei really all that bad ?