Some banners were raised and a few officers blew the whistles.
An officer who asked not to be named said that they wanted to show all that civil servants must stand by the righteousness.
"We believe that we are the first among civil servants and we would like to urge those at other ministries to express their opinions," he said.
They plan to continue the protest until the amnesty bill is withdrawn.