In the paper we discuss the possibility of using stone dust for utilizing as building material. The tested material was amphibolite, found in the Sudeten Mountains and the Tatra Mountains in Poland. The chemical composition of dust was determined by means of spectrometry methods. Moreover, the basic physical properties of the material were designated. Stone dust was mixed with starch or cement binder. The binder addition was from 5% to 20% by weight. The water content was adjusted to about 25% humidity. The mixture was then compressed in a hydraulic press at 50 MPa. The results of the mechanical toughness of agglomerates were shown. On the basis of the results, acceptable toughness of agglomerates was found, with the addition of cement in mass share 20% and seasoning for 48 hours. However, starch was not suitable as a binder for agglomeration of amphibolite.