To investigate effects of nonlinear soil-structure interaction, we study the influence of the nonlinearity of pile damage on building response. In this paper, it is presented that the results of the centrifuge tests considering elasto-plastic behavior of pile and its simulation analysis. The following conclusions were obtained: (1) The response of the building, which is calculated considering the nonlinear characteristics of pile damage during the main shock, is smaller than that of the building which is calculated without the nonlinearity of pile. (2) In frequency transfer function between the ground and the building, the reduction of predominant frequency is mainly caused by the nonlinearity of the soil around piles. (3) The nonlinearity of pile damage has a very small effect in the building response in aftershock.