In 2011, K-means algorithm combined Firefly Algorithm has been proposed by Mr. Senthilnath. This clustering algorithm has obtained better results than K-means algorithm and the other algorithms combined bio-inspired algorithm. In this study, we propose a new clustering algorithm; K-means algorithm combined improved Firefly Algorithm. One parameter of our proposed algorithm is changed when the assignment does not change. We compare K-means algorithm, K-means algorithm combined Firefly Algorithm and our proposed algorithm using simple model. Numerical experiments show our proposed algorithm is more efficient algorithm than the other algorithms.