A variant of discrete velocity approach for solving the Boltzmann kinetic equation with regular (deterministic) approximation of collision integrals is used in parallel implementation with NVIDIA GPU computing. Some problems, namely a uniform relaxation, nonuniform relaxation in 2D physical space are solved. Speed up of GPU Boltzmann solver is of the order 100 or more times over CPU version of the solver.