s paper presents a hybrid algorithm, the “particle swarm optimization with simulated annealing behavior (SA-PSO)” algorithm, which combines the advantages of good solution quality in simulated annealing and fast calculation in particle swarm optimization. As stochastic optimization algorithms are sensitive to its parameters, this paper introduces criteria in selecting parameters to improve solution quality. To prove the usability and effectiveness of the proposed algorithm, simulations are performed using 20 different mathematical optimized functions of different dimensions. The results made from different algorithms are then compared between the quality of the solution, the efficiency of searching for the solution and the convergence characteristics. According to the simulation results, SA-PSO obtained higher efficiency, better quality and faster convergence speed than other compared algorithms.