Nowadays project management is a key component in introductory operations management. The educators and the researchers in these areas advocate representing a project as a network and applying the solution approaches for network models to them to assist project managers to monitor their completion. In this paper, we evaluated project’s completion time utilizing the Q-learning algorithm. So the new algorithm is proposed to solve completion time project. Then, we run this algorithm in example network in Matlab. The results showed that the algorithm has achieved the best time to complete the project.