The analysis of the new edges of parallelism that have emerged in connection with the further development of the concept of «computing» and related new concepts and structures is accomplished. It is shown that the inclusion of the randomization and multi-agent concepts to a variety of approaches to the development of high-performance parallel solvers allows to solve previously inaccessible problems and leads to powerful new capabilities in dealing with the already known cumbersome computational tasks.