Problems of the modern mathematical physics