Geodesic
The unstructured texts' semantic models for the R\' evaluation
Matematičeskoe modelirovanie, Tome 28 (2016) no. 6, pp. 33-52.

Voir la notice de l'article provenant de la source Math-Net.Ru

The development of technological application of semantic models of text information sources for analytical and informational basement of R's concrete results evaluation is the application of text collection semantic models as an instrument for the expertise of R's persons. We provide the corresponding problem setting. For experimental justification of the suggested approach we provide text collection semantic models given in electronic form in expertise system of the Directorate of State Scientific and Technical Programs. On the base of computational models of semantics of individual documents we computationally form another models. The last models allow to split the documents into the thematically homogeneous groups as a result of completely computational procedure. Also they provide the objective view onto the directions of works financed by the Russian Ministry of Education and Science within the frame of Federal purpose-oriented program and within the frames of specific priority directions in science and technology. Given examples approve the possibility to apply the models in the questions of informational and analytical ensuring of R evaluation.
Keywords: expertise of research and development (R&D) results, semantic models, unstructured texts, natural language. 
@article{MM_2016_28_6_a2,
     author = {A. N. Petrov and M. G. Kreines and A. A. Afonin},
     title = {The unstructured texts' semantic models for the {R\&Ds'} evaluation},
     journal = {Matemati\v{c}eskoe modelirovanie},
     pages = {33--52},
     publisher = {mathdoc},
     volume = {28},
     number = {6},
     year = {2016},
     language = {ru},
     url = {http://geodesic.mathdoc.fr/item/MM_2016_28_6_a2/}
}
TY  - JOUR
AU  - A. N. Petrov
AU  - M. G. Kreines
AU  - A. A. Afonin
TI  - The unstructured texts' semantic models for the R\&Ds' evaluation
JO  - Matematičeskoe modelirovanie
PY  - 2016
SP  - 33
EP  - 52
VL  - 28
IS  - 6
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/MM_2016_28_6_a2/
LA  - ru
ID  - MM_2016_28_6_a2
ER  - 
%0 Journal Article
%A A. N. Petrov
%A M. G. Kreines
%A A. A. Afonin
%T The unstructured texts' semantic models for the R\&Ds' evaluation
%J Matematičeskoe modelirovanie
%D 2016
%P 33-52
%V 28
%N 6
%I mathdoc
%U http://geodesic.mathdoc.fr/item/MM_2016_28_6_a2/
%G ru
%F MM_2016_28_6_a2
A. N. Petrov; M. G. Kreines; A. A. Afonin. The unstructured texts' semantic models for the R\&Ds' evaluation. Matematičeskoe modelirovanie, Tome 28 (2016) no. 6, pp. 33-52. http://geodesic.mathdoc.fr/item/MM_2016_28_6_a2/

[1] P. S. Krasnoshchekov, A. A. Petrov, Printsipy postroeniia modelei, FAZIS, VTsRAN, M., 2000, 400 pp.

[2] K. I. Pletnev, N. E. Lazarenko, Ekspertiza v nauchno-tekhnicheskoi sfere: metodologiia i organizatsiia, Izd-vo RAGS, M., 2003, 156 pp.

[3] A. N. Petrov, A. V. Strelets, A. A. Vakulenko, D. A. Sytnik, “Spetsialnoe programmnoe obespechenie dlia povysheniia kachestva ekspertizy rezultatov vypolneniia NIOKR”, Programmnye produkty i sistemy, 2010, no. 4, 152–157 | MR

[4] A. N. Petrov, M. G. Kreines, A. A. Afonin, “Semanticheskii poisk nestrukturirovannoi tekstovoi informatsii na estestvennykh iazykakh v zadachakh organizatsii ekspertizy pri realizatsii nauchnotekhnicheskikh programm”, Informatizatsiia obrazovaniia i nauki, 2:18 (2013), 54–67

[5] M. G. Kreines, “Metody vychislitelnogo analiza modelei semantiki dlia otsenki kachestv nauchnykh tekstov”, Izvestiia RAN. Teoriia i sistemy upravleniia, 2013, no. 2, 64–75 | DOI

[6] M. G. Kreines, A. A. Afonin, E. M. Kreines, “Otsenka kachestva nauchno-tekhnicheskikh dokumentov na osnove vychislitelnogo analiza modelei semantiki tekstov na estestvennykh iazykakh”, Informatizatsiia obrazovaniia i nauki, 20:4 (2013), 68–94

[7] M. G. Kreines, “Modeli i tekhnologii izvlecheniia agregirovannykh znanii dlia upravleniia protsessami poiska nestrukturirovannoi informatsii”, Izvestiia RAN. Teoriia i sistemy upravleniia, 2009, no. 2, 114–124

[8] M. G. Kreines, “Model tekstovoi kollektsii dlia poiska informatsii na estestvennykh iazykakh: kliuchevye slova, ikh sviazi i konteksty”, VI Moskovskaia mezhdunarodnaia konferentsiia po issledovaniiu operatsii, Trudy, MAKS Press, M., 2010, 150–151

[9] M. G. Kreines, A. A. Afonin, E. M. Kreines, “Obieektivnost ili magiia chisel”, VII Moskovskaia mezhdunarodnaia konferentsiia po issledovaniiu operatsii, Trudy, v. 2, VTs imeni A. A. Dorodnitsyna RAN, M., 2013, 133–135

[10] M. G. Kreines, A. A. Afonin, “Semanticheskaia kategorizatsiia tekstov na estestvennykh iazykakh bez znaniia semantiki”, VII Moskovskaia mezhdunarodnaia konferentsiia po issledovaniiu operatsii, Trudy, v. 2, VTs imeni A. A. Dorodnitsyna RAN, M., 2013, 132–133

[11] M. G. Kreines, “Informatsionnaia tekhnologiia KLIuChI K TEKSTAMR: funktsii, vozmozhnosti, prilozheniia”, Rechevye tekhnologii, 2009, no. 4, 97–106

[12] B. Wol, T. Lindenthal, M. Szerencsits, J. B. Holbrook, J. Heß, “Evaluating Research beyond Scientific Impact. How to Include Criteria for Productive Interactions and Impact on Practice and Society”, GAIA, 22:2 (2013), 104–114

[13] O. Kucuktunc, E. Saule, K. Kaya, U. V. Catalyurek, “Diversifying citation recommendations”, ACM Trans. Intell. Syst. Technol., 2012, 19 pp., arXiv: 1209.5809

[14] J. K. Vanclay, Impact Factor: outdated artefact or stepping-stone to journal certification?, Scientometrics, 2012, 25 pp., arXiv: 1201.3076

[15] J. K. Vanclay, L. Bornmann, “Metrics to evaluate research performance in academic institutions: A critique of ERA 2010 as applied in forestry and the indirect H2 index as a possible alternative”, Scientometrics, 91:3 (2012), 751–771 | DOI

[16] J. A. Eisen, C. J. MacCallum, C. Neylon, “Expert Failure: Re-evaluating Research Assessment”, PLoS Biol, 11:10 (2013), e1001677 | DOI

[17] R. Kwok, “Research impact: Altmetrics make their mark”, Nature, 500 (2013), 491–493 | DOI

[18] A. Eyre-Walker, N. Stoletzki, “The Assessment of Science: The Relative Merits of Post-Publication Review, the Impact Factor, and the Number of Citations”, PLoS Biol, 11:10 (2013), e1001675 | DOI

[19] T. Saracevic, “Effects of Inconsistent Relevance Judgments on Information Retrieval Test Results: A Historical Perspective”, LIBRARY TRENDS, 56:4 (2008), 763–783 ; The Evaluation and Transformation of Information Systems: Essays Honoring the Legacy of F. W. Lancaster, eds. L. J. Haricombe, K. Russell | DOI

[20] M. A. T. de Silva, G. Yapa, E. D. de Silva, “Interactive peer review as a productive evaluation process”, Research Evaluation, 11:3 (2002), 119–128 | DOI

[21] M. G. Kreines, A. A. Afonin, Programma predmetno nezavisimogo vychislitelnogo formirovaniia bazovykh dlia tematiki i soderzhaniia kollektsii dokumentov poniatii i terminov i opredeleniia sviazei mezhdu nimi, Svidetelstvo o gosudarstvennoi registratsii programmy dlia EVM No 2011612983 ot 14 aprelia 2011

[22] M. G. Kreines, A. A. Afonin, Programma predmetno nezavisimogo vychislitelnogo vyiavleniia struktury vzaimosviazei mezhdu terminami i poniatiiami, kharakterizuiushchimi semantiku kollektsii dokumentov, Svidetelstvo o gosudarstvennoi registratsii programmy dlia EVM No 2011612982 ot 14 aprelia 2011