Internal
evaluation2023
Internal evaluation of research fields and artistic segments 2023
In 2023, an internal evaluation of research fields and artistic segments was conducted at the Brno University of Technology. The goals were:
- to determine how individual scientific fields perform in comparison to prominent European universities and how individual artistic segments perform in comparison to other Czech artistic institutes,
- to ensure self-evaluation by faculties and university institutes,
- and obtain feedback on the functioning of BUT in the area of scientific research and artistic activities from the International Scientific Board.
The 2023 evaluation and recommendations from the International Scientific Advisory Board served to thoroughly prepare for the peer review evaluation of departments at BUT in 2024.
Tools Used
Benchmarking of Publication Outputs
Benchmarking with Reference Universities: A list of reference universities has been compiled, focusing on institutions that specialize in the same research areas as BUT, particularly technical universities and other leading universities in Europe.
Selection Criteria: The selection includes world-renowned universities as well as top-ranking institutions from neighbouring countries (Slovakia, Austria, Germany, and Poland), based on the Leiden ranking in Physical Sciences and Engineering (top 10%) and the Times Higher Education ranking in Engineering. Czech universities are also represented in this list.
Benchmarking Criteria: These universities were compared to BUT in the most significant FORD fields. The comparison was limited to universities that contributed at least 1% of the total output from all benchmark institutions during the evaluation period (2018-2022), with a minimum publication output of 100.
Bibliometric Indicators Used: Various bibliometric indicators were employed, including the number of documents indexed in the Web of Science database, citation impact normalized for the research field, publication year and type, journal quartile according to Journal Impact Factor (JIF), and the share of publications resulting from international, domestic, or internal collaborations, as well as those published in open access.
Additional Statistics: The metrics were supplemented with additional statistics about the universities, such as budget, number of researchers and academics, and student enrollment.
These metrics provide valuable insights into the quantitative aspects of research performance, helping to understand the reach and influence of scientific outputs and facilitating comparisons between institutions. However, it is essential to recognize that these metrics do not encompass the full spectrum of quality and societal impact of research. Consequently, the benchmarking analyses were complemented by self-evaluation reports of faculties and higher education institutes, which provided the necessary context for these quantitative indicators.
Benchmarking of Artistic Outputs
The internal evaluation process also focused on artistic segments, establishing a framework for comparing artistic outputs with those of other Czech institutions. An analysis of evaluated outputs was carried out based on the parameters defined by the Register of Artistic Outputs.
Self-Evaluation Reports by Faculties and University Institutes
Each faculty and university institute prepared self-evaluation reports detailing their most significant research fields and artistic segments. The faculties were tasked with commenting on the benchmarks and analyses included in the self-evaluation reports, while also describing their research/artistic activities according to a prescribed structure.
They addressed several key areas, including the publication strategy, description of the most significant applied and other results, social and economic relevance of their research, strategy for obtaining external funding, description of the most significant grants, research vision for the next 5-10 years, use of research infrastructures, and vision for further infrastructure development.
Summary Report for BUT Management
A comprehensive summary report was prepared for the management of BUT based on the materials provided by the faculties and institutes.
Visit of the International Scientific Advisory Board
All the materials mentioned above were submitted to the International Scientific Advisory Board, whose members visited BUT on November 1-2, 2023. During their visit, they met with university management, toured individual faculties and institutes, and engaged with researchers and artists, including doctoral students.
Feedback and Recommendations: Following their visit, the International Scientific Advisory Board provided feedback on the university's performance in scientific and artistic activities, as well as insights into the results of the internal evaluation of both science and art. They also offered valuable recommendations for establishing a detailed peer review evaluation process scheduled for 2024.
Responsibility: Mgr. Marta Vaňková