Business Administration and Economics
Abstract
This work paper is focused on the evaluation of university engagement in innovation (the
third mission of university), and aims to establish the main directions for improving the current systems
used to evaluate this university function in Romanian Higher Education. In the first part of the paper a
general overview on models and indicators for evaluation of university third mission is presented. The
second part briefly describes how university participation in innovation is assessed in Romania. Final
conclusions summarize the previous analysis, and point out some recommendations of improvement.
The novelty of the study consists in the complex analysis of the models used for the assessment of
university third mission. The overview is based on methodologies presented in official publications and
other studies related to the assessment of the universities’ engagement in innovation.
References
Aslan, Y. (2016). A Novel Index for Knowledge Triangle: The Entrepreneurial and Innovative
University Index of Turkey, Paris: OECD.
Boston University (2017). The Economic and Community Impact of Boston University, Fiscal Year
2015. Retrieved from https://www.bu.edu/oir/files/2017/05/Final-BU-Economic-Impact-Report-
5_15_17.pdf, date: 19.07.2018.
Carrion, A.; García-Gutiérrez, V.R.; Bas, M.C. & Carot, J.M. (2012). A New Methodology for
Measuring Third Mission Activities of Universities. Proceedings of 6th International Technology,
Education and Development Conference INTED 2012, pp. 1218-1223. Valencia, March. Spain:
IATED. Retrieved from http://apps.webofknowledge.com, date: 20.07.2018.
Damian, L.B.; Morais, R. & Smith, H.J. (2014). University-Business Collaborative Research: Goals,
Outcomes and New Assessment Tools, Belgium: EUA Publications.
DeVol, R.; Lee, J. & Ratnatunga, M. (2017). Concept to Commercialization: The Best Universities for
Technology Transfer. USA: Milken Institute.
European Commission (2009). Metrics for Knowledge Transfer from Public Research Organisations
in Europe. Report from the European Commission’s Experts Group on Knowledge Transfer Metrics.
Brussels, pp.1-79.
European Commission (2010). Assessing Europe’s University-Based Research. Expert Group on
Assessment of University-Based Research, Luxembourg: Publications Office of the European Union.
European Commission (2015). U-Multirank, Implementation of a user-driven, multi-dimensional and
international ranking of higher education institutions. Luxembourg: Publications Office of the
European Union.
European Commission and OECD (2012). A Guiding Framework for Entrepreneurial Universities.
Retrieved from https://www.oecd.org/site/cfecpr/ECOECD%
20Entrepreneurial%20Universities%20Framework.pdf, date: 20.12.2018.
Fornasari, A. (2016), The Role of Universities’ Third Mission in a Globalized Word: Continuing
Education, Social Engagement, Technology Transfer to Relate Science and Society. An International
Case Study: If4tm Project. Proceedings Paper, 9th Annual International Conference of Education,
Research and Innovation (ICERI), pp. 4373-4379. Seville, Spain, Retrieved from
http://apps.webofknowledge.com, date: 19.03.2018.
Government of Romania (2018). Decision no. 915/2017 amending the annex to the Government
Decision No. 1.418/2006 for the approval of the External Evaluation Methodology, the standards, the
reference standards and the list of performance indicators of the Romanian Agency for Quality
Assurance in Higher Education. Published in the Official Monitor, No. 25/11 January 2018.
Green Paper (2018). Fostering and Measuring “Third Mission” in Higher Education Institutions,
Project nr: 2008-3599/001 – 001, LifeLong Learning Program. Retrieved from
http://www.e3mproject.eu/Green%20paper-p.pdf, date: 25.07.2018.
Guthrie, J.; Evans, E. & Burritt, R. (2017). Improving Collaboration and Innovation between Industry
and Business Schools in Australia. Academic Leadership Series, Volume 8, pp. 9-26.
Holi, M.; Wickramasinghe, R. & van Leeuwen, M. (2008). Metrics for the Evaluation of Knowledge
Transfer Activities at Universities. Cambridge: Library House, a Report Commissioned by UNICO.
Jensen, H.P.; Palangkaraya, A. & Webster, E. (2009). A Guide to Metrics on Knowledge Transfer from
Universities to Businesses and Industry in Australia. Australia: Intellectual Property Research Institute
of Australia.
Jonkers, K. et al. (2018). A Regional Innovation Impact Assessment Framework for Universities. JRC
Discussion Paper. Brussels: Joint Research Centre.
Langford, G. (2002). Measuring the Impact of University Research on Innovation. Retrieved from
http://sites.utoronto.ca/isrn/publications/WorkingPapers/Working00/Langford00_Measuring.pdf,
date: 20.07.2018.
Molas-Gallart et al. (2002). Measuring Third Stream Activities. Final Report to the Russell Group
Universities. SPRU, United Kingdom: University of Sussex.
Parliament of Romania (2011). National Education Law No.1/2011. Published in Official Monitoring
No.18/ 10.01.2011, with subsequent amendments.
Piirainen, A.K.; Andersen, P.D. & Andersen, A.D. (2016). Foresight and the Third Mission of
Universities: The Case for Innovation System Foresight. Foresight, Volume 18, Issue 1, pp. 24-40,
Emerald Group Ltd. England, Retrieved from http://apps.webofknowledge.com, date: 19.03.2018.
Pressman, L. et al. (2017). The Economic Contribution of University/Nonprofit Inventions in the United
States: 1996-2015. Biotechnology Industry Organization. Retrieved from
https://www.autm.net/AUTMMain/media/Partner-Events/Documents/Economic-
_Contribution_University-Nonprofit_Inventions_US_1996-2015_BIO_AUTM.pdf, date: 18.07.2018.
Reuters (2018). Methodology: Top 100 Innovative Universities|2017, Retrieved from
https://www.reuters.com/innovative-universities-2017/methodology, date: 05.09.2018.
Romanian Ministry of Education (2018). Order No. 3047/2018 regarding the Methodology for the
allocation of budgetary funds for the basic financing and additional financing of the Romanian higher
education institutions for the year 2018. Published in the Official Monitor No. 127/09.02.2018.
Rubens, A.; Spigarelli, F.; Cavicchi, A. & Rinaldi, C. (2017). Universities' Third Mission and the
Entrepreneurial University and the Challenges they Bring to Higher Education Institutions. Journal of
Enterprising Communities-People and Places of Global Economy, Volume 11, Issue 3, pp. 354-372,
Special Issue: SI, Emerald Group Ltd, Yorkshire, England, DOI: 10.1108/JEC-01-2017-0006,
Retrieved from http://apps.webofknowledge.com, date: 19.03.2019.
Russell Group (2012). The Social Impact of Research Conducted in Russell Group Universities. Russell
Group Papers, Issue 3. Retrieved from
https://www.russellgroup.ac.uk/media/5235/socialimpactofresearch.pdf, date: 21.09.2018.
Sánchez-Barrioluengo, M. (2014). Articulating the Three-Missions in Spanish Universities. Research
Policy, Volume 43, Issue 10, pp. 1760-1773. doi:10.1016/j.respol.2014.06.001, Retrieved from
http://apps.webofknowledge.com, date: 19.03.2019.
Seppo, M. & Lille, A. (2012). Indicators Measuring University-Industry Cooperation. Discussions on
Estonian Economic Policy, Vol. 20, Issue 1, pp. 204-225.
Tabas, J.; Beranová, M. & Polák, J. (2012). Evaluation of Innovation Processes. Acta Universitatis
Agriculturae et Silviculturae Mendelianae Brunensis, Volume LX 69, no 2, pp. 523-532.
Trencher, G.; Yarime, M.; McCormick, K.; Doll, C.; Kraines, S. & Kharrazi, A. (2014). Beyond the
Third Mission: Exploring the Emerging University Function of Co-creation for Sustainability, Science
and Public Policy, Volume 41, Issue 2, pp. 151-179. Oxford University Press, England. Retrieved from
http://apps.webofknowledge.com, date: 19.03.2019.
Tripp Umbach (2018). The Economic and Community Impact of the University of Missouri System.
FY17, Retrieved from https://mospace.umsystem.edu/xmlui/handle/10355/63176, date: 22.07.2018.
University of Washington (2014). 2014 Economic and Community Impact Report of the University of
Washington, Retrieved from http://www.washington.edu/externalaffairs/files/2015/01/14-Economic-
Impact-Report.pdf, date: 21.07.2018.
Vernon, M.M.; Balas, E.A. & Momani, S. (2018). Are University Rankings Useful to Improve
Research? A Systematic Review. PLoS ONE Journal, Volume 13, Issue 3, pp. 1-15.
Veugelers, R. & Del Rey, E. (2014). The Contribution of Universities to Innovation. (Regional) Growth
and Employment. European Expert Network on Economics of Education (EENEE), European
Commission, Analytical Report No. 18.
Watson, D. & Hall, L. (2015) Addressing the Elephant in the Room: Are Universities Committed to the
Third Stream Agenda. International Journal of Academic Research in Management, Volume 4, Issue
2, pp. 48-76.
World Bank Group of Romania (2018). Methodology of University Classification - Project for the
Classification of Universities in Romania – Proposal. Retrieved from
https://www.utcluj.ro/media/notices/2018/Output_2__Classification_2__May_2018__RO_1.pdf, date:
05.10.2018.
https://heinnovate.eu, date: 05.09.2018.
University Index of Turkey, Paris: OECD.
Boston University (2017). The Economic and Community Impact of Boston University, Fiscal Year
2015. Retrieved from https://www.bu.edu/oir/files/2017/05/Final-BU-Economic-Impact-Report-
5_15_17.pdf, date: 19.07.2018.
Carrion, A.; García-Gutiérrez, V.R.; Bas, M.C. & Carot, J.M. (2012). A New Methodology for
Measuring Third Mission Activities of Universities. Proceedings of 6th International Technology,
Education and Development Conference INTED 2012, pp. 1218-1223. Valencia, March. Spain:
IATED. Retrieved from http://apps.webofknowledge.com, date: 20.07.2018.
Damian, L.B.; Morais, R. & Smith, H.J. (2014). University-Business Collaborative Research: Goals,
Outcomes and New Assessment Tools, Belgium: EUA Publications.
DeVol, R.; Lee, J. & Ratnatunga, M. (2017). Concept to Commercialization: The Best Universities for
Technology Transfer. USA: Milken Institute.
European Commission (2009). Metrics for Knowledge Transfer from Public Research Organisations
in Europe. Report from the European Commission’s Experts Group on Knowledge Transfer Metrics.
Brussels, pp.1-79.
European Commission (2010). Assessing Europe’s University-Based Research. Expert Group on
Assessment of University-Based Research, Luxembourg: Publications Office of the European Union.
European Commission (2015). U-Multirank, Implementation of a user-driven, multi-dimensional and
international ranking of higher education institutions. Luxembourg: Publications Office of the
European Union.
European Commission and OECD (2012). A Guiding Framework for Entrepreneurial Universities.
Retrieved from https://www.oecd.org/site/cfecpr/ECOECD%
20Entrepreneurial%20Universities%20Framework.pdf, date: 20.12.2018.
Fornasari, A. (2016), The Role of Universities’ Third Mission in a Globalized Word: Continuing
Education, Social Engagement, Technology Transfer to Relate Science and Society. An International
Case Study: If4tm Project. Proceedings Paper, 9th Annual International Conference of Education,
Research and Innovation (ICERI), pp. 4373-4379. Seville, Spain, Retrieved from
http://apps.webofknowledge.com, date: 19.03.2018.
Government of Romania (2018). Decision no. 915/2017 amending the annex to the Government
Decision No. 1.418/2006 for the approval of the External Evaluation Methodology, the standards, the
reference standards and the list of performance indicators of the Romanian Agency for Quality
Assurance in Higher Education. Published in the Official Monitor, No. 25/11 January 2018.
Green Paper (2018). Fostering and Measuring “Third Mission” in Higher Education Institutions,
Project nr: 2008-3599/001 – 001, LifeLong Learning Program. Retrieved from
http://www.e3mproject.eu/Green%20paper-p.pdf, date: 25.07.2018.
Guthrie, J.; Evans, E. & Burritt, R. (2017). Improving Collaboration and Innovation between Industry
and Business Schools in Australia. Academic Leadership Series, Volume 8, pp. 9-26.
Holi, M.; Wickramasinghe, R. & van Leeuwen, M. (2008). Metrics for the Evaluation of Knowledge
Transfer Activities at Universities. Cambridge: Library House, a Report Commissioned by UNICO.
Jensen, H.P.; Palangkaraya, A. & Webster, E. (2009). A Guide to Metrics on Knowledge Transfer from
Universities to Businesses and Industry in Australia. Australia: Intellectual Property Research Institute
of Australia.
Jonkers, K. et al. (2018). A Regional Innovation Impact Assessment Framework for Universities. JRC
Discussion Paper. Brussels: Joint Research Centre.
Langford, G. (2002). Measuring the Impact of University Research on Innovation. Retrieved from
http://sites.utoronto.ca/isrn/publications/WorkingPapers/Working00/Langford00_Measuring.pdf,
date: 20.07.2018.
Molas-Gallart et al. (2002). Measuring Third Stream Activities. Final Report to the Russell Group
Universities. SPRU, United Kingdom: University of Sussex.
Parliament of Romania (2011). National Education Law No.1/2011. Published in Official Monitoring
No.18/ 10.01.2011, with subsequent amendments.
Piirainen, A.K.; Andersen, P.D. & Andersen, A.D. (2016). Foresight and the Third Mission of
Universities: The Case for Innovation System Foresight. Foresight, Volume 18, Issue 1, pp. 24-40,
Emerald Group Ltd. England, Retrieved from http://apps.webofknowledge.com, date: 19.03.2018.
Pressman, L. et al. (2017). The Economic Contribution of University/Nonprofit Inventions in the United
States: 1996-2015. Biotechnology Industry Organization. Retrieved from
https://www.autm.net/AUTMMain/media/Partner-Events/Documents/Economic-
_Contribution_University-Nonprofit_Inventions_US_1996-2015_BIO_AUTM.pdf, date: 18.07.2018.
Reuters (2018). Methodology: Top 100 Innovative Universities|2017, Retrieved from
https://www.reuters.com/innovative-universities-2017/methodology, date: 05.09.2018.
Romanian Ministry of Education (2018). Order No. 3047/2018 regarding the Methodology for the
allocation of budgetary funds for the basic financing and additional financing of the Romanian higher
education institutions for the year 2018. Published in the Official Monitor No. 127/09.02.2018.
Rubens, A.; Spigarelli, F.; Cavicchi, A. & Rinaldi, C. (2017). Universities' Third Mission and the
Entrepreneurial University and the Challenges they Bring to Higher Education Institutions. Journal of
Enterprising Communities-People and Places of Global Economy, Volume 11, Issue 3, pp. 354-372,
Special Issue: SI, Emerald Group Ltd, Yorkshire, England, DOI: 10.1108/JEC-01-2017-0006,
Retrieved from http://apps.webofknowledge.com, date: 19.03.2019.
Russell Group (2012). The Social Impact of Research Conducted in Russell Group Universities. Russell
Group Papers, Issue 3. Retrieved from
https://www.russellgroup.ac.uk/media/5235/socialimpactofresearch.pdf, date: 21.09.2018.
Sánchez-Barrioluengo, M. (2014). Articulating the Three-Missions in Spanish Universities. Research
Policy, Volume 43, Issue 10, pp. 1760-1773. doi:10.1016/j.respol.2014.06.001, Retrieved from
http://apps.webofknowledge.com, date: 19.03.2019.
Seppo, M. & Lille, A. (2012). Indicators Measuring University-Industry Cooperation. Discussions on
Estonian Economic Policy, Vol. 20, Issue 1, pp. 204-225.
Tabas, J.; Beranová, M. & Polák, J. (2012). Evaluation of Innovation Processes. Acta Universitatis
Agriculturae et Silviculturae Mendelianae Brunensis, Volume LX 69, no 2, pp. 523-532.
Trencher, G.; Yarime, M.; McCormick, K.; Doll, C.; Kraines, S. & Kharrazi, A. (2014). Beyond the
Third Mission: Exploring the Emerging University Function of Co-creation for Sustainability, Science
and Public Policy, Volume 41, Issue 2, pp. 151-179. Oxford University Press, England. Retrieved from
http://apps.webofknowledge.com, date: 19.03.2019.
Tripp Umbach (2018). The Economic and Community Impact of the University of Missouri System.
FY17, Retrieved from https://mospace.umsystem.edu/xmlui/handle/10355/63176, date: 22.07.2018.
University of Washington (2014). 2014 Economic and Community Impact Report of the University of
Washington, Retrieved from http://www.washington.edu/externalaffairs/files/2015/01/14-Economic-
Impact-Report.pdf, date: 21.07.2018.
Vernon, M.M.; Balas, E.A. & Momani, S. (2018). Are University Rankings Useful to Improve
Research? A Systematic Review. PLoS ONE Journal, Volume 13, Issue 3, pp. 1-15.
Veugelers, R. & Del Rey, E. (2014). The Contribution of Universities to Innovation. (Regional) Growth
and Employment. European Expert Network on Economics of Education (EENEE), European
Commission, Analytical Report No. 18.
Watson, D. & Hall, L. (2015) Addressing the Elephant in the Room: Are Universities Committed to the
Third Stream Agenda. International Journal of Academic Research in Management, Volume 4, Issue
2, pp. 48-76.
World Bank Group of Romania (2018). Methodology of University Classification - Project for the
Classification of Universities in Romania – Proposal. Retrieved from
https://www.utcluj.ro/media/notices/2018/Output_2__Classification_2__May_2018__RO_1.pdf, date:
05.10.2018.
https://heinnovate.eu, date: 05.09.2018.
Downloads
Published
2021-07-01
How to Cite
Collective Authors. (2021). Business Administration and Economics: Array. Acta Universitatis Danubius. Œconomica, 15(3). Retrieved from https://dj.univ-danubius.ro/index.php/AUDOE/article/view/1214
Issue
Section
Articles
License
The author fully assumes the content originality and the holograph signature makes him responsible in case of trial.
