Impact evidence for NTRO publications
Non-traditional research outputs
NTROs are activities or artefacts that arise from your research and may serve as impact evidence. They include publications such as:
- creative works
- live performances
- curated or produced exhibitions or events
- research reports commissioned by external bodies.
Use our impact evidence suggestions at the end of this page to:
- add evidence requirements and select quality indicators to support government reporting in UQ eSpace
- document your impact evidence in Impact Tracker.
Add an NTRO to UQ eSpace
You need to manually add your NTRO to UQ eSpace, including:
- uploading a copy, or representation, of the work
- adding your Creator research statement
- selecting relevant quality indicators.
To be eligible for research assessment exercises, each NTRO must include at least one piece of evidence that demonstrates the work or a full representation of the work, e.g., a book, book chapter, research report, event program, or digital recording.
Visit the Non-traditional research outputs section of our UQ eSpace guide for detailed information on NTRO categories and their requirements.
Note: The information in this section is based on the requirements for the previous national research evaluation exercises - Excellence in Research Australia (ERA) and Engagement and Impact (EI). This information may change in the future to reflect new research evaluation initiatives.
Document additional evidence
You can store additional impact evidence in Impact Tracker to collect ongoing evidence of the impact of your work. Visit the Systems Training Hub for how to add project evidence in Impact Tracker.
Request a correction to a record within UQ eSpace to:
- Upload additional evidence
- Request an update to your creator research statement.
Impact evidence suggestions
Browse the following suggestions of impact evidence for each NTRO category. These examples are not exhaustive and are a guide only.
General engagement
These indicators may apply to any NTRO type:
- Media coverage
- Online attention through social media
- Invited presentations
- Enhancement of behaviours or activities (such as health behaviours)
- Changes in knowledge, understanding, attitudes, or beliefs
- Cost-effective intervention or reduction in costs
- Partnership with community or groups to address a community-based need
- Changes or additions to curriculum, teaching materials, or teaching bibliographies
- Development of a guideline, textbook, or statement issue
- Development or influence of education materials
- Improvements in outcome (e.g. effectiveness, performance, quality, consistency)
- Development of mobile applications
- Improvement in health outcomes, quality of life, and/or reduction of prevalence, burden, morbidity or mortality
- Generation of new products or businesses
- Descriptions of public engagement, such as evaluation data or user feedback
- Evidence of sustainability, such as ongoing engagement, a significant increase in participation, continuing sales, downloads, or use of resources
- Contributions to expert panels and policy committees, or advice to government
- Formal partnership agreements or research collaborations
- Consultancies to public or other bodies that utilise research expertise
- Evidence of engagement including membership and activity involvement
- Changes to professional standards and behaviours
- Acknowledgements in annual reports or other publications of NGOs, charities, and other civil society organisations
- Independent testimonials
- Third-party evidence of changed policies, practices, processes, strategies
- Influence or change to legislation and policy.
Original Creative Works
e.g. realised or unrealised building and design projects, digital outputs of architectural and design projects.
Impact evidence suggestions:
- Exhibition or exhibition catalogue recognised nationally or internationally by peers in the discipline
- Commissioning or funding by a distinguished public or private body, or industry partner
- Reproduction or repeat exhibition
- substantial representations or reviews written by peers in the field and published (in print or online) in academic journals or professional publications, by commercial publishers in the national and international press, and/or by not-for-profit bodies of national and international reputation
- Design awards, prizes, honours, short-listing commendations, judged by a panel of peers.
Find more information on Creative Work - Design/Architectural in the Library Guide.
The Creative Work - Textual category includes:
- Book - e.g. novels, play scripts, art reviews, essays, books of poetry
- Book Chapter - e.g. essays, poems, art reviews, short stories and other literary works published as a book chapter
- Journal Article - e.g. essays, poems, art reviews, short stories, design reviews and other literary works published as a journal article
- Textual - Written creative work that is not eligible to be submitted as a book, book chapter, or journal article e.g. standalone literary work or critical reviews/reflections, policy notes.
Impact evidence suggestions:
- Publication in a venue recognised nationally or internationally by peers in the discipline, of at least state standing or higher, such as a state-based publisher, capital city theatre, state-recognised festival
- Publication by major academic or commercial presses, galleries or museums
- Inclusion on university or school reading lists & library holdings
- Online hosting by major institutions
- Commissioning or funding by a distinguished public or private body
- New editions or translations
- Publication in a peer-reviewed publication series
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
Find more information on Creative Work - Textual in the Library Guide.
e.g. photograph, painting, fine arts, sculpture or installation, crafts
Impact evidence suggestions:
- Exhibition, presentation or gallery showings in a venue recognised nationally or internationally by peers in the discipline, such as a major festival or gallery location
- Commissioning or funding by a distinguished public or private body
- Inclusion of work in school or university curriculum
- Recognition through exhibition catalogue from a reputable international or local academic/commercial publisher
- Invitation to repeat exhibitions or performances
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Acquisition by a private or public collection
- Discussion and dissemination by esteemed organisations e.g. broadcast or televised
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
Find more information on Creative Work - Visual Art in the Library Guide.
e.g. original scores, notated/re-interpreted scores, audio compositions
Impact evidence suggestions:
- Publication in a venue recognised nationally or internationally by peers in the discipline
- Publication of the work and prestige of the performer
- Information about any accompanying work (e.g. performance of a composition, production of a film soundtrack)
- Commissioning/funding by a distinguished public or private body
- Sales or download figures
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation.
- Cover by other musicians
Note: Evidence of impact for interactive compositions, performances, or recordings of musical work may be found for those separate outputs.
Find more information on Creative Work - Musical Composition in the Library Guide.
Other is intended for works that do not fit into the other Creative Work research output types, e.g. works that offer a new contribution to broad cultural or social debates, works that develop or extend historical, theoretical, political or design debates.
Impact evidence suggestions:
- Publication in a venue recognised nationally or internationally by peers in the discipline
- Commissioning/funding by a distinguished public or private body
- Re-publication (e.g. poetry works published in a magazine that are re-published as part of an anthology)
- Publication in a peer-reviewed publication series
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
Find more information on Creative Work - Other in the Library Guide.
Live Performance of Creative Work
e.g. performance of a new work or new repertoire, such as a world premiere, developed in partnership with the composer
Impact evidence suggestions:
- Performance in a venue recognised nationally or internationally by peers in the discipline e.g. festivals, concerts etc.
- Performance in association with performing bodies recognised nationally or internationally by peers in the discipline
- Selection of work performed for broadcasting or recording (where publisher or broadcaster is recognised nationally or internationally by peers in discipline)
- Repeat performances and reviews
- Commissioning or funding of the work by a nationally or internationally recognised peer-review body
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation.
- View/stream/download statistics or analysis of comments received through platforms like YouTube
Find more information on Live Performance - Music in the Library Guide.
e.g. performance of a new work or new repertoire, such as a world premiere
Impact evidence suggestions:
- Performance in a venue recognised nationally or internationally by peers in the discipline e.g. festivals, concerts etc.
- Performance in association with performing bodies recognised nationally or internationally by peers in the discipline
- Selection of work performed for broadcasting or recording (where publisher or broadcaster is recognised nationally or internationally by peers in discipline)
- Repeat performances and reviews
- Commissioning or funding of the work by a nationally or internationally recognised peer-review body
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation.
- View/stream/download statistics or analysis of comments received through platforms like YouTube
Find more information on Live Performance - Dance in the Library Guide.
e.g. performance of a new work for live theatre, such as a world premiere
Impact evidence suggestions:
- Performance in a venue recognised nationally or internationally by peers in the discipline e.g. festivals, concerts etc.
- Performance in association with performing bodies recognised nationally or internationally by peers in the discipline
- Selection of work performed for broadcasting or recording (where publisher or broadcaster is recognised nationally or internationally by peers in discipline)
- Repeat performances and reviews
- Commissioning or funding of the work by a nationally or internationally recognised peer-review body
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation.
- View/stream/download statistics or analysis of comments received through platforms like YouTube
Find more information on Live Performance - Plays, Drama, Theatre in the Library Guide.
e.g. experimental live performances using hybrid forms or new combinations of performance genres
Impact evidence suggestions:
- Performance in a venue recognised nationally or internationally by peers in the discipline e.g. festivals, concerts etc.
- Performance in association with performing bodies recognised nationally or internationally by peers in the discipline
- Selection of work performed for broadcasting or recording (where publisher or broadcaster is recognised nationally or internationally by peers in discipline)
- Repeat performances and reviews
- Commissioning or funding of the work by a nationally or internationally recognised peer-review body
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation.
- View/stream/download statistics or analysis of comments received through platforms like YouTube
Find more information on Live Performance - Interarts in the Library Guide.
e.g. live performance works that do not fit other types in this section
Impact evidence suggestions:
- Performance in a venue recognised nationally or internationally by peers in the discipline e.g. festivals, concerts etc.
- Performance in association with performing bodies recognised nationally or internationally by peers in the discipline
- Selection of work performed for broadcasting or recording (where publisher or broadcaster is recognised nationally or internationally by peers in discipline)
- Repeat performances and reviews
- Commissioning or funding of the work by a nationally or internationally recognised peer-review body
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
- View/stream/download statistics or analysis of comments received through platforms like YouTube
Find more information on Live Performance - Other in the Library Guide.
Recorded or Rendered Creative Work
e.g. recorded performance of a new work or repertoire, such as a world premiere, or a repertoire that has been newly discovered/edited by performers
Impact evidence suggestions:
- Commercial release under a label recognised by peers in the discipline
- Performance recorded in association with bodies recognised nationally or internationally by peers in the discipline
- Selection of the work for broadcast or inclusion in festivals, where broadcast/festival is recognised nationally or internationally by peers in the discipline
- Commissioning/funding by a distinguished public or private body
- Awards, prizes, honour, short-listing etc. judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
- View/stream/download statistics or analysis of comments received through platforms like Spotify or YouTube
Find more information on Recorded or Rendered Creative Work - Music, Dance, Theatre in the Library Guide.
e.g. use of innovative production techniques in films, documentaries, video-based podcasts, moving or still image-based or screen-based work, or audio-visual presentations
Impact evidence suggestions:
- Presentation in a venue recognised nationally or internationally by peers
- Dissemination by a commercial or not-for-profit body of national or international reputation
- Commissioning or funding by a distinguished public or private body
- Discussion and dissemination by esteemed broadcast organisations
- Awards, prizes, honours, short-listing etc., judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
- View/stream/download/sales statistics, or analysis of comments received through platforms like Spotify or YouTube
- Development of works that complement the original (e.g. for computer applications – plug-ins)
Find more information on Recorded or Rendered Creative Work - Audio or Visual in the Library Guide.
e.g. 3D or multidimensional models, creative and interactive computer applications, digital games/apps and computer programs
Impact evidence suggestions:
- Presentation in a venue recognised nationally or internationally by peers
- Dissemination by a commercial or not-for-profit body of national or international reputation
- Commissioning or funding by a distinguished public or private body
- Discussion and dissemination by esteemed broadcast organisations
- Awards, prizes, honours, short-listing etc., judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
- View/stream/download/sales statistics, or analysis of comments received through platforms like Spotify or YouTube
- Development of works that complement the original (e.g. for computer applications – plug-ins)
Find more information on Recorded or Rendered Creative Work - Digital in the Library Guide.
e.g. experimental audio recordings, collaborative recordings across disciplines
Impact evidence suggestions:
- Presentation in a venue recognised nationally or internationally by peers
- Dissemination by a commercial or not-for-profit body of national or international reputation
- Commissioning or funding by a distinguished public or private body
- Discussion and dissemination by esteemed broadcast organisations
- Awards, prizes, honours, short-listing etc., judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
- View/stream/download/sales statistics, or analysis of comments received through platforms like Spotify or YouTube
- Development of works that complement the original (e.g. for computer applications – plug-ins)
Find more information on Recorded or Rendered Creative Work - Interarts in the Library Guide.
e.g. recorded or rendered work where the eligible researcher is the creator of the web-featured work, online/digital works that incorporate new presentation techniques, approaches in online media or platforms
Impact evidence suggestions:
- Hosting by a major institution – a commercial or not-for-profit body of national or international reputation
- Commissioning or funding by a distinguished public or private body
- Awards, prizes, honours, short-listing, etc., judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
- Electronic downloads and website visits
Find more information on Recorded or Rendered Creative Work - Web Exhibition in the Library Guide.
Other is intended for works that do not fit into the other Recorded or Rendered Creative Work research output types, e.g. audio essays, creative and scholarly audio podcasts or documentaries.
Impact evidence suggestions:
- Hosting by a major institution – a commercial or not-for-profit body of national or international reputation
- Commissioning or funding by a distinguished public or private body
- Awards, prizes, honours, short-listing, etc., judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
- Electronic downloads and website visits
Find more information on Recorded or Rendered Creative Work - Other in the Library Guide.
Curated or Produced Exhibition or Event
This category contains the curation and/or production of creative works or artefacts exhibited in a recognised gallery, museum or similar venue, in order to:
- show new works or a new interpretation/arrangement of works exhibited previously; or
- to explore a new, innovative or significant thesis; or
- to make a substantial declaration of historical, cultural or theoretical principles.
Impact evidence suggestions:
- Exhibition or presentation in a venue recognised nationally or internationally by peers in the discipline
- Exhibition or presentation of creative works recognised as significant by peers in the discipline
- Commissioning/funding of event/exhibition by a distinguished public or private body
- Discussion and dissemination in esteemed publishing or broadcasting organisations
- Substantial reviews written by peers in the field and published (in print or online) in academic journals, by commercial publishers in the national and international press, and/or by not-for-profit bodies of national and international reputation
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Sales/box office ratings data for film, ticketed art exhibitions or tv releases
- Number of views or streams via online platforms (Youtube/Spotify) if web-based, and mentions via social media
- Inclusion in broader works (compilations, festivals, interviews etc.)
Find more information on Curated or Produced Exhibition or Event in the Library Guide.
Other is intended for works that do not fit into the other Curated or Produced Exhibition or Event research output types - e.g. objects presented together for the first time, existing groups of objects presented via new and innovative cultural methodologies, interpretations or approaches.
Impact evidence suggestions:
- Exhibition or presentation in a venue recognised nationally or internationally by peers in the discipline
- Exhibition or presentation of creative works recognised as significant by peers in the discipline
- Commissioning/funding of event/exhibition by a distinguished public or private body
- Discussion and dissemination in esteemed publishing or broadcasting organisations
- Substantial reviews written by peers in the field and published (in print or online) in academic journals, by commercial publishers in the national and international press, and/or by not-for-profit bodies of national and international reputation
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Sales/box office ratings data for film, ticketed art exhibitions or tv releases
- Number of views or streams via online platforms (Youtube/Spotify) if web-based, and mentions via social media
- Inclusion in broader works (compilations, festivals, interviews etc.)
Find more information on Curated or Produced Exhibition or Event - Other in the Library Guide.
The curation of a festival bringing together creative works or artefacts and live performance, in order to:
- present new works in an innovative way; or
- present a new interpretation/approach to works presented previously; or
- offer a theme that provides new perspectives and/or experiences
Impact evidence suggestions:
- Exhibition or presentation in a festival recognised nationally or internationally by peers in the discipline
- Exhibition or presentation of creative works recognised as significant by peers in the discipline
- Commissioning/funding by a distinguished public or private body
- Discussion and dissemination in esteemed publishing or broadcasting organisations
- Substantial reviews written by peers in the field and published (in print or online) in academic journals, by commercial publishers in the national and international press, and/or by not-for-profit bodies of national and international reputation
- Awards, short-listing, prizes, honours, etc. judged by a panel of peers
- Exhibition catalogues – sales and downloads
- Ticketed sales data
- Number of views or streams via online platforms (YouTube/Spotify) and mentions via social media
Find more information on Curated or Produced Exhibition or Event - Festival in the Library Guide.
e.g. digital repositories, interactive and searchable databases, digital reference works, digital archives
Impact evidence suggestions:
- Hosting by an industry or educational institution of national or international reputation amongst peers in the discipline
- Commissioning or funding by a distinguished public or private body
- Awards, short-listing, prizes, honours, judged by a panel of peers
- Substantial reviews of the work written by peers in the field and published (in print and/or online) in academic journals, by commercial publishers in the national or international press, and/or by not-for-profit bodies of national and international reputation
- Number of views or streams via online platforms (Youtube/Spotify) if web-based, and mentions via social media
Find more information on Curated or Produced Exhibition or Event - Web Exhibition in the Library Guide.
Research Reports
A research report, review or document commissioned by an Australian, state, territory, local, foreign, or international government body or organisation.
Impact evidence suggestions:
- Commissioning or funding of the report by a distinguished government or non-government body
- Appointment through a quality selection process
- Affirmative citation (e.g. supporting statements or claims made) in other reports or publications – found through Google scholar, cited references in Scopus & Web of Science
- Recognition of research conclusions by experts employed in the relevant field of government and/or industry
- Recognition in critical or scholarly essays and/or articles (print or electronic)
- Recognition in policy documents
- Recognition through an award or honour judged by a panel of peers
Note: there may be cases where the evidence (metadata) for a “research report – internal or citation only" may not be publicly available, as is outlined in the UQ eSpace guide.
Find more information on Research Report for an External Body - Public sector in the Library Guide.
A research report or review that has been undertaken for a company, commercial enterprise, industry organisation, industry peak body, or an employer/employee association.
Impact evidence suggestions:
- Commissioning or funding of the report by a distinguished government or non-government body
- Appointment through a quality selection process
- Affirmative citation (e.g. supporting statements or claims made) in other reports or publications – found through Google scholar, cited references in Scopus & Web of Science
- Recognition of research conclusions by experts employed in the relevant field of government and/or industry
- Recognition in critical or scholarly essays and/or articles (print or electronic)
- Recognition in policy documents
- Recognition through an award or honour judged by a panel of peers
Note: there may be cases where the evidence (metadata) for a “research report – internal or citation only" may not be publicly available, as is outlined in the UQ eSpace guide.
Find more information on Research Report for an External Body - Industry in the Library Guide.
A research report or review that has been undertaken for a discipline recognised body, enterprise or organisation operating in the not-for-profit sector.
Impact evidence suggestions:
- Commissioning or funding of the report by a distinguished government or non-government body
- Appointment through a quality selection process
- Affirmative citation (e.g. supporting statements or claims made) in other reports or publications – found through Google scholar, cited references in Scopus & Web of Science
- Recognition of research conclusions by experts employed in the relevant field of government and/or industry
- Recognition in critical or scholarly essays and/or articles (print or electronic)
- Recognition in policy documents
- Recognition through an award or honour judged by a panel of peers
Note: there may be cases where the evidence (metadata) for a “research report – internal or citation only" may not be publicly available, as is outlined in the UQ eSpace guide.
Find more information on Research Reports for an External Body - Not-for-profit in the Library Guide.
A research report or review undertaken for an organisation not covered by the other sub-categories, including papers and educational materials, such as commissioned policy papers, annual reports, training manuals or clinical practice guidelines.
Impact evidence suggestions:
- Commissioning or funding of the report by a distinguished government or non-government body
- Appointment through a quality selection process
- Affirmative citation (e.g. supporting statements or claims made) in other reports or publications – found through Google scholar, cited references in Scopus & Web of Science
- Recognition of research conclusions by experts employed in the relevant field of government and/or industry
- Recognition in critical or scholarly essays and/or articles (print or electronic)
- Recognition in policy documents
- Recognition through an award or honour judged by a panel of peers
Note: there may be cases where the evidence (metadata) for a “research report – internal or citation only" may not be publicly available, as is outlined in the UQ eSpace guide.
Find more information on Research Report for an External Body - Other in the Library Guide.
- Non-commissioned internal UQ-published research reports
- Non-commissioned externally-published research reports, or
- Non-commissioned internal or externally published reports with an embargo on the report itself, but public access to the metadata about the report via UQ eSpace is permissible.
Impact evidence suggestions:
- Commissioning or funding of the report by a distinguished government or non-government body
- Appointment through a quality selection process
- Affirmative citation (e.g. supporting statements or claims made) in other reports or publications – found through Google scholar, cited references in Scopus & Web of Science
- Recognition of research conclusions by experts employed in the relevant field of government and/or industry
- Recognition in critical or scholarly essays and/or articles (print or electronic)
- Recognition in policy documents
- Recognition through an award or honour judged by a panel of peers
Note: there may be cases where the evidence (metadata) for a “research report – internal or citation only" may not be publicly available, as is outlined in the UQ eSpace guide.
Find more information on Research Report - Other or Citation Only in the Library Guide.