Chapter 4 Evidence - research quality and societal relevance

4. Evidence - research quality and societal relevance

As described above, achievements have been realized by following the original strategic aims we set up in 2016 (see Section 2, p. 08) and the institute’s subsequent strategy (i.e., 2019-2021, see Section 3, p. 13). In this section, ‘Evidence’, the Strategy Evaluation Protocol (SEP) is strictly followed by discussing research quality and relevance to society. The narratives in this domain are evidence-based and supported by so-called matrix analyses, as shown in Appendices 3 (p. 57), 4 (p. 66) and 5 (p. 79), and further showcased by a selection of ‘use cases’ collected in Appendix 6, p. 83.

Research products for peers

The research output of Amsterdam Neuroscience is summarized in Table 3.2.1 and Table 3.2.2, p. 57; our work includes 7,995 peer-reviewed articles in addition to book chapters and conference proceedings. The institute’s research output is the result of an increasing number of co-authorships between Amsterdam Neuroscience’s Principal Investigators (see Appendix 5, p. 79). We established a research infrastructure with several new corefacilities in a new research initiative called ADORE, co-founded Hersenonderzoek.nl and we organize various scientific conferences such as our Amsterdam Neuroscience Annual Meetings and TN2 conferences. In addition, we advertise the research we do through our website, at conferences and symposia, and in (social) media (see Appendix 6, p. 98). Use of research products by peers

Over the years we have published numerous excellent reviews (see Table 3.2.1 and Table 3.2.2, p. 57). Overall our work is well cited as is clear from our Annual Reports (see Annual Reports 2016-2021) and also summarized in Appendix 3 (p. 64) and analyzed by an external agency in Appendix 4 (p. 66). Over the years, we have established several expertise centers (see Figure 12, p. 22) and also built data-platforms that are made available to our peers (i.e., Hersenonderzoek.nl and RCT-Alert). Appendix 4 (p. 66) includes tables listing the number of papers co-authored with other academic institutes, with non-academic private hospitals and with industrial partners. Marks of recognition from peers

The Veni-Vidi-Vici grants received by investigators affiliated with Amsterdam Neuroscience are listed on our website, as are our ERC recipients. In addition, key opinion leaders of Amsterdam Neuroscience coordinate several major grant-awarded collaborative projects, including a Gravity Project (Brainscapes), several Dutch Research Agenda (NWA) projects, a Knowledge and Innovation Covenant (KIC) center grant, a National Public-Private Partnership grant (ABOARD), and a Neurotech grant (see Appendix 6, p. 83). Many of the program leaders and taskforce members listed in Appendix 1 (p. 33) have affiliated appointments in scientific councils, advisory committees and international organizations (such the Alzheimer’s Association International Conference, the European Committee for Treatment and Research in Multiple Sclerosis, the European Congress of Clinical Microbiology and Infectious Diseases, and the European College of Neuropsychopharmacology Congress).

Research Quality

Relevance to society

Metrics analysis

For the purpose of this evaluation, the analysis of the relevance of our research to society was pursued in several ways. As indicated in Appendix 4 (p. 66), so-called ‘term map’ visualizations (networks) were produced based on keywords, extracted from textual data of titles and abstracts of all research publications reported by Amsterdam Neuroscience in the period 2016-2021. The term map visualizations were created with VOSviewer (Van Eck and Waltman, 2010; see Figure 4.2.1, p. 72). Next, so-called ‘societal heatmaps’ were produced by color-coding the relative uptake of these terms – as compared to a worldwide reference database (generated by the Centre for Science and Technology Studies (CWTS) at Leiden University) - in policy documents, clinical guidelines, the media, citations in patents, and the relative number of co-authors in industry and non-academic hospitals (see Figures 4.2.2-4.2.7, p. 73).

In each of these figures, the three or four most prominent contributing research programs of Amsterdam Neuroscience were overlaid on these societal heatmaps. This showed, for instance, that MAPSS, CIA and NII publish research on topics and terms most often used in policy documents worldwide (Figure 4.2.2, p. 73); that MAPSS, CIA and NDIS publish on topics and terms most often used in clinical guidelines worldwide (Figure 4.2.3, p. 74); that ND, BI and CTG publish on topics and terms often used in the media worldwide (Figure 4.2.4, p. 75); that BI, CMM, CTG and ND publish using key terms of relevance to industry (Figure 4.2.5 p. 76); that CMM, BI, CTG and ND also publish using terms often used in patent citations worldwide (Figure 4.2.6, p. 77); and NDIS, NII and ND are the programs that most often publish reports with experts from non-academic hospitals as co-authors (Figure 4.2.7, p. 78). The relevance of the SNN research program to society is not limited to one specific research topic area in the term map, which explains why this program did not appear to be prominent in Figures 4.2.1-4.2.7. Their research areas are more spread and overlap with other programs (mainly BI, CMM and ND) in the network). Evidence-based narratives (research products for societal target groups)

In addition to the estimated metrics of societal relevance, we have also produced an overview in which we provide evidence-based narratives by presenting a selection of use cases which, in our view, are most relevant both in terms of scientific excellence as well as in terms of societal relevance (see Appendix 6, p. 83). These include a number of books authored by Amsterdam Neuroscience affiliates (including Cyriel Pennartz, Damiaan Denys, Odile van den Heuvel, Annemieke Dols and Christiaan Vinkers) that have been published. And a number of patents have been filed by CNCR and UvA-Swammerdam Institute for Life Sciences (SILS) investigators (Guus Smit, Matthijs Verhage, Marten Smidt and Lars van der Heide).

We have published several video-films and online conference material (i.e., the Amsterdam UMC & COVID-19 event, and IAO film) and we have posted several news items in particular over the past three years through our website and LinkedIn. The visitor statistics for the Amsterdam Neuroscience website are vastly rising, as are the numbers of visitors to the more than 500 posts on LinkedIn and Twitter (see Appendix 6, Figure 6.1, p. 98). In addition, the Alzheimer Center Amsterdam, the MS Center Amsterdam and the CNCR organize public meeting days on an annual basis in which patients and carers are informed about the latest insights in the field (see Figure 10, p. 20). And last but not least, we have been publishing the Amsterdam Neuroscience MAGAZINE every year since 2019 (see Figure 9, p. 19) as an integral result of our renewed communication strategy (see Figure 5, p. 12).

Relevance to society

Use of products by societal target groups

Here we want to showcase two projects in particular: ABOARD, coordinated by Wiesje van der Flier, and Don’t be late, coordinated by Hanneke Hulst. We perform contract research and execute clinical trials through our IAO. As indicated in the previous section, the IAO has generated major contract deal flow through the years and is serving many global biotech and pharma parties. Amsterdam Neuroscience’s investigators also organize the Graduate School Neurosciences Amsterdam Rotterdam (ONWAR) (also see Appendix 8, p. 103).

Amsterdam Neuroscience

MAGAZINE We care about the brain

Magazine 2019 Magazine 2020

Magazine 2021 (online only)

Figure 9 Team science is a prominent element being featured in our Amsterdam Neuroscience MAGAZINE, the annual publication that celebrates the achievements and hard work of the investigators and colleagues in the neuroscience field. The three editions of the magazine already published contain in-depth interviews and short profiles of prominent junior and senior investigators. A must-read for anyone interested in the neuroscience research community in Amsterdam. See Amsterdam Neuroscience MAGAZINE.