Reinventing the Methods Journal: Increasing Reproducibility with Video Journals

Kira (2013) "Reinventing the Methods Journal: Increasing Reproducibility with Video Journals Reinventing the Methods Journal: Increasing Reproducibility with Video Journals Kira Henderson JoVE Follow this and additional works at: https://docs.lib.purdue.edu/atg Part of the Library and Information Science Commons - Article 9 The requirement for geospatial tagging was also problematic. For example, the following caption explains that the painting in question was once in Florence, but the aim was to have dates and places held in separate fields so users would be able to search by dates and date ranges rather than through a simple string-based search. This is one of two panels that were part of the predella that forms the lower edge of the large altarpiece of v eneziano’s “St. Lucy Altarpiece” (c.1442-48). Originally in the church of St. Lucia dei Magnoli in Florence, the altarpiece appears to have been dismantled by 1816. A large number of images and moving images were rejected at the initial evaluation because of spelling errors in the encodings or metadata. This problem particularly applied to the “rushes” (the never-before seen unedited footage from which news broadcasts are selected), which Jisc had encouraged the vendors to provide. It should also be remembered that commercial providers usually compile metadata for internal use, rather than for publication, and so most of the encodings and metadata supplied had not been through any form of editorial review. The logistical and metadata problems overcome, the project produced more than 500 hours of film clips — fromgorbachev’s accession to power in the Soviet Union in 1985 to the financial crisis of 2009, and including powerful raw footage of the 9/11 attacks as well as coverage of key issues such as deforestation and global warming. All told, a large and diverse collection of over 56,000 photographs to support teaching and lifelong learning was developed in the areas of history, social sciences, science, art and creative industries, and geography. These collections were and continue to be delivered to the UK academic community through a service called Jisc MediaHub, which provides a single point of access and enables users to search and link out to other external media collections such as the Open Video Project, Wellcome Images, ADS, ARKive, and the First World War Poetry Archive. In summary, although Jisc usually negotiates with vendors on behalf of libraries, in the area of media resources we recommend a tender process, not least because this ensures a very clear definition of requirements and evaluation process. Evaluation by educational experts is essential in building collections that will be of value in research and teaching and provide a long-term return on investment. Licenses in perpetuity — or for at least a very long term, are essential, because it is impossible to sustain annual subscription fees in an uncertain economic climate. Finally, metadata is king! However interesting or informative an image, it is useless if it cannot be found. Reinventing the Methods Journal: Increasing Reproducibility with Video Journals by Kira henderson (Deputy Director of Journal Development, JoVE) <> Tmust be rehabilitated or risk becoming he way science journals present research obsolete, causing foreseeable negative consequences to research funding and productivity. Researchers are dealing with everincreasing complexities, and as techniques and solutions become more involved, so too does the task of describing them. Unfortunately, simply explaining a technique with text does not always paint a clear enough picture. Scientific publishing has followed essentially the same model since the original scientific journal was published in the mid-seventeenth century. Thanks to advances in technology, we have seen some minor improvements such as the addition of color printing and better dissemination and search functionality through online cataloging. But what has actually changed? In truth, not all that much. Articles are still published as text heavytomes with the occasional photograph or chart to demonstrate a point. Dr. John ioannidis, the C.F. Rehnborg Chair in Disease Prevention at Stanford university, and two independent teams of scientific analysts, recently attempted to reproduce the findings of 18 research articles. The articles, published in Nature Genetics in 2005 and 2006, profiled gene expression from microarray data. Despite the authors’ claims that the microarray data set was publicly available, the procedures were not detailed enough to allow for accurate reproduction of the findings for 16 of the 18 articles.1 Inability to reproduce findings is not an uncommon problem in modern science. Several other independent studies confirm Dr. ioannidis’ findings, including a report by researchers at Amgen pharmaceutical company, where only six of the 53 studies they tested were reproducible,2 and an internal report at bayer healthCare, where results (...truncated)