BMJ (2009a). About BMJ. [http://resources.bmj.com/bmj/about-bmj] Accessed November 4, 2009.
BMJ (2009b). Open access policy. [http://resources.bmj.com/bmj/about-
bmj/policies/press-release-greater-openness-is-the-future2014the-bmj-and-open- access] Accessed November 4, 2009.
Craig, I. D., Plume, A. M., McVeigh, M. E., Pringle, J., & Aminb, M. (2007). Do open access articles have greater citation impact? A critical review of the literature. Journal of Informetrics 1:239–248.
Davis, P. M. (2009). Author-choice open-access publishing in the biological and medical literature: A citation analysis. Journal of the American Society for Information Science and Technology 60(1):3–8. doi:10.1002/asi.20965
Davis, P. M., & Fromerth, M. J. (2007). Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? Scientometrics 71(2):203– 215. doi:10.1007/s11192-007-1661-8
Davis, P. M., Lewenstein, B. V., Simon, D. H., Booth, J. G., & Connolly, M. J. L. (2008). Open access publishing, article downloads, and citations: Randomised controlled trial. BMJ 337:a568. doi:10.1136/bmj.a568
Evans, J. A. (2009). Response. Science 325:266–267.
Eysenbach, G. (2006). Citation advantage of open access articles. PLoS Biol 4(5):e157. doi:10.1371/journal.pbio.0040157
Flanagan, J. C. (1954). The Critical Incident Technique. Psychological Bulletin 51(4):327-358.
Frandsen, T. F. (2009). Attracted to open access journals: A bibliometric author analysis in the field of biology. Journal of Documentation 65(1):58-82.
doi:10.1108/00220410910926121
Guédon, J.-C. (2001). In Oldenburg’s long shadow: Librarians, research scientists, publishers, and the control of scientific publishing. From Creating the Digital Future (138th Association of Research Libraries Membership Meeting), Toronto, ON. Available at: http://www.arl.org/resources/pubs/mmproceedings/138guedon.shtml
Harnad, S., Brody, T., Vallières, F., Carr, L., Hitchcock, S., Gingras, Y., Oppenheim, C., Stamerjohanns, H., & Hilf, E. R. (2004). The access/impact problem and the green and gold roads to open access. Serials Review 30(4):310–314.
Harnad, S., Brody, T., Vallières, F., Carr, L., Hitchcock, S., Gingras, Y., Oppenheim, C., Hajjem, C., & Hilf, E. R. (2008). The access/impact problem and the green and gold roads to open access: An update. Serials Review 34(1):36–40.
Hey, T., Tansley, S., & Tolle, K. (Eds.). (2009). The Fourth Paradigm: Data-Intensive Scientific Discovery. Redmond, WA: Microsoft Research.
Ioannidis, J. P. A. (2006). Concentration of the most-cited papers in the scientific literature: Analysis of journal ecosystems. PLoS ONE 1(1):e5.
doi:10.1371/journal.pone.0000005
Kyrillidou, M., & Young, M. (Eds.). (2005). ARL statistics 2003-04: A compilation of statistics from the one hundred and twenty-three members of the association of research libraries. Washington, D.C.: Association of Research Libraries.
Kurtz, M. J., Eichhorn, G., Accomazzi, A., Grant, C., Demleitner, M., Henneken, E., & Murray, S. S. (2005). The effect of use and access on citations. Information
Processing and Management 41:1395–1402.
Lawrence, S. (2001). Free online availability substantially increases a paper’s impact. Nature 411:521.
Moed, H. F. (2007). The effect of “open access” on citation impact: An analysis of ArXiv’s Condensed Matter section. Journal of the American Society for Information Science and Technology 58(13):2047–2054. doi:10.1002/asi.20663
Nicholas, D., Huntington, P., & Rowlands, I. (2005). Open access journal publishing: The views of some of the world’s senior authors. Journal of Documentation 61(4):497-519. doi:10.1108/00220410510607499
Norris, M., Oppenheim, C., & Rowland, F. (2008). The citation advantage of open-access articles. Journal of the American Society for Information Science and Technology 59(12):1963–1972. doi:10.1002/asi.20898
Piwowar, H.A., Day, R.S., & Fridsma, D.B. (2007). Sharing detailed research data is associated with increased citation rate. PLoS ONE 2(3):e308.
doi:10.1371/journal.pone.0000308
Savage, C.J., & Vickers, A.J. (2009). Empirical study of data sharing by authors publishing in PLoS journals. PLoS ONE 4(9):e7078.
Schroter, S., & Tite, L. (2006). Open access publishing and author-pays business models: A survey of authors’ knowledge and perceptions. Journal of the Royal Society of Medicine 99:141–148.
Schroter, S., Tite, L., & Kassem, A. (2006). Financial support at the time of paper acceptance: A survey of three medical journals. Learned Publishing 19(4):291-297. Seglen, P. O. (1992). The Skewness of Science. Journal of the American Society for
Information Science 43(9):628-638.
Schroter, S., Tite, L., & Smith, R. (2005). Perceptions of open access publishing: Interviews with journal authors. BMJ doi:10.1136/bmj.38359.695220.82 Shieber S.M. (2009). Equity for open-access journal publishing. PLoS Biol
7(8):e1000165. doi:10.1371/journal.pbio.1000165
Wagner, A. B. (2010). Open access citation advantage: An annotated bibliography. Issues in Science and Technology Librarianship Winter 2010.
APPENDIX A. Initial Recruitment Email Professor [last name],
My name is Chris Doty, and I am a Master’s student in the School of Information and Library Science here at UNC. For my Master’s research I am investigating faculty attitudes about common post-publication metrics (citations, downloads, and page views) that may serve as proxies for article quality. I would like to know the extent to which faculty are concerned with and actively follow post-publication metrics for their articles. Several alternative publishing models have emerged over the past several years, and I am also interested in your perceptions of how these new alternatives might affect these post- publication metrics.
You have been chosen as a candidate for this study by virtue of your status as a tenure- track faculty member in the Department of [Biology or Chemistry] who has published at least one research article in a peer-reviewed journal at some point in the last two years. Your role in this study would consist of participating in an individual 30-minute
interview during which we would talk about post-publication metrics with respect to your most recent publication(s). Your responses will be kept confidential. To the extent possible, results will be reported in the aggregate so as to prevent indirect identification of your participation. Any direct quotes used when reporting the results of this study will be scrubbed of identifying details.
Should participation in the study described above interest you, I would be more than happy to discuss the project in more detail and arrange logistical details for an interview. Should participation in this study not interest you, communication of such will ensure that you do not receive any subsequent follow-up emails.
All the best,
Chris Doty
Master of Science in Information Science School of Information and Library Science University of North Carolina at Chapel Hill
APPENDIX B. Follow-Up Recruitment Email Professor [last name],
About a month ago, I sent you a recruitment email for my Master’s research project on post-publication metrics for scholarly articles. Since I have not heard from you, I have included the text of that message below in the hope that you will consider participating in this study. Should participation in this study not interest you, communication of such will ensure that you do not receive any additional follow-up messages.
Thank you, Chris Doty
_______________________________________________________
My name is Chris Doty, and I am a Master’s student in the School of Information and Library Science here at UNC. For my Master’s research I am investigating faculty attitudes about common post-publication metrics (citations, downloads, and page views) that may serve as proxies for article quality. I would like to know the extent to which faculty are concerned with and actively follow post-publication metrics for their articles. Several alternative publishing models have emerged over the past several years, and I am also interested in your perceptions of how these new alternatives might affect these post- publication metrics.
You have been chosen as a candidate for this study by virtue of your status as a tenure- track faculty member in the Department of [Biology or Chemistry] who has published at least one research article in a peer-reviewed journal at some point in the last two years. Your role in this study would consist of participating in an individual 30-minute
interview during which we would talk about post-publication metrics with respect to your most recent publication(s). Your responses will be kept confidential. To the extent possible, results will be reported in the aggregate so as to prevent indirect identification of your participation. Any direct quotes used when reporting the results of this study will be scrubbed of identifying details.
Should participation in the study described above interest you, I would be more than happy to discuss the project in more detail and arrange logistical details for an interview. Should participation in this study not interest you, communication of such will ensure that you do not receive any subsequent follow-up emails.
All the best, Chris Doty
School of Information and Library Science University of North Carolina at Chapel Hill
APPENDIX C. Informed Consent Form University of North Carolina-Chapel Hill Consent to Participate in a Research Study Adult Participants
Social Behavioral Form
________________________________________________________________________ IRB Study #10-0118
Consent Form Version Date: January 26, 2010
Title of Study: Citations, downloads, and page views: Faculty expectations of post- publication metrics
Principal Investigator: R. Christopher Doty
UNC-Chapel Hill Department: School of Information and Library Science UNC-Chapel Hill Phone number: (919) 357-3655
Email Address: [email protected] Faculty Advisor: Phillip M. Edwards
UNC-Chapel Hill Department: School of Information and Library Science UNC-Chapel Hill Phone number: (919) 962-8068
Email Address: [email protected] Study Contact: R. Christopher Doty
Study Contact telephone number: (919) 357-3655 Study Contact email: [email protected]
________________________________________________________________________ What are some general things you should know about research studies?
You are being asked to take part in a research study. To join the study is voluntary. You may refuse to join, or you may withdraw your consent to be in the study, for any reason, without penalty.
Research studies are designed to obtain new knowledge. This new information may help people in the future. You may not receive any direct benefit from being in the research study. There also may be risks to being in research studies.
Details about this study are discussed below. It is important that you understand this information so that you can make an informed choice about being in this research study. You will be given a copy of this consent form. You should ask the researchers named above any questions you have about this study at any time.
What is the purpose of this study?
The purpose of this research study is to learn about faculty attitudes concerning common post-publication metrics (citations, downloads, page views) that may serve as proxies for article quality. In particular, this study will look to examine faculty expectations for
these metrics when publishing in an open-access journal compared to a subscription- based journal.
You are being asked to be in this study because you are a tenure-track faculty member in the Department of Biology, Chemistry, or Physics and Astronomy who has published at least one research article in a peer-reviewed journal at some point in the last two years. How many people will take part in this study?
If you decide to be in this study, you will be one of approximately 30 people in this research study.
How long will your part in this study last?
If you agree to participant, I will ask you to schedule a time to take part in an interview about your recent publications. This interview is expected to last no longer than 30 minutes, and we may arrange to conduct this interview at a location of your choosing or via the telephone. It is possible, but unlikely, that clarification may be required for one or two of your answers. Should this be necessary, one additional email will be sufficient and should not take more than 15 minutes of your time.
What will happen if you take part in the study?
The scope of your participation in this study is limited to this interview and, possibly, a follow-up email, in the unlikely event that one may be necessary. Interviews will consist of questions about your most recent publication(s), including questions about how you view post-publication metrics and your expectations about the post-publication metrics you expects your recent article(s) to receive. You may choose not to answer any question (for any reason).
What are the possible benefits from being in this study?
Research is designed to benefit society by gaining new knowledge. It is unlikely that you will benefit personally from being in this research study.
What are the possible risks or discomforts involved from being in this study? There are no known risks involved from being in this study.
How will your privacy be protected?
Every precaution will be taken to ensure the confidentiality of your responses. To the extent possible, results will be reported in the aggregate so as to prevent indirect
identification of your identity. Participants will not be directly identified in any report or publication about this study. Although every effort will be made to keep research records private, there may be times when federal or state law requires the disclosure of such records, including personal information. This is very unlikely, but if disclosure is ever required, UNC-Chapel Hill will take steps allowable by law to protect the privacy of personal information. In some cases, your information in this research study could be reviewed by representatives of the University, research sponsors, or government agencies for purposes such as quality control or safety.
With your permission, the interview will be recorded so that a transcript can be made to assist in the qualitative analysis of your responses. Interview transcripts will not contain any direct identifiers. A supplemental code sheet will be created to connect your identity to your transcript. The audio recording and code sheet will be destroyed no later than December 31, 2010. In the meantime, the audio recording and code sheet will be stored in a locked box in the principal investigator’s possession. My faculty advisor and I are the only people who will see the transcript, and I am the only person who will have access to the code sheet.
Should you agree to be recorded, you may request that the audio recording be turned off at any time.
Check the line that best matches your choice: _____ OK to record me during the study _____ Not OK to record me during the study
What if you want to stop before your part in the study is complete?
You can refuse to answer any question during the interview. You can also end this interview at any time, without penalty.
Will you receive anything for being in this study? You will not receive anything for taking part in this study. Will it cost you anything to be in this study?
There will be no costs for being in the study What if you have questions about this study?
You have the right to ask, and have answered, any questions you may have about this research. If you have questions, complaints, concerns, or if a research-related injury occurs, you should contact the researchers listed on the first page of this form. What if you have questions about your rights as a research participant?
All research on human volunteers is reviewed by a committee that works to protect your rights and welfare. If you have questions or concerns about your rights as a research subject, or if you would like to obtain information or offer input, you may contact the Institutional Review Board at 919-966-3113 or by email to [email protected]. - - - Title of Study: Citations, downloads, and page views: Faculty expectations of post- publication metrics
Principal Investigator: R. Christopher Doty Participant’s Agreement:
I have read the information provided above. I have asked all the questions I have at this time. I voluntarily agree to participate in this research study.
_________________________________________________ _________________
Signature of Research Participant Date
_________________________________________________ Printed Name of Research Participant
_________________________________________________ _________________ Signature of Research Team Member Obtaining Consent Date
_________________________________________________ Printed Name of Research Team Member Obtaining Consent
APPENDIX D. Representative Interview Questions 1. Are you familiar with OA publishing?
2. Where did you first learn about it?
3. Would you participate in an author-pay model? 4. Do you track the citations to your articles?
5. What percentage of the people who cite your article do you know?
6. How important are post-publication metrics (citations, downloads, page views) for evaluating the quality of your articles?
7. What kinds of post-publication metrics are you most interested in? 8. Are you interested in the acceleration of citations to your articles? 9. How do you judge recognition from your peers?
10.Do you use citations during tenure considerations?
11.Do you believe an OA citation effect exists for your field?
12.How large an increase in the number of citations would be necessary to get your attention?
13.How did you come to choose the publication venue for your most recent article? 14.How important was the impact factor of this journal when you were deciding where
to publish?
15.Can you estimate how many citations your most recent article will receive? 16.What do think about open data?