EDaWaX WP2: Some Information about Journals and Selection of our Analysis

Posted: April 2nd, 2012 | Author: | Filed under: EDaWaX | Tags: , , , | 2 Comments »

Today I want to share some parts of our current research with you. While writing our report on the work package 2, I thought it would be a good idea to publish some of my thoughts – it helps to structure all the information we have.
I start with a brief introduction about the selection of scholarly journals for our research work. Surely this will be only a small excerpt of the whole information presented in the report. So watch out for this publication!

Read the rest of this entry »


New Working Paper published: ‘The Economics of Replication’

Posted: February 14th, 2017 | Author: | Filed under: Data Sharing, EDaWaX, journals | Tags: , | Comments Off on New Working Paper published: ‘The Economics of Replication’

Frank Mueller-Langer, Benedikt Fecher, Dietmar Harhoff and Gert G. Wagner have published a new working paper on the ‘economics of replication’.

In the abstract of the paper, the researchers state:

“Replication studies are considered a hallmark of good scientific practice. Yet they are treated among researchers as an ideal to be professed but not practiced. To provide incentives and favorable boundary conditions for replication practice, the main stakeholders need to be aware of what drives replication. Here we investigate how often replication studies are published in empirical economics and what types of journal articles are replicated. We find that from 1974 to 2014 less than 0.1% of publications in the top-50 economics journals were replications. We do not find empirical support that mandatory data disclosure policies or the availability of data or code have a significant effect on the incidence of replication. The mere provision of data repositories may be ineffective, unless accompanied by appropriate incentives. However, we find that higher-impact articles and articles by authors from leading institutions are more likely to be subject of published replication studies whereas the replication probability is lower for articles published in higher-ranked journals.”

The paper is available here.

Read the rest of this entry »


EDaWaX-Study on Data Policies of Journals in Economics and Business Studies (Part I)

Posted: January 14th, 2015 | Author: | Filed under: Data Policy, EDaWaX, journals | Tags: , | 1 Comment »

300_Journals_DFG1One work package (WP2) of EDaWaX’s second funding phase deals with a broader analysis and comparison of journals’ data policies in economics and business studies. In the project’s first funding phase we already have conducted a similar survey, but it primarily focused on journals in economics.

Because research data and methodology in business studies are not necessarily identical to those employed in economics, we found it to be important to compare journals’ data policies of both branches of economic research. Read the rest of this entry »


Project Output: Funding Phase I

Posted: June 25th, 2014 | Author: | Filed under: | No Comments »

300_ljguitar_8218737821_8a79aa7409

On this page you will find all our journal articles, working papers, presentations as well as our poster and some miscellaneous content.

Though we are moving on to project phase 2, we assume that several parts of project phase 1 are still of interest to a broader audience.

The project output of EDaWaX’s second funding phase is grouped into the different sorts of publications, presentations and other outouts.

 

Journal ArticleJournal Articles and Conference Proceedings:

in English:

  • Paper: Andreoli-Versbach, Patrick /Mueller-Langer, Frank: “Open access to data: An ideal professed but not practised”.  Research Policy, Vol. 43, Issue 7, 2014, http://dx.doi.org/10.1016/j.respol.2014.04.008.
  • Paper: “Data Management in Scholarly Journals and possible Roles for Libraries – Some Insights from EDaWaX .”  LIBER Quarterly, Vol.23, Issue 1, 2013 [html | pdf]
  • Paper: “On the role of research data centres in the management of publication-related research data.” LIBER Quarterly Vol.23, Issue 4, 2014. [html | pdf]

in German:

  • Paper: “Welche Rolle spielen Forschungsdaten eigentlich für Fachzeitschriften? Eine Analyse mit Fokus auf die Wirtschaftswissenschaften.” In: Mittermaier, Bernhard (Ed.): Vernetztes Wissen – Daten, Menschen, Systeme. 6. Konferenz der Zentralbibliothek, Forschungszentrum Jülich, 5. – 7. November 2012, Proceedingsband, Schriften des Forschungszentrums Jülich, Reihe Bibliothek / Library Band / Volume 21, pp. 29 – 44.
  • Paper: Vlaeminck, S. / Wagner, G.G / Wagner, J. / Harhoff D. / Siegert, O.: “Replizierbare Forschung in den Wirtschaftswissenschaften erhöhen – eine Herausforderung für wissenschaftliche Infrastrukturdienstleister.” LIBREAS. Library Ideas, 23 (2013). (October 2013)

Working PaperWorking Paper:

in English:

  • Paper: Andreoli-Versbach, Patrick /Mueller-Langer, Frank: Open Access to Data: An Ideal Professed but Not Practised (February 21, 2013). RatSWD Working Paper Series No. 215.
  • Paper: ”On the role of research data centres in the management of publication-related research data.” RatSWD Working Paper Series (226)

in German:

  • Summary: Max Planck Institute for Innovation and Competition: Information infrastructure for research data: The project European Data Watch Extended. [main parts in German]
  • Paper: “Welche Rolle spielen Forschungsdaten eigentlich für Fachzeitschriften? Eine Analyse mit Fokus auf die Wirtschaftswissenschaften.” RatSWD Working Paper Series, No. 210. (Updated version)
  • Paper: “Zur Rolle von Forschungsdatenzentren beim Management von publikationsbezogenen Forschungsdaten. Ergebnisse einer Befragung von wissenschaftlichen Infrastrukturdienstleistern.” RatSWD Working Paper Series (225).

PresentationPresentations:

in English:

  • Presentation: “Data Management in Scholarly Journals and possible Roles for Libraries – Some Insights from EDaWaX .” Talk given at the 41st Annual Conference of LIBER | June 27, 2012 | Tartu | Estonia.
  • Presentation: “Facilitating Replications of Research Results in Economics.” Talk given at the 1. Open Economics International Workshop | December 16th 2012 | Cambridge | UK.
  • Presentation: “Research Data Management in Economics Journals – Data Policies and Data Description as prerequisites of reproducible Research.” Presentation given at the IASSIST-Conference | May 31, 2013 | Cologne | Germany.

in German:

  • Presentation: “„Linking Data and Publications“ – Anforderungen und Vorgehensweise am Beispiel des Aufbaus eines publikationsbezogenen Datenarchivs.” | Presentation given at a plenary meeting of the Standing Committee Research Data Infrastructure (FDI) | March 2013 | Berlin.
  • Presentation: “Wirtschaftswissenschaftliche Forschung replizierbar machen“. Project presentation and first findings. Talk given at the 101st German Bibliothekartag | June 2012 | Hamburg | Germany.
  • Presentation: “Anforderungen für den Aufbau eines publikationsbezogenen Datenarchivs in den Wirtschaftswissenschaften ”. Talk given at the 6th Open Access Day | September 26, 2012 | Vienna | Austria.
  • Presentation: “Welche Rolle spielen Forschungsdaten eigentlich für Fachzeitschriften? Eine Analyse mit Fokus auf die Wirtschaftswissenschaften.” Talk given at the 6th WissKom Conference | November 5, 2012 | Jülich | Germany.
  • Presentation: “Forschungsdaten und Forschungsdateninfrastrukturen in den Wirtschaftswissenschaften” | Talk given at the 7th Open Access Days | October 2013 | Hamburg | Germany.
  • Presentation: “Forschungsdatenmanagement bei wirtschaftswissenschaftlichen Zeitschriften – Ergebnisse des Projekts EDaWaX “ | DFG-Workshop „Vernetzung – Nachnutzung – Austausch“ | December 16/17 2013 | Bonn.
  • Presentation: “Wirtschaftswissenschaftliche Ergebnisse replizierbarer machen. Das Projekt EDaWaX und seine Ergebnisse.” Talk given at the PubMan Days 2013 | October 21, 2013 | Munich | Germany.
  • Presentation: “Forschungsdatenmanagement bei wirtschaftswissenschaftlichen Zeitschriften – Einblicke aus dem DFG-Projekt EDaWaX .” Talk given at the 6. Conference for Social- and Economic Data (KSWD)| February 21, 2014 | Berlin | Germany.

PosterPoster:

  • Poster for a Knowledge Exchange (KE) Workshop on Research Data | November 2011 | Bonn | Germany.

MiscellaneousMiscellaneous:

Image: “Trinity belt pack in/output” by Larry Jacobsen / ljguitar on flickr.com. License: CC-BY 2.0
All icons (except the last one) made by Freepik from www.flaticon.com  
License:Flaticon Basic License.
Icon (‘miscellaneous’) last shown:”Folder couple one black other white” by SimpleIcon from www.flaticon.com. License: CC-BY 3.0


Research Data Management in Economic Journals (Part I)

Posted: December 10th, 2012 | Author: | Filed under: Data Policy, EDaWaX | Tags: , , , | 1 Comment »

This article is cross-posted from the blog of the Open Economics Working Group

Background

edawax-logoIn Economics, as in many other research disciplines, there is a continuous increase in the number of papers where authors have collected their own research data or used external datasets. However, so far there have been few effective means of replicating the results of economic research within the framework of the corresponding article, of verifying them and making them available for repurposing or using in the support of the scholarly debate.

In the light of these findings B.D. McCullough pointed out: “Results published in economic journals are accepted at face value and rarely subjected to the independent verification that is the cornerstone of the scientific method. Most results published in economics journals cannot be subjected to verification, even in principle, because authors typically are not required to make their data and code available for verification.” (McCullough/McGeary/Harrison: “Lessons from the JMCB Archive”, 2006)

Harvard Professor Gary King also asked: “[I]f the empirical basis for an article or book cannot be reproduced, of what use to the discipline are its conclusions? What purpose does an article like this serve?” (King: “Replication, Replication” 1995). Therefore, the management of research data should be considered an important aspect of the economic profession.

Read the rest of this entry »


EDaWaX: First paper published! #Update

Posted: November 6th, 2012 | Author: | Filed under: Conference, EDaWaX | Tags: , , | Comments Off on EDaWaX: First paper published! #Update

I am happy to announce that some of the results we obtained in our analyses have been published in the proceedings of the WissKom2012 conference (pp.29 ff).

In the research paper for Wisskom2012 Olaf Siegert and I summarized some of the findings of the EDaWaX project.  Unfortunately the paper is available in German only, but I promise to publish some more of our major findings in English – eighter on this blog or in a seperate paper. Some results of our analyses are already published here: ( |1 | 2 | 3 | 4 | )

The presentation I gave in Jülich is available in the download section of the blog.

I also wrote a paper in English that has already been accepted by a peer-reviewed journal. I hope to find time to rework the article and to integrate the very helpful notes and comments of the reviewers anytime soon.

I’ll come back to you, when I’ve got news.

# Update 2012-11-14 #

A slightly updated version of the paper is also available now. It has been published in Working Paper Series of the German Data Forum (RatSWD), No. 210. The RatSWD Working Papers series was launched at the end of 2007. Since 2009, the series has been publishing exclusively conceptual and historical works dealing with the organization of the German statistical infrastructure and research infrastructure in the social, behavioral, and economic sciences.


Data Policies in Open Access Journals: Not all that glitters is “gold”

Posted: October 15th, 2012 | Author: | Filed under: Conference, EDaWaX | Tags: , , | 1 Comment »

At the end of September, I was in beautifull Vienna for some days and presented a few results of our project at the 6th Open Access Days in a session about “Making Research Data publicly available: opportunities and challenges“.
It’s been a very nice conference – and some blogposts [Uli Herb -> telepolis (in German) | Astrid Recker -> admtic (in English)] report on the conference and some of the presentations. My colleques Olaf Siegert, Ralf Flohr and I also wrote a summary of the conference for ZfBB (in German) that will be published in the next issue of the journal.

Well, to come back to my talk:  In this post I want to point out some single aspects of my presentation: the availability of data policies in economic scholarly journals that are published open access.
Our project compared the number and quality of data policies we found in a sample of 43 open access Journals to a sample of 141 traditional subscription journals in regard to the implementation of data availability policies.

Generally speaking I wondered how open access journals acquit themselves in this context. Prior to starting our analysis I was quite sure that the percentage of journals equipped with a data availability policy would be higher in open access journals than the proportion of subscription journals equipped with such a policy. I even thought that open access journals could have a comparative advantage to traditional subscription journals: Read the rest of this entry »


Data Policies in Economic Journals: What Data Authors have to provide beside the Manuscript?

Posted: July 16th, 2012 | Author: | Filed under: EDaWaX, Projects | Tags: , | Comments Off on Data Policies in Economic Journals: What Data Authors have to provide beside the Manuscript?

As mentioned in some of my previous blogposts we analyzed more than 140 economic scholarly journals regarding their data availability policies. It has been an interesting work checking the quality and the extend of these data policies.

In our sample (that was evaluated in 2011 by the German Economics Bräuninger, Haucap and Muck regarding the reputation and relevance of these journals) we were able to find 29 journals equipped with a data availability policy and 11 journals that own a so called “replication policy”.

Read the rest of this entry »


Requirements for Data Availability Policies to enable Replications

Posted: June 21st, 2012 | Author: | Filed under: Data Policy, EDaWaX | Tags: , , | 2 Comments »

In our analyses for work package 2 we collected some criteria to evaluate the quality of the data policies we found in our sample.

It was important to identify some core requirements that aim to ensure the replicability of economic research.  This was not an easy task, because we had to find some criteria that are suitable for many fields of research in economics.

Therefore we consulted several research papers and used the recommendations we found in the papers as a basis for analysing and assessing the suitability of data availability policies of economics journals in our study.

We’d like to discuss these criteria with our readers. Feel free to submit comments or send me an e-mail.

Read the rest of this entry »


German Bibliothekartag: EDaWaX presents first Findings

Posted: June 4th, 2012 | Author: | Filed under: Conference, EDaWaX | Tags: , , , , | 1 Comment »

On Thursday -24th of may- I presented first findings of our research project in a session on research data at the 101st German Bibliothekartag, managed by Goportis, the Leibniz Library Network for Research Information. Up to 100 colleques heard the presentation and some interesting questions were raised.

For introducing my presentation I gave a short overview on the project’s aims and our three project phases. Also the expected outcome and our project partners were introduced.

Read the rest of this entry »


Announcement: New section – Data Availability Policies in Economic Journals

Posted: February 1st, 2012 | Author: | Filed under: journals | Tags: | 1 Comment »

Today, I want to introduce a new regular section here on edawax.de. Within the next weeks and months I’ m going to discuss some of the data availability policies we found during our investigations for our work package 2.

Even though you’ll find a lot of the information posted here in a condensed report by the end of spring, I thought it would be beneficial to our readers to get some preliminary information about the things we are currently doing. Of course I would be very happy to discuss the policies presented and some of my thoughts with you. So please feel free to comment or to send me an email.

Read the rest of this entry »