diff --git a/about.Rmd b/about.Rmd index 334a0eb..50e56ff 100644 --- a/about.Rmd +++ b/about.Rmd @@ -24,12 +24,16 @@ We are based at the [Göttingen State and University Library](https://www.sub.un We want to thank [Maëlle Salmon](https://masalmon.eu/) for encouraging us to start a blog about our work. As a technical framework for the blog, we are using [Distill for R Markdown](https://rstudio.github.io/distill/), a new web publishing format optimized for scientific and technical writing. -*Dr. Anne Hobert*, *Nick Haupka*, *Najko Jahn* +*Dr. Anne Hobert*, *Nick Haupka*, *Sophia Dörner*, *Najko Jahn* ## Journal publications We also publish in scholarly journals about our work. +Haupka, N., Culbert, J., Schniedermann, A, Jahn, N., Mayr, P. (2024). Analysis of the Publication and Document Types in OpenAlex, Web of Science, Scopus, Pubmed and Semantic Scholar. + +Haupka, N. (2024). Analyse der Abdeckung wissenschaftlicher Publikationen auf Semantic Scholar im Kontext von Open Access. *Bibliothek Forschung und Praxis*, 48(2), 362–-373. + Jahn, N. (2024). How open are hybrid journals included in transformative agreements? Culbert, J., Hobert, A., Jahn, N., Haupka, N., Schmidt, M., Donner, P., Mayr, P. (2024). Reference Coverage Analysis of OpenAlex compared to Web of Science and Scopus. @@ -90,6 +94,11 @@ Chamberlain, S., Zhu, H., Jahn, N., Boettiger, C., Ram, K. *rcrossref: Client fo Jahn, N (2022). *roadoi: Find Free Versions of Scholarly Publications via Unpaywall*. | . +Python-Packages (selection): + +Haupka, N., Paul Morrison. *unpywall - Interfacing the Unpaywall API with Python*. + | + Dashboards (selection): [Hybrid Open Access Dashboard (HOAD)](https://subugoe.github.io/hoaddash/). See our blog post: diff --git a/data.Rmd b/data.Rmd index 2235891..18432c7 100644 --- a/data.Rmd +++ b/data.Rmd @@ -71,6 +71,17 @@ Anyone can view and query our publicly available [Open Scholarly Data warehouse ::: +## Status Semantic Scholar + +::: l-body-outset + +| Snapshot | Directory | Table | Schema | Procedure | Last Changed | Coverage | Number of rows | +|------------|--------------|----------------------|----------------------|-----------|--------------|-----------|-----------------| +| 2024-05-28 | papers/ | [semantic_scholar.papers](https://console.cloud.google.com/bigquery?ws=!1m4!1m3!3m2!1ssubugoe-collaborative!2ssemantic_scholar) | / | [Repo](https://github.com/naustica/MA/blob/main/download_papers.py) | 10.06.2024 | All | 218.668.220 | +| 2024-05-28 | venues/ | [semantic_scholar.venues](https://console.cloud.google.com/bigquery?ws=!1m4!1m3!3m2!1ssubugoe-collaborative!2ssemantic_scholar) | / | [Repo](https://github.com/naustica/MA/blob/main/download_venues.py) | 10.06.2024 | All | 194.578 | + +::: + ## Status Openalex ::: l-body-outset @@ -85,4 +96,14 @@ Anyone can view and query our publicly available [Open Scholarly Data warehouse | 2024-09-23 | topics/ | [openalex.topics](https://console.cloud.google.com/bigquery?ws=!1m4!1m3!3m2!1ssubugoe-collaborative!2sopenalex) | schema_openalex_topics.json | [Repo](https://github.com/naustica/openalex) | 09.10.2024 | All | 4.516 | | 2024-09-27 | works/ | [openalex.works](https://console.cloud.google.com/bigquery?ws=!1m4!1m3!3m2!1ssubugoe-collaborative!2sopenalex) | schema_openalex_work.json | [Repo](https://github.com/naustica/openalex) | 09.10.2024 | All | 259.375.778 | +::: + +## Status OpenAlex Document Type classification by SUB Göttingen + +::: l-body-outset + +| Snapshot | Directory | Table | Schema | Procedure | Last Changed | Coverage | Number of rows | +|------------|--------------|----------------------|----------------------|-----------|--------------|-----------|-----------------| +| 2024-09-27 | works/ | [resources.classification_article_reviews_september_2024](https://console.cloud.google.com/bigquery?ws=!1m4!1m3!3m2!1ssubugoe-collaborative!2sresources) | schema_document_types.json | [Repo](https://github.com/naustica/openalex_doctypes/tree/classifier/classifier) | 15.10.2024 | All | 151.099.815 | + ::: \ No newline at end of file diff --git a/docs/about.html b/docs/about.html index eb9c01d..4984ef7 100644 --- a/docs/about.html +++ b/docs/about.html @@ -2205,9 +2205,11 @@

About this Blog!

  • R-related training and outreach activities

    • We want to thank Maëlle Salmon for encouraging us to start a blog about our work. As a technical framework for the blog, we are using Distill for R Markdown, a new web publishing format optimized for scientific and technical writing.

    -

    Dr. Anne Hobert, Nick Haupka, Najko Jahn

    +

    Dr. Anne Hobert, Nick Haupka, Sophia Dörner, Najko Jahn

    Journal publications

    We also publish in scholarly journals about our work.

    +

    Haupka, N., Culbert, J., Schniedermann, A, Jahn, N., Mayr, P. (2024). Analysis of the Publication and Document Types in OpenAlex, Web of Science, Scopus, Pubmed and Semantic Scholar. https://arxiv.org/abs/2406.15154

    +

    Haupka, N. (2024). Analyse der Abdeckung wissenschaftlicher Publikationen auf Semantic Scholar im Kontext von Open Access. Bibliothek Forschung und Praxis, 48(2), 362–-373. https://doi.org/10.1515/bfp-2023-0057

    Jahn, N. (2024). How open are hybrid journals included in transformative agreements? https://arxiv.org/abs/2402.18255

    Culbert, J., Hobert, A., Jahn, N., Haupka, N., Schmidt, M., Donner, P., Mayr, P. (2024). Reference Coverage Analysis of OpenAlex compared to Web of Science and Scopus. https://arxiv.org/abs/2401.16359

    Taubert, N., Hobert, A., Jahn, N., Bruns, A., & Iravani, E. (2024). Understanding differences of the OA uptake within the German University landscape (2010–2020): Part 2—repository-provided OA. Scientometrics. https://doi.org/10.1007/s11192-024-05003-5

    @@ -2248,6 +2250,9 @@

    Software

    Jahn, N. europepmc: R Interface to the Europe PubMed Central RESTful Web Service. https://CRAN.R-project.org/package=europepmc | https://docs.ropensci.org/europepmc/

    Chamberlain, S., Zhu, H., Jahn, N., Boettiger, C., Ram, K. rcrossref: Client for Various ‘CrossRef’ ‘APIs’. https://CRAN.R-project.org/package=rcrossref https://docs.ropensci.org/rcrossref/

    Jahn, N (2022). roadoi: Find Free Versions of Scholarly Publications via Unpaywall. https://CRAN.R-project.org/package=roadoi | https://docs.ropensci.org/roadoi/.

    +

    Python-Packages (selection):

    +

    Haupka, N., Paul Morrison. unpywall - Interfacing the Unpaywall API with Python. +https://pypi.org/project/unpywall | https://unpywall.readthedocs.io/

    Dashboards (selection):

    Hybrid Open Access Dashboard (HOAD). See our blog post: https://www.coalition-s.org/blog/introducing-the-hybrid-open-access-dashboard-hoad/

    metacheck: Open Access Metadata Compliance Checker

    diff --git a/docs/data.html b/docs/data.html index 13a5b81..6a5100e 100644 --- a/docs/data.html +++ b/docs/data.html @@ -2189,7 +2189,9 @@

    Contents

    @@ -2454,6 +2456,55 @@

    Historical Snapshots (upw_history)

    +

    Status Semantic Scholar

    +
    + ++++++++++ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
    SnapshotDirectoryTableSchemaProcedureLast ChangedCoverageNumber of rows
    2024-05-28papers/semantic_scholar.papers/Repo10.06.2024All218.668.220
    2024-05-28venues/semantic_scholar.venues/Repo10.06.2024All194.578
    +

    Status Openalex

    @@ -2553,6 +2604,45 @@

    Status Openalex

    +

    Status OpenAlex Document Type classification by SUB Göttingen

    +
    + ++++++++++ + + + + + + + + + + + + + + + + + + + + + + + + +
    SnapshotDirectoryTableSchemaProcedureLast ChangedCoverageNumber of rows
    2024-09-27works/resources.classification_article_reviews_september_2024schema_document_types.jsonRepo15.10.2024All151.099.815
    +
    diff --git a/docs/index.html b/docs/index.html index 591dff6..b01696e 100644 --- a/docs/index.html +++ b/docs/index.html @@ -2312,7 +2312,7 @@

    -
    Oct. 23, 2024
    +
    Oct. 24, 2024
    Nick Haupka
    diff --git a/docs/index.xml b/docs/index.xml index 7d1fd10..91f6ec0 100644 --- a/docs/index.xml +++ b/docs/index.xml @@ -11,14 +11,14 @@ to publish case-studies rapidely showing how to support data-driven workflows an decision-making around scholarly communication in libraries using R. Distill - Wed, 23 Oct 2024 00:00:00 +0000 + Thu, 24 Oct 2024 00:00:00 +0000 Identifying journal article types in OpenAlex Nick Haupka https://subugoe.github.io/scholcomm_analytics/posts/oal_document_types_classifier Identifying suitable types of journal articles for bibliometric analyses is important. In this blog post, I present a document type classifier that helps to identify research contributions like original research articles using Crossref and OpenAlex. The classifier and classified OpenAlex records are openly available. https://subugoe.github.io/scholcomm_analytics/posts/oal_document_types_classifier - Wed, 23 Oct 2024 00:00:00 +0000 + Thu, 24 Oct 2024 00:00:00 +0000 diff --git a/docs/posts/posts.json b/docs/posts/posts.json index 2a2f8bc..5628332 100644 --- a/docs/posts/posts.json +++ b/docs/posts/posts.json @@ -13,8 +13,8 @@ "categories": [], "contents": "\nJournals publish different types of articles.\nOriginal research articles and reviews are the most common and are most often used in bibliometric analyses.\nBut there are also other types, such as letters to the editor or book reviews, which are often not considered.\nBoth the vocabulary used to describe journal article types and the methods used to assign them vary between bibliometric databases.\nFor example, when analysing the classification in OpenAlex, Web of Science (WoS), Scopus, PubMed and Semantic Scholar, I found that OpenAlex tends to overestimate the assignment of the document type ‘article’. OpenAlex tagged 10% of items as articles, which were labelled as editorial material in Scopus and the Web of Science.\nIn this blog post, I will present a classifier designed to improve the identification of journal article types in open scholarly databases like OpenAlex.\nThe classifier uses metadata from Crossref and OpenAlex, including the number of references, citations and affiliations, to assess whether an item in a journal is a research contribution or not.\nTo train the classifier, I used open scholarly data from PubMed, OpenAlex and Crossref.\nAfter introducing the classifier, I will compare my approach with that of OpenAlex, Scopus and the methodology employed by the CWTS to identify core publications.\nBoth the source code of the classifier and the classified records are publicly accessible.\nData and Methods\nThe journal article type classifier was trained on approximately 9.5 million journal articles from PubMed, representing either research discourse or editorial discourse.\nPubMed was used because its classification of document types is similar to that of Scopus and Web of Science, with the advantage that PubMed data is openly accessible and reusable.\nThe training data was limited to the publication years 2012 to 2022.\nIn addition, articles from publishers with fewer than 5,000 publications were excluded from the training.\nSimilar to the CWTS approach to identify core publications, the classifier also takes into account metadata retrieved from Crossref and OpenAlex.\nThese metadata fields are:\nMetadata\nType\nRetrieved from\nhas abstract?\nBOOLEAN\nCrossref (October 2023 snapshot)\ntitle word count\nINT\nCrossref (October 2023 snapshot)\npage count\nINT\nCrossref (October 2023 snapshot)\nauthor count\nINT\nCrossref (October 2023 snapshot)\nhas license?\nBOOLEAN\nCrossref (October 2023 snapshot)\nnumber of citations\nINT\nCrossref (October 2023 snapshot)\nnumber of references\nINT\nCrossref (October 2023 snapshot)\nhas funding information?\nBOOLEAN\nCrossref (October 2023 snapshot)\nnumber of affiliations\nINT\nOpenAlex (April 2024 snapshot)\nhas OA url?\nBOOLEAN\nOpenAlex (April 2024 snapshot)\nThe dataset was then split into 75% training data and 25% test data.\nFor the classifier, I used the k-nearest neighbours algorithm.\nParameters for the algorithm were optimised using grid search.\n\nThe exact parameters that were used for the algorithm and also the programming code are available on GitHub.\nThe classifier is build on top of OpenAlex rule-based paratext recognition, which uses title heuristics.\nThis means that my classifier cannot classify pre-labelled editorial material from OpenAlex as research items.\nTo evaluate my model, I compared the results with OpenAlex, Scopus and the CWTS Leiden Ranking Open Edition.\nThe CWTS Leiden Ranking Open Edition is a university ranking based on a pre-computed subset of so called core publications indexed in OpenAlex to compare universities.\nA publication is considered a core publication if it has one or more authors, has at least one reference, is published in English and is also published in a core journal (Van Eck and Waltman 2024).\nA journal is considered a core journal if it has an international scope and also contains a high number of references. The CWTS approach is therefore more selective than my approach, because I did not exclude journals and non-English contributions.\nFor the comparison I used the September 2024 snapshot from OpenAlex, the July 2024 snapshot from Scopus and the data underlying the Leiden Ranking Open Edition 2024, which is available through Google BigQuery. Matching were carried out by DOI.\nResults\nOverall, the classifier categorised 12.647.946 out of 108.744.219 journal items, which were classified as articles and reviews in OpenAlex, as non-research items, representing a share of 11.6%. When restricted to the period 2012–2021, this figure drops to 3.778.393 out of 38.265.399 journal items (9.9%), presumably due to improved metadata coverage used to determine document types. Figure 1 compares the results of the classifier with OpenAlex and the CWTS approach, based on items in journals between 2012 and 2021. The left side of the figure displays all journals in OpenAlex, whereas the data from the figure on the right side is restricted to CWTS core journals. The grey line represents all articles and reviews in journals in OpenAlex. The green line indicates all articles and reviews in OpenAlex for which at least one reference and one citation were identified. The purple line below shows all items from journals in OpenAlex included as core publications in the CWTS Leiden Ranking Open Edition. The yellow line illustrates the proportion of items in OpenAlex that are recognised as research items by the classifier. About 48.3% of all journal items in OpenAlex from 2012 to 2021 were categorised as core publications by the CWTS when not restricting to core journals, demonstrating the effect of also using journal characteristics to define eligble publications. Overall, 27.72 of 203.545 journals (13.6%) in OpenAlex were considered as core journals by the CWTS in its latest Open Leiden Ranking. But also missing authors, affiliations and references had an impact on the CWTS classification. In contrast, my classifier determined about 84,5% of journal items as research items when not restricting to core journal. When restricted to core journals, it shows that the classifier is less sensitive to missing metadata or a low number of citations. In contrast, the proportion of CWTS core publications and the proportion of publications with at least one reference and one citation in OpenAlex are similar and achieve both about 71% on average.\n\n\n\nFigure 1: Comparison of my classifier with OpenAlex and the CWTS core classification.\n\n\n\nTo check for potentially discriminatory behaviour of my classifier, I compared my approach with the CWTS approach by journal topic (see Figure 2). Again, a common corpus based on DOI matching is used. Figure 2a and 2b show all journals in OpenAlex, while the data in Figure 2c and Figure 2d are restricted to the CWTS core journals. Figures 2a and 2b show that my classifier treats publications from different disciplines in a more balanced way, while the CWTS method excludes publications from the social sciences and humanities more often, probably due to the exclusion of non-core journals. In this respect, the CWTS points out that many social science journals were not considered core journals due to the lack of a suitable number of references. When using core journals (Figure 2c and Figure 2d) the behaviour changes. Here, my classifier and the CWTS classification show a similar pattern, but with health sciences publications being excluded more often. These publications may be case reports, which usually do not contain references.\n\n\n\nFigure 2: Comparison of the coverage of my classifier with the CWTS core classification using topics from OpenAlex.\n\n\n\nFigure 3 compares the proportion of articles and reviews in OpenAlex and Scopus in relation to the intersection of items in OpenAlex and Scopus in journals from 2012 to 2021 using a shared corpus based on DOI matching. The results of my classifier are represented by the yellow line.\nOpenAlex counts more items than Scopus when restricting to the document types articles and reviews (OpenAlex: 95.9% and Scopus: 87.6%).\nWith the help of the classifier, the retrieval of articles and reviews in OpenAlex can be improved (Classifier: 93.2%).\nNevertheless, Scopus counts were lower when comparing it to my method.\n\n\n\nFigure 3: Comparison of my classifier with OpenAlex and Scopus.\n\n\n\nDiscussion and Data Access\nThe comparison of my classifier with OpenAlex, Scopus and the CWTS has shown that it can help with document type assignments in open scholarly data sources such as Crossref and OpenAlex. My next step is to qualitatively check a larger sample. Meanwhile, OurResearch is also in the process of updating its classification of document types. Until then, my classifier can be used as a complementary tool for identifying suitable articles for bibliometric analysis using open scholarly data sources such as Crossref or OpenAlex.\nA major limitation of my classifier is that it often identifies clinical trials and case studies as non-research articles, as these often have no references or citations. However, this could be improved by adding open data from PubMed that classifies these document types.\nThe classified data is available via the publicly available Google BigQuery instance provided by the SUB Göttingen. Here you can also compare it with OpenAlex, Crossref and Semantic Scholar. To query it, you can use\n\nSELECT COUNT(DISTINCT(oal.doi)) AS n, type, label\nFROM 'subugoe-collaborative.openalex.works' AS oal\nJOIN 'subugoe-collaborative.resources.classification_article_reviews_september_2024' AS dt\n ON oal.doi = dt.doi\nGROUP BY type, label\nORDER BY n DESC\n\nThe results will be constantly updated in line with the monthly release of OpenAlex and Crossref. I would be happy to get feedback about your experiences with the classifier!\n\n\n\nVan Eck, Nees Jan, and Ludo Waltman. 2024. “A methodology for identifying core sources and core publications in OpenAlex.” Zenodo. https://doi.org/10.5281/zenodo.13879947.\n\n\n\n\n", "preview": "posts/oal_document_types_classifier/distill-preview.png", - "last_modified": "2024-10-24T09:40:23+02:00", - "input_file": "blogpost.knit.md", + "last_modified": "2024-10-24T09:45:22+02:00", + "input_file": {}, "preview_width": 3896, "preview_height": 2213 }, diff --git a/docs/search.json b/docs/search.json index aa9fec6..126a2c6 100644 --- a/docs/search.json +++ b/docs/search.json @@ -4,22 +4,22 @@ "path": "about.html", "title": "About us", "author": [], - "contents": "\n\nContents\nAbout this Blog!\nJournal publications\nTheses\nSoftware\nThird-party funded projects\n\nAbout this Blog!\nWelcome to our Blog! Here, you’ll find insights from our work as Data Analysts in the domain of scholarly communication. With this blog, we want to engage with the broader community about how to support data-driven workflows and decision-making around scholarly communication with R.\nWe are based at the Göttingen State and University Library, one of the largest academic libraries in Germany. We are using R-based tools in our everyday work and contribute to R package developments and training activities. In this blog, you’ll find news and case-studies around:\nOpen Access and Open Science Analytics\nR Packages making use of open databases and helping us in our work\nR Tools for interactive visualizations and dashboard developments\nR-related training and outreach activities\nWe want to thank Maëlle Salmon for encouraging us to start a blog about our work. As a technical framework for the blog, we are using Distill for R Markdown, a new web publishing format optimized for scientific and technical writing.\nDr. Anne Hobert, Nick Haupka, Najko Jahn\nJournal publications\nWe also publish in scholarly journals about our work.\nJahn, N. (2024). How open are hybrid journals included in transformative agreements? https://arxiv.org/abs/2402.18255\nCulbert, J., Hobert, A., Jahn, N., Haupka, N., Schmidt, M., Donner, P., Mayr, P. (2024). Reference Coverage Analysis of OpenAlex compared to Web of Science and Scopus. https://arxiv.org/abs/2401.16359\nTaubert, N., Hobert, A., Jahn, N., Bruns, A., & Iravani, E. (2024). Understanding differences of the OA uptake within the German University landscape (2010–2020): Part 2—repository-provided OA. Scientometrics. https://doi.org/10.1007/s11192-024-05003-5\nFraser, N., Hobert, A., Jahn, N., Mayr, P., & Peters, I. (2023). No deal: German researchers’ publishing and citing behaviors after Big Deal negotiations with Elsevier.\nQuantitative Science Studies, 4(2), 325–352. https://doi.org/10.1162/qss_a_00255\nTaubert, N., Hobert, A., Jahn, N., Bruns, A., & Iravani, E. (2023). Understanding differences of the OA uptake within the German university landscape (2010–2020): Part 1—journal-based OA. Scientometrics, 128(6), 3601–3625. https://doi.org/10.1007/s11192-023-04716-3\nHaupka, N., Jahn, N., & Hobert, N. (2022). Praxisbericht Big Scholarly Data an der SUB Göttingen. LIBREAS. Library Ideas, 41 (2022). https://libreas.eu/ausgabe41/haupka/\nJahn, N., Matthias, L., & Laakso, M. (2022). Toward transparency of\nhybrid open access through publisher‐provided metadata: An article‐level\nstudy of Elsevier. Journal of the Association for Information Science\nand Technology, 73(1), 104–118. https://doi.org/10.1002/asi.24549\nJahn, N., Held, M., Walter, H., Haupka, N., & Hillenkötter, K. (2022).\nHOAD: Data Analytics für mehr Transparenz bei\nOpen-Access-Transformationsverträgen. ABI Technik, 42(1), 64–69.\nhttps://doi.org/10.1515/abitech-2022-0007\nStisser, A., Jahn, N., & Schmidt, B. (2022). Stand und Perspektiven bibliometriegestützter Open-Access-Services an Universitäten in Deutschland. Bibliothek Forschung und Praxis, 46(2), 275–283. https://doi.org/10.1515/bfp-2021-0098\nHobert, A., Jahn, N., Mayr, P., Schmidt, B., & Taubert, N. (2021). Open\naccess uptake in Germany 2010–2018: adoption in a diverse research\nlandscape. Scientometrics, 126(12), 9751–9777.\nhttps://doi.org/10.1007/s11192-021-04002-0\nLaakso, M., Matthias, L., & Jahn, N. (2021). Open is not forever: A\nstudy of vanished open access journals. Journal of the Association for\nInformation Science and Technology, 72(9), 1099–1112.\nhttps://doi.org/10.1002/asi.24460 (JASIST Best Paper Award 2022. Featured in Nature,\nNature,\nScience, CNN,\nDLF)\nJahn, N., Hobert, A., & Haupka, N. (2021). Entwicklung und Typologie des\nDatendiensts Unpaywall. Bibliothek Forschung und Praxis, 45(2),\n293–303. https://doi.org/10.1515/bfp-2020-0115\nMatthias, L., Jahn, N., & Laakso, M. (2019). The Two-Way Street of Open\nAccess Journal Publishing: Flip It and Reverse It. Publications, 7(2),\n23. https://doi.org/10.3390/publications7020023\nTheses\nHaupka, N. (2021). Analyse der Entwicklung des Open Access-Discovery-Services Unpaywall seit 2018 [Bachelor Thesis, Hochschule Hannover]. https://doi.org/10.25968/opus-1899\nSoftware\nR-Packages (selection):\nJahn, N. europepmc: R Interface to the Europe PubMed Central RESTful Web Service. https://CRAN.R-project.org/package=europepmc | https://docs.ropensci.org/europepmc/\nChamberlain, S., Zhu, H., Jahn, N., Boettiger, C., Ram, K. rcrossref: Client for Various ‘CrossRef’ ‘APIs’. https://CRAN.R-project.org/package=rcrossref https://docs.ropensci.org/rcrossref/\nJahn, N (2022). roadoi: Find Free Versions of Scholarly Publications via Unpaywall. https://CRAN.R-project.org/package=roadoi | https://docs.ropensci.org/roadoi/.\nDashboards (selection):\nHybrid Open Access Dashboard (HOAD). See our blog post: https://www.coalition-s.org/blog/introducing-the-hybrid-open-access-dashboard-hoad/\nmetacheck: Open Access Metadata Compliance Checker\nOpen Access uptake in Germany 2010-2018: Interactive Supplement\nThird-party funded projects\nBMBF\nKompetenznetzwerk Bibliometrie: Komparative Analyse und Kuratierung Deutscher Metadaten in Offenen Bibliometriedaten, Teilprojekt: Bereitstellung und Analyse Dokumenttypen\nKompetenznetzwerk Bibliometrie, Teilprojekt: Datenergänzung: Open-Access-Nachweise\nindi:oa - Verantwortungsbewusste Bewertung und Qualitätssicherung von Open-Access Publikationen mittels bibliometrischer Indikatoren (concluded)\nOAUNI - Entwicklung und Einflussfaktoren des Open-Access-Publizierens an Universitäten in Deutschland (concluded)\nDFG\nOA-Datenpraxis: Datenpraxis zur Gestaltung der Open-Access-Transformation - Analyse, Empfehlung, Training & Vernetzung\nHybrid OA Dashboards: Mehrwertorientierte Analytics-Anwendungen zur Förderung der Kostentransparenz bei Transformationsverträgen (concluded)\nEuropean Commission\nOn-Merrit (concluded)\nOpenAIRE Nexus (concluded)\n\n\n\n", - "last_modified": "2024-10-11T10:06:09+02:00" + "contents": "\n\nContents\nAbout this Blog!\nJournal publications\nTheses\nSoftware\nThird-party funded projects\n\nAbout this Blog!\nWelcome to our Blog! Here, you’ll find insights from our work as Data Analysts in the domain of scholarly communication. With this blog, we want to engage with the broader community about how to support data-driven workflows and decision-making around scholarly communication with R.\nWe are based at the Göttingen State and University Library, one of the largest academic libraries in Germany. We are using R-based tools in our everyday work and contribute to R package developments and training activities. In this blog, you’ll find news and case-studies around:\nOpen Access and Open Science Analytics\nR Packages making use of open databases and helping us in our work\nR Tools for interactive visualizations and dashboard developments\nR-related training and outreach activities\nWe want to thank Maëlle Salmon for encouraging us to start a blog about our work. As a technical framework for the blog, we are using Distill for R Markdown, a new web publishing format optimized for scientific and technical writing.\nDr. Anne Hobert, Nick Haupka, Sophia Dörner, Najko Jahn\nJournal publications\nWe also publish in scholarly journals about our work.\nHaupka, N., Culbert, J., Schniedermann, A, Jahn, N., Mayr, P. (2024). Analysis of the Publication and Document Types in OpenAlex, Web of Science, Scopus, Pubmed and Semantic Scholar. https://arxiv.org/abs/2406.15154\nHaupka, N. (2024). Analyse der Abdeckung wissenschaftlicher Publikationen auf Semantic Scholar im Kontext von Open Access. Bibliothek Forschung und Praxis, 48(2), 362–-373. https://doi.org/10.1515/bfp-2023-0057\nJahn, N. (2024). How open are hybrid journals included in transformative agreements? https://arxiv.org/abs/2402.18255\nCulbert, J., Hobert, A., Jahn, N., Haupka, N., Schmidt, M., Donner, P., Mayr, P. (2024). Reference Coverage Analysis of OpenAlex compared to Web of Science and Scopus. https://arxiv.org/abs/2401.16359\nTaubert, N., Hobert, A., Jahn, N., Bruns, A., & Iravani, E. (2024). Understanding differences of the OA uptake within the German University landscape (2010–2020): Part 2—repository-provided OA. Scientometrics. https://doi.org/10.1007/s11192-024-05003-5\nFraser, N., Hobert, A., Jahn, N., Mayr, P., & Peters, I. (2023). No deal: German researchers’ publishing and citing behaviors after Big Deal negotiations with Elsevier.\nQuantitative Science Studies, 4(2), 325–352. https://doi.org/10.1162/qss_a_00255\nTaubert, N., Hobert, A., Jahn, N., Bruns, A., & Iravani, E. (2023). Understanding differences of the OA uptake within the German university landscape (2010–2020): Part 1—journal-based OA. Scientometrics, 128(6), 3601–3625. https://doi.org/10.1007/s11192-023-04716-3\nHaupka, N., Jahn, N., & Hobert, N. (2022). Praxisbericht Big Scholarly Data an der SUB Göttingen. LIBREAS. Library Ideas, 41 (2022). https://libreas.eu/ausgabe41/haupka/\nJahn, N., Matthias, L., & Laakso, M. (2022). Toward transparency of\nhybrid open access through publisher‐provided metadata: An article‐level\nstudy of Elsevier. Journal of the Association for Information Science\nand Technology, 73(1), 104–118. https://doi.org/10.1002/asi.24549\nJahn, N., Held, M., Walter, H., Haupka, N., & Hillenkötter, K. (2022).\nHOAD: Data Analytics für mehr Transparenz bei\nOpen-Access-Transformationsverträgen. ABI Technik, 42(1), 64–69.\nhttps://doi.org/10.1515/abitech-2022-0007\nStisser, A., Jahn, N., & Schmidt, B. (2022). Stand und Perspektiven bibliometriegestützter Open-Access-Services an Universitäten in Deutschland. Bibliothek Forschung und Praxis, 46(2), 275–283. https://doi.org/10.1515/bfp-2021-0098\nHobert, A., Jahn, N., Mayr, P., Schmidt, B., & Taubert, N. (2021). Open\naccess uptake in Germany 2010–2018: adoption in a diverse research\nlandscape. Scientometrics, 126(12), 9751–9777.\nhttps://doi.org/10.1007/s11192-021-04002-0\nLaakso, M., Matthias, L., & Jahn, N. (2021). Open is not forever: A\nstudy of vanished open access journals. Journal of the Association for\nInformation Science and Technology, 72(9), 1099–1112.\nhttps://doi.org/10.1002/asi.24460 (JASIST Best Paper Award 2022. Featured in Nature,\nNature,\nScience, CNN,\nDLF)\nJahn, N., Hobert, A., & Haupka, N. (2021). Entwicklung und Typologie des\nDatendiensts Unpaywall. Bibliothek Forschung und Praxis, 45(2),\n293–303. https://doi.org/10.1515/bfp-2020-0115\nMatthias, L., Jahn, N., & Laakso, M. (2019). The Two-Way Street of Open\nAccess Journal Publishing: Flip It and Reverse It. Publications, 7(2),\n23. https://doi.org/10.3390/publications7020023\nTheses\nHaupka, N. (2021). Analyse der Entwicklung des Open Access-Discovery-Services Unpaywall seit 2018 [Bachelor Thesis, Hochschule Hannover]. https://doi.org/10.25968/opus-1899\nSoftware\nR-Packages (selection):\nJahn, N. europepmc: R Interface to the Europe PubMed Central RESTful Web Service. https://CRAN.R-project.org/package=europepmc | https://docs.ropensci.org/europepmc/\nChamberlain, S., Zhu, H., Jahn, N., Boettiger, C., Ram, K. rcrossref: Client for Various ‘CrossRef’ ‘APIs’. https://CRAN.R-project.org/package=rcrossref https://docs.ropensci.org/rcrossref/\nJahn, N (2022). roadoi: Find Free Versions of Scholarly Publications via Unpaywall. https://CRAN.R-project.org/package=roadoi | https://docs.ropensci.org/roadoi/.\nPython-Packages (selection):\nHaupka, N., Paul Morrison. unpywall - Interfacing the Unpaywall API with Python.\nhttps://pypi.org/project/unpywall | https://unpywall.readthedocs.io/\nDashboards (selection):\nHybrid Open Access Dashboard (HOAD). See our blog post: https://www.coalition-s.org/blog/introducing-the-hybrid-open-access-dashboard-hoad/\nmetacheck: Open Access Metadata Compliance Checker\nOpen Access uptake in Germany 2010-2018: Interactive Supplement\nThird-party funded projects\nBMBF\nKompetenznetzwerk Bibliometrie: Komparative Analyse und Kuratierung Deutscher Metadaten in Offenen Bibliometriedaten, Teilprojekt: Bereitstellung und Analyse Dokumenttypen\nKompetenznetzwerk Bibliometrie, Teilprojekt: Datenergänzung: Open-Access-Nachweise\nindi:oa - Verantwortungsbewusste Bewertung und Qualitätssicherung von Open-Access Publikationen mittels bibliometrischer Indikatoren (concluded)\nOAUNI - Entwicklung und Einflussfaktoren des Open-Access-Publizierens an Universitäten in Deutschland (concluded)\nDFG\nOA-Datenpraxis: Datenpraxis zur Gestaltung der Open-Access-Transformation - Analyse, Empfehlung, Training & Vernetzung\nHybrid OA Dashboards: Mehrwertorientierte Analytics-Anwendungen zur Förderung der Kostentransparenz bei Transformationsverträgen (concluded)\nEuropean Commission\nOn-Merrit (concluded)\nOpenAIRE Nexus (concluded)\n\n\n\n", + "last_modified": "2024-10-24T14:01:21+02:00" }, { "path": "data.html", "title": "Open Scholarly Data @ SUB Göttingen - Overview", "author": [], - "contents": "\n\nContents\nStatus Crossref\nStatus Unpaywall\nStatus Openalex\n\nWe use Google Big Query to work with large open scholarly data. Our main data sources are Unpaywall, Crossref and OpenAlex.\nAn overview of our data warehouse including procedures to load the data into BigQuery can be found below.\nAnyone can view and query our publicly available Open Scholarly Data warehouse on BigQuery with a Google Cloud Computing account. Note that Google will charge you for the number of bytes processed by each query (currently $ 6.25 per 1 TB).\nStatus Crossref\nCurrent Snapshot (cr_instant)\n\nSnapshot\nFile\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2024/09\nall.json.tar.gz\ncr_instant.snapshot\nschema_crossref.json\nRepo\n10.10.2024\n2013-2024\n50.397.426\n\nHistorical Snapshots (cr_history)\n\nSnapshot\nFile\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2018/04\nall.json.tar.gz\ncr_history.cr_apr18\nschema_crossref.json\nRepo\n20.02.2022\n2013-2018\n16.766.035\n2019/04\nall.json.tar.gz\ncr_history.cr_apr19\nschema_crossref.json\nRepo\n29.10.2021\n2013-2019\n20.715.644\n2020/04\nall.json.tar.gz\ncr_history.cr_apr20\nschema_crossref.json\nRepo\n29.10.2021\n2013-2020\n25.334.525\n2021/04\nall.json.tar.gz\ncr_history.cr_apr21\nschema_crossref.json\nRepo\n29.10.2021\n2013-2021\n30.579.119\n2022/04\nall.json.tar.gz\ncr_history.cr_apr22\nschema_crossref.json\nRepo\n14.05.2022\n2013-2022\n35.939.195\n2023/04\nall.json.tar.gz\ncr_history.cr_apr23\nschema_crossref.json\nRepo\n07.05.2023\n2013-2023\n41.767.461\n2024/04\nall.json.tar.gz\ncr_history.cr_apr24\nschema_crossref.json\nRepo\n07.05.2024\n2013-2024\n47.709.184\n\nStatus Unpaywall\nCurrent Snapshot (upw_instant)\n\nSnapshot\nFile\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2022/03\nunpaywall_snapshot_2022-03-09T083001.jsonl.gz\nupw_instant.snapshot\nbq_schema_mar22.json\nRepo\n14.03.2022\n2008-2022\n67.424.819\n\nHistorical Snapshots (upw_history)\n\nSnapshot\nFile\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2018/03\nunpaywall_snapshot_2018-03-29T113154.jsonl.gz\nupw_history.upw_Mar18_08_20\nbq_schema_mar18.json\nRepo\n29.10.2021\n2008-2018\n36.557.043\n2019/02\nunpaywall_snapshot_2019-02-21T031509.jsonl.gz\nupw_history.upw_Feb19_08_19\nbq_schema_feb19.json\nRepo\n10.11.2021\n2008-2019\n42.143.979\n2020/02\nunpaywall_snapshot_2020-02-25T115244.jsonl.gz\nupw_history.upw_Feb20_08_20\nbq_schema_feb20.json\nRepo\n30.10.2021\n2008-2020\n49.717.710\n2021/02\nunpaywall_snapshot_2021-02-18T160139.jsonl.gz\nupw_history.upw_Feb21_08_21\nbq_schema_feb21.json\nRepo\n29.10.2021\n2008-2021\n58.437.927\n2022/03\nunpaywall_snapshot_2022-03-09T083001.jsonl.gz\nupw_history.upw_Mar22_08_22\nbq_schema_mar22.json\nRepo\n14.03.2022\n2008-2022\n67.424.819\n\nStatus Openalex\n\nSnapshot\nDirectory\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2024-09-27\nauthors/\nopenalex.authors\nschema_openalex_author.json\nRepo\n09.10.2024\nAll\n96.105.161\n2024-09-28\nfunders/\nopenalex.funders\nschema_openalex_funders.json\nRepo\n09.10.2024\nAll\n32.437\n2024-09-28\ninstitutions/\nopenalex.institutions\nschema_openalex_institutions.json\nRepo\n09.10.2024\nAll\n109.495\n2024-09-28\npublishers/\nopenalex.publishers\nschema_openalex_publishers.json\nRepo\n09.10.2024\nAll\n10.250\n2024-09-28\nsources/\nopenalex.sources\nschema_openalex_sources.json\nRepo\n09.10.2024\nAll\n254.533\n2024-09-23\ntopics/\nopenalex.topics\nschema_openalex_topics.json\nRepo\n09.10.2024\nAll\n4.516\n2024-09-27\nworks/\nopenalex.works\nschema_openalex_work.json\nRepo\n09.10.2024\nAll\n259.375.778\n\n\n\n\n", - "last_modified": "2024-10-11T10:06:10+02:00" + "contents": "\n\nContents\nStatus Crossref\nStatus Unpaywall\nStatus Semantic Scholar\nStatus Openalex\nStatus OpenAlex Document Type classification by SUB Göttingen\n\nWe use Google Big Query to work with large open scholarly data. Our main data sources are Unpaywall, Crossref and OpenAlex.\nAn overview of our data warehouse including procedures to load the data into BigQuery can be found below.\nAnyone can view and query our publicly available Open Scholarly Data warehouse on BigQuery with a Google Cloud Computing account. Note that Google will charge you for the number of bytes processed by each query (currently $ 6.25 per 1 TB).\nStatus Crossref\nCurrent Snapshot (cr_instant)\n\nSnapshot\nFile\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2024/09\nall.json.tar.gz\ncr_instant.snapshot\nschema_crossref.json\nRepo\n10.10.2024\n2013-2024\n50.397.426\n\nHistorical Snapshots (cr_history)\n\nSnapshot\nFile\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2018/04\nall.json.tar.gz\ncr_history.cr_apr18\nschema_crossref.json\nRepo\n20.02.2022\n2013-2018\n16.766.035\n2019/04\nall.json.tar.gz\ncr_history.cr_apr19\nschema_crossref.json\nRepo\n29.10.2021\n2013-2019\n20.715.644\n2020/04\nall.json.tar.gz\ncr_history.cr_apr20\nschema_crossref.json\nRepo\n29.10.2021\n2013-2020\n25.334.525\n2021/04\nall.json.tar.gz\ncr_history.cr_apr21\nschema_crossref.json\nRepo\n29.10.2021\n2013-2021\n30.579.119\n2022/04\nall.json.tar.gz\ncr_history.cr_apr22\nschema_crossref.json\nRepo\n14.05.2022\n2013-2022\n35.939.195\n2023/04\nall.json.tar.gz\ncr_history.cr_apr23\nschema_crossref.json\nRepo\n07.05.2023\n2013-2023\n41.767.461\n2024/04\nall.json.tar.gz\ncr_history.cr_apr24\nschema_crossref.json\nRepo\n07.05.2024\n2013-2024\n47.709.184\n\nStatus Unpaywall\nCurrent Snapshot (upw_instant)\n\nSnapshot\nFile\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2022/03\nunpaywall_snapshot_2022-03-09T083001.jsonl.gz\nupw_instant.snapshot\nbq_schema_mar22.json\nRepo\n14.03.2022\n2008-2022\n67.424.819\n\nHistorical Snapshots (upw_history)\n\nSnapshot\nFile\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2018/03\nunpaywall_snapshot_2018-03-29T113154.jsonl.gz\nupw_history.upw_Mar18_08_20\nbq_schema_mar18.json\nRepo\n29.10.2021\n2008-2018\n36.557.043\n2019/02\nunpaywall_snapshot_2019-02-21T031509.jsonl.gz\nupw_history.upw_Feb19_08_19\nbq_schema_feb19.json\nRepo\n10.11.2021\n2008-2019\n42.143.979\n2020/02\nunpaywall_snapshot_2020-02-25T115244.jsonl.gz\nupw_history.upw_Feb20_08_20\nbq_schema_feb20.json\nRepo\n30.10.2021\n2008-2020\n49.717.710\n2021/02\nunpaywall_snapshot_2021-02-18T160139.jsonl.gz\nupw_history.upw_Feb21_08_21\nbq_schema_feb21.json\nRepo\n29.10.2021\n2008-2021\n58.437.927\n2022/03\nunpaywall_snapshot_2022-03-09T083001.jsonl.gz\nupw_history.upw_Mar22_08_22\nbq_schema_mar22.json\nRepo\n14.03.2022\n2008-2022\n67.424.819\n\nStatus Semantic Scholar\n\nSnapshot\nDirectory\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2024-05-28\npapers/\nsemantic_scholar.papers\n/\nRepo\n10.06.2024\nAll\n218.668.220\n2024-05-28\nvenues/\nsemantic_scholar.venues\n/\nRepo\n10.06.2024\nAll\n194.578\n\nStatus Openalex\n\nSnapshot\nDirectory\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2024-09-27\nauthors/\nopenalex.authors\nschema_openalex_author.json\nRepo\n09.10.2024\nAll\n96.105.161\n2024-09-28\nfunders/\nopenalex.funders\nschema_openalex_funders.json\nRepo\n09.10.2024\nAll\n32.437\n2024-09-28\ninstitutions/\nopenalex.institutions\nschema_openalex_institutions.json\nRepo\n09.10.2024\nAll\n109.495\n2024-09-28\npublishers/\nopenalex.publishers\nschema_openalex_publishers.json\nRepo\n09.10.2024\nAll\n10.250\n2024-09-28\nsources/\nopenalex.sources\nschema_openalex_sources.json\nRepo\n09.10.2024\nAll\n254.533\n2024-09-23\ntopics/\nopenalex.topics\nschema_openalex_topics.json\nRepo\n09.10.2024\nAll\n4.516\n2024-09-27\nworks/\nopenalex.works\nschema_openalex_work.json\nRepo\n09.10.2024\nAll\n259.375.778\n\nStatus OpenAlex Document Type classification by SUB Göttingen\n\nSnapshot\nDirectory\nTable\nSchema\nProcedure\nLast Changed\nCoverage\nNumber of rows\n2024-09-27\nworks/\nresources.classification_article_reviews_september_2024\nschema_document_types.json\nRepo\n15.10.2024\nAll\n151.099.815\n\n\n\n\n", + "last_modified": "2024-10-24T14:01:23+02:00" }, { "path": "index.html", "title": "Blog | Scholarly Communication Analytics with R", "author": [], "contents": "\n\n\n\n", - "last_modified": "2024-10-11T10:06:11+02:00" + "last_modified": "2024-10-24T14:01:24+02:00" } ], "collections": ["posts/posts.json"] diff --git a/docs/sitemap.xml b/docs/sitemap.xml index e4c8b7a..579962c 100644 --- a/docs/sitemap.xml +++ b/docs/sitemap.xml @@ -2,11 +2,11 @@ https://subugoe.github.io/scholcomm_analytics/about.html - 2024-09-23T11:52:14+02:00 + 2024-10-24T14:00:48+02:00 https://subugoe.github.io/scholcomm_analytics/data.html - 2024-10-11T10:06:58+02:00 + 2024-10-24T13:46:45+02:00 https://subugoe.github.io/scholcomm_analytics/ @@ -14,7 +14,7 @@ https://subugoe.github.io/scholcomm_analytics/posts/oal_document_types_classifier/ - 2024-10-24T09:40:23+02:00 + 2024-10-24T09:45:22+02:00 https://subugoe.github.io/scholcomm_analytics/posts/openalex_document_types/