# \#harvesting
**URL:** https://forum.clarin.eu/tag/harvesting/40.md
[Latest](https://forum.clarin.eu/latest.md) · [Categories](https://forum.clarin.eu/categories.md) · [Tags](https://forum.clarin.eu/tags.md)
---
## [Can you harvest my data from Zenodo, DataVerse, FigShare, Github, Hugging Face?](https://forum.clarin.eu/t/can-you-harvest-my-data-from-zenodo-dataverse-figshare-github-hugging-face/1490)
**Author:** [@dieter](https://forum.clarin.eu/u/dieter)\
**Replies:** 0\
**Last updated:** [23 July 2026 09:50 UTC](https://forum.clarin.eu/t/can-you-harvest-my-data-from-zenodo-dataverse-figshare-github-hugging-face/1490 "2026-07-23T09:50:44Z")
It depends on: the exact repository the quality of the metadata Since it is not trivial at all to ensure that all technical requirements for successful harvesting are fulfilled, we advise to deposit your data with a C…
---
## [Do I need to configure my OAI-PMH provider differently for CMDI 1.1 and CMDI 1.2?](https://forum.clarin.eu/t/do-i-need-to-configure-my-oai-pmh-provider-differently-for-cmdi-1-1-and-cmdi-1-2/922)
**Author:** [@twagoo](https://forum.clarin.eu/u/twagoo)\
**Replies:** 0\
**Last updated:** [9 July 2025 14:17 UTC](https://forum.clarin.eu/t/do-i-need-to-configure-my-oai-pmh-provider-differently-for-cmdi-1-1-and-cmdi-1-2/922 "2025-07-09T14:17:35Z")
Yes, the correct method of configuring the metadata formats response of an OAI-PMH provider depends on the version of CMDI that is provided. This is documented with examples at OAI for PMH on the CLARIN website.
---
## [I have multiple OAI prefixes. How does the harvester deal with this?](https://forum.clarin.eu/t/i-have-multiple-oai-prefixes-how-does-the-harvester-deal-with-this/470)
**Author:** [@twagoo](https://forum.clarin.eu/u/twagoo)\
**Replies:** 0\
**Last updated:** [12 September 2024 16:29 UTC](https://forum.clarin.eu/t/i-have-multiple-oai-prefixes-how-does-the-harvester-deal-with-this/470 "2024-09-12T16:29:33Z")
The harvester uses the namespace URI to detect the provided metadata format (http://www.clarin.eu/cmd/1 for CMDI 1.2, http://www.clarin.eu/cmd/ for older versions), so all prefixes get included automatically. See the OA…
---
## [Radboud Data Repository data sets in the VLO](https://forum.clarin.eu/t/radboud-data-repository-data-sets-in-the-vlo/688)
**Author:** [@dieter](https://forum.clarin.eu/u/dieter)\
**Replies:** 0\
**Last updated:** [3 February 2025 13:16 UTC](https://forum.clarin.eu/t/radboud-data-repository-data-sets-in-the-vlo/688 "2025-02-03T13:16:09Z")
The Centre for Language Studies and Radboud Institute for Culture & History collections from the Radboud Data Repository are now also findable via the VLO (The Collection facet will later on get a more meaningful value,…
---
## [I have a DSpace repository. How can I offer my CMDI files over OAI-PMH?](https://forum.clarin.eu/t/i-have-a-dspace-repository-how-can-i-offer-my-cmdi-files-over-oai-pmh/468)
**Author:** [@twagoo](https://forum.clarin.eu/u/twagoo)\
**Replies:** 0\
**Last updated:** [12 September 2024 16:25 UTC](https://forum.clarin.eu/t/i-have-a-dspace-repository-how-can-i-offer-my-cmdi-files-over-oai-pmh/468 "2024-09-12T16:25:05Z")
CLARIN-DSpace supports providing CMDI (as well as metadata in various other formats) over the OAI-PMH protocol. This is the protocol that is used by CLARIN to “harvest” metadata records. The use of OAI-PMH within CLARIN…
---
## [Metadata university repository harvested in VLO: Radboud University PoC](https://forum.clarin.eu/t/metadata-university-repository-harvested-in-vlo-radboud-university-poc/706)
**Author:** [@Henk](https://forum.clarin.eu/u/Henk)\
**Replies:** 0\
**Last updated:** [18 February 2025 16:29 UTC](https://forum.clarin.eu/t/metadata-university-repository-harvested-in-vlo-radboud-university-poc/706 "2025-02-18T16:29:04Z")
We would like to share an interesting achievement. CLARIN’s Virtual Language Observatory (VLO) now harvests the metadata records of datasets in Radboud University’s Data Repository (RDR, https://data.ru.nl/) that are pub…
---
## [Collection name improvement for DataCite OAI providers](https://forum.clarin.eu/t/collection-name-improvement-for-datacite-oai-providers/644)
**Author:** [@dieter](https://forum.clarin.eu/u/dieter)\
**Replies:** 0\
**Last updated:** [8 January 2025 13:16 UTC](https://forum.clarin.eu/t/collection-name-improvement-for-datacite-oai-providers/644 "2025-01-08T13:16:24Z")
Thanks to @twagoo the DataCite metadata collections in the VLO that are harvested from OAI providers are now marked with a meaningful Collection field, see e.g.: DANS records Trolling records Technical details are ava…
---
## [If I deliver CLARIN metadata today, can you make my metadata available to the broad public?](https://forum.clarin.eu/t/if-i-deliver-clarin-metadata-today-can-you-make-my-metadata-available-to-the-broad-public/475)
**Author:** [@twagoo](https://forum.clarin.eu/u/twagoo)\
**Replies:** 0\
**Last updated:** [13 September 2024 08:38 UTC](https://forum.clarin.eu/t/if-i-deliver-clarin-metadata-today-can-you-make-my-metadata-available-to-the-broad-public/475 "2024-09-13T08:38:26Z")
Yes - bringing all metadata descriptions together (“harvesting”, see harvesting) and making them searchable (“indexing”) is an important part of the infrastructure that CLARIN is building. When you provide CMDI metadata …
---
## [What is the update schedule for the metadata in the VLO?](https://forum.clarin.eu/t/what-is-the-update-schedule-for-the-metadata-in-the-vlo/462)
**Author:** [@twagoo](https://forum.clarin.eu/u/twagoo)\
**Replies:** 0\
**Last updated:** [12 September 2024 16:18 UTC](https://forum.clarin.eu/t/what-is-the-update-schedule-for-the-metadata-in-the-vlo/462 "2024-09-12T16:18:25Z")
The metadata harvester runs with different configurations at different starting times: Monday and Thursday 20:00 CE(S)T: harvesting of CLARIN providers Friday 20:00 CE(S)T: harvesting of non-CLARIN providers The VLO i…
---
## [I have a self-developed repository. How can I offer my CMDI files over OAI-PMH?](https://forum.clarin.eu/t/i-have-a-self-developed-repository-how-can-i-offer-my-cmdi-files-over-oai-pmh/467)
**Author:** [@twagoo](https://forum.clarin.eu/u/twagoo)\
**Replies:** 0\
**Last updated:** [12 September 2024 16:24 UTC](https://forum.clarin.eu/t/i-have-a-self-developed-repository-how-can-i-offer-my-cmdi-files-over-oai-pmh/467 "2024-09-12T16:24:21Z")
There are several packages available to setup an OAI provider, some popular examples: file-based, Tomcat web application written in Java: jOAI (some centres have good experiences with this one) database-based, written …
---
## [Which sources does CLARIN harvest from for the VLO?](https://forum.clarin.eu/t/which-sources-does-clarin-harvest-from-for-the-vlo/469)
**Author:** [@twagoo](https://forum.clarin.eu/u/twagoo)\
**Replies:** 0\
**Last updated:** [12 September 2024 16:27 UTC](https://forum.clarin.eu/t/which-sources-does-clarin-harvest-from-for-the-vlo/469 "2024-09-12T16:27:10Z")
The OAI providers from the CLARIN centre registry (= the CLARIN B and C centres) A (relatively static) list of additional OAI providers (OLAC and CMDI) More (technical) details about the harvesting process and results …
---
## [I have a fedora repository. How can I offer my CMDI files over OAI-PMH?](https://forum.clarin.eu/t/i-have-a-fedora-repository-how-can-i-offer-my-cmdi-files-over-oai-pmh/472)
**Author:** [@twagoo](https://forum.clarin.eu/u/twagoo)\
**Replies:** 0\
**Last updated:** [12 September 2024 16:38 UTC](https://forum.clarin.eu/t/i-have-a-fedora-repository-how-can-i-offer-my-cmdi-files-over-oai-pmh/472 "2024-09-12T16:38:25Z")
The CLARIN-D team in Leipzig has written an excellent guide explaining how to do this. (in German)
---
## [If I am hosting a hierarchical CMDI metadata collection, do I need to offer all records over OAI-PMH or only the root nodes?](https://forum.clarin.eu/t/if-i-am-hosting-a-hierarchical-cmdi-metadata-collection-do-i-need-to-offer-all-records-over-oai-pmh-or-only-the-root-nodes/473)
**Author:** [@twagoo](https://forum.clarin.eu/u/twagoo)\
**Replies:** 0\
**Last updated:** [12 September 2024 16:43 UTC](https://forum.clarin.eu/t/if-i-am-hosting-a-hierarchical-cmdi-metadata-collection-do-i-need-to-offer-all-records-over-oai-pmh-or-only-the-root-nodes/473 "2024-09-12T16:43:35Z")
Short answer: as indicated in the OAI-PMH protocol, you need to offer all records. There is no automatic harvesting of any of the CMDI child nodes. Long answer: in the case of our toy example hierarchy, you would need t…