codemeta-harvester

Harvest and aggregate codemeta from source repositories and service endpoints, automatically converting known metadata schemes in the process
Go to the source repository https://github.com/proycon/codemeta-harvester

Provided tools & services

codemeta-harvester

Type
  • Command-line Application
Executable name
codemeta-harvester

Tool suite: CLARIAH Tool Discovery

The following closely related tools are in a tool suite together with codemeta-harvester:

  • Web Application
  • 8 - Complete: Technology complete and qualified, released for all end-users in scholarly environments.
  • Active: The project has reached a stable, usable state and is being actively developed.

CLARIAH Tool Discovery 1.6.4

This is the over-arching project for CLARIAH Tool Discovery, its components harvest and aggregate codemeta from source repositories and service endpoints, automatically converting known metadata schemes in the process. This project holds the Tool Source Registry, pointing to all the tools that are to be harvested. It also holds the validation schema. [view more]
  • Browsing
  • Databases for humanities
  • Discovering
  • Exploration
  • Gathering
  • Software for humanities
  • codemeta
  • harvester
  • linked data
  • metadata
  • rdf
  • schema.org
  • software metadata
  •  Source code
  • Go to CLARIAH Tools (WebApplication) https://tools.clariah.nl This is a web portal where you can find all tools (i.e. software and software services) developed in the CLARIAH project, as well as some tools from predecessors and sister projects. This list is automatically harvested from the tool producers and providers themselves, and updated daily. Our tools are designed for researchers and developers in the Humanities and Social Sciences. Not all tools are suitable for all audiences and not all tools are mature and stable, this information should be clearly indicated for each tool, so you can make an informed judgement whether a tool might be suitable for you.
Created: 2022-01-05
Modified: 2024-06-04
  • Command-line Application
  • Software Library
  • 9 - Proven: Technology complete and proven in practice by real users.
  • Active: The project has reached a stable, usable state and is being actively developed.

CodeMetaPy 3.0.3

Codemetapy is a command-line tool and python library to work with the codemeta software metadata standard. Codemeta builds upon schema.org and defines a vocabulary for describing software source code. It maps various existing metadata standards to a unified vocabulary. Codemetapy allows you to generate codemeta from various sources. [view more]
  • Computer science
  • Converting
  • Software Development
  • codemeta
  • linked data
  • metadata
  • metadata-extractor
  • rdf
  • schema.org
  • scientific
  • software metadata
  • Bsd
  • Linux
  • Macos
  • Python
Created: 2018-04-16
Modified: 2025-04-24
  • Inactive: The project has reached a stable, usable state but is no longer being actively developed; support/maintenance will be provided as time allows.

codemeta-lod-to-cmdi 1.0-SNAPSHOT

  •   meindertkroese
CLARIAH Tool Discovery output (LOD -> CMDI conversion) [view more]
Created: 2023-02-01
Modified: 2023-05-15
  • Server Application
  • 7 - Release Candidate: Technology ready enough and in initial use by end-users in intended scholarly environments. Further validation may be in progress.
  • Active: The project has reached a stable, usable state and is being actively developed.

codemeta-server 0.5.1

Web API serving codemeta software metadata using codemeta and schema.org, provides a SPARQL endpoint and also offers a human web-interface [view more]
  • Software Development
  • codemeta
  • linked data
  • metadata
  • rdf
  • schema.org
  • scientific
  • software metadata
  • Bsd
  • Linux
  • Macos
  • Python
Created: 2022-03-22
Modified: 2025-08-18
  • Command-line Application
  • Software Library
  • 7 - Release Candidate: Technology ready enough and in initial use by end-users in intended scholarly environments. Further validation may be in progress.
  • Active: The project has reached a stable, usable state and is being actively developed.

codemeta2html 0.2.0

Convert software metadata in codemeta to html for visualisation, can generate fully-fledged static sites that serve well as a portal for a collection of software [view more]
  • Software Development
  • codemeta
  • linked data
  • metadata
  • rdf
  • schema.org
  • scientific
  • software metadata
  • Bsd
  • Linux
  • Macos
  • Python
Created: 2023-05-06
Modified: 2025-03-07
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

codemeta2mp

  •   KNAW Humanities Cluster & CLST, Radboud University
codemeta to SSHOC Open Marketplace converter [view more]
Created: 2024-04-11
Modified: 2026-01-22

Citation

You can cite this software using the following citation generated from its metadata:

(2025) codemeta-harvester 0.5.1 .
  • Humanities Cluster
.

Logs & Reviews

Name
Automatic software metadata validation report for codemeta-harvester 0.5.1
Author
  • codemetapy validator using software.ttl
Date
2026-02-07 03:05:42
Review
Please consult the CLARIAH Software Metadata Requirements at https://github.com/CLARIAH/clariah-plus/blob/main/requirements/software-metadata-requirements.md for an in-depth explanation of any found problems

Validation of codemeta-harvester 0.5.1 was successful (score=3/5), but there are some warnings which should be addressed:

1. Info: Software source code *SHOULD* link to a continuous integration service that builds the software and runs the software's tests (This is missing in the metadata)
2. Warning: Documentation *SHOULD* be expressed (This is missing in the metadata)
3. Info: Reference publications *SHOULD* be expressed, if any (This is missing in the metadata)
Rating
★ ★ ★ ☆ ☆ 
(log file starts at Sat Feb  7 03:05:39 UTC 2026)

[harvester info] --> Processing codemeta-harvester (https://github.com/proycon/codemeta-harvester) [Sat Feb  7 03:05:39 UTC 2026]

[harvester info] Git updating cached clone of https://github.com/proycon/codemeta-harvester...

[harvester info] Found release v0.5.1

[harvester info] Using 'v0.5.1'

[harvester info] Git reference: v0.5.1

[harvester info] Scanning directory /tmp/codemeta-harvester.cache/codemeta-harvester for harvestable resources...

[harvester info] found codemeta.json for codemeta-harvester (md5sum 39e8edef72a4902a6a3f0cd6049e4b8c); **NOTE: this is considered authoritative and most other detection methods will be skipped now!**

[harvester info] Inferring repostatus information from git activity (used only as a fallback if not explicitly provided)...

[harvester info] Inferred repostatus https://www.repostatus.org/#active

[harvester info] Looking for repostatus information in README.md in master branch...

[harvester info] Found repostatus (master branch) https://www.repostatus.org/#active

[harvester info] Setting group CLARIAH Tool Discovery

[harvester info] Reconciliating: codemetapy  --baseuri https://tools.clariah.nl --baseuri https://tools.clariah.nl --includecontext --addcontext https://w3id.org/nwo-research-fields --addcontext https://w3id.org/research-technology-readiness-levels --addcontextgraph https://vocabs.dariah.eu/rest/v1/tadirah/data?format=text/turtle --trl --identifier "codemeta-harvester" --codeRepository "https://github.com/proycon/codemeta-harvester" --validate /etc/software.ttl --released --enrich --textv "Please consult the CLARIAH Software Metadata Requirements at https://github.com/CLARIAH/clariah-plus/blob/main/requirements/software-metadata-requirements.md for an in-depth explanation of any found problems" -O /tmp/out/codemeta-harvester.codemeta.json /tmp/codemeta-harvester.cache//tmp/99-repostatus.codemeta-harvester.codemeta.json /tmp/codemeta-harvester.cache//tmp/10-jsonld.codemeta-harvester.codemeta.json /tmp/codemeta-harvester.cache//tmp/05-repostatus.codemeta-harvester.codemeta.json /tmp/codemeta-harvester.cache//tmp/04-applicationSuite.codemeta-harvester.codemeta.json 

-- begin log --

/usr/lib/python3.12/site-packages/pyshacl/extras/__init__.py:6: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.

  import pkg_resources

Passed 4 files/sources but specified 0 input types! Automatically guessing types...

Detected input types: [('/tmp/codemeta-harvester.cache//tmp/99-repostatus.codemeta-harvester.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/10-jsonld.codemeta-harvester.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/05-repostatus.codemeta-harvester.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/04-applicationSuite.codemeta-harvester.codemeta.json', 'json')]

Adding to contextgraph: /tmp/turtle

Initial URI automatically generated, may be overriden later: https://tools.clariah.nl/codemeta-harvester

Processing source #1 of 4

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/99-repostatus.codemeta-harvester.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.clariah.nl/codemeta-harvester

[CODEMETA COMPOSITION (https://tools.clariah.nl/codemeta-harvester)] processed 1 new triples, total is now 2

Processing source #2 of 4

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/10-jsonld.codemeta-harvester.codemeta.json

    Found main resource with URI https://github.com/proycon/codemeta-harvester.git

    Injected (possibly temporary) URI https://tools.clariah.nl/codemeta-harvester

[CODEMETA CORRECTION (codemeta-harvester)] automatically converting spdx license URI from https:// to http:///

[CODEMETA COMPOSITION (codemeta-harvester)] processed 58 new triples, total is now 58

Processing source #3 of 4

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/05-repostatus.codemeta-harvester.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.clariah.nl/codemeta-harvester

[CODEMETA COMPOSITION (codemeta-harvester)] processed 1 new triples, total is now 58

Processing source #4 of 4

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/04-applicationSuite.codemeta-harvester.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.clariah.nl/codemeta-harvester

[CODEMETA COMPOSITION (codemeta-harvester)] processed 1 new triples, total is now 59

Remapping URI to (possibly) new identifier and version component: https://tools.clariah.nl/codemeta-harvester -> https://tools.clariah.nl/codemeta-harvester/0.5.1

[CODEMETA VALIDATION (codemeta-harvester)] done

[CODEMETA ENRICHMENT (codemeta-harvester)] adding author https://orcid.org/0000-0002-1046-0006 as contributor

VALIDATION https://tools.clariah.nl/codemeta-harvester/0.5.1 #1: Info: Software source code *SHOULD* link to a continuous integration service that builds the software and runs the software's tests (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/codemeta-harvester/0.5.1 #2: Warning: Documentation *SHOULD* be expressed (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/codemeta-harvester/0.5.1 #3: Info: Reference publications *SHOULD* be expressed, if any (This is missing in the metadata)

-- end log --

[harvester info] Output written to /tmp/out/codemeta-harvester.codemeta.json

[harvester info] <-- Finished processing codemeta-harvester (https://github.com/proycon/codemeta-harvester) [Sat Feb  7 03:05:43 UTC 2026]

Metadata Properties

Version
0.5.1
Interface types
  • Command-line Application
Source code repository
 https://github.com/proycon/codemeta-harvester Stars are an indicator of the popularity of this project on GitHub
Keywords
  • codemeta
  • harvester
  • linked data
  • metadata
  • rdf
  • schema.org
  • software metadata
Development Status
  • 8 - Complete: Technology complete and qualified, released for all end-users in scholarly environments.
  • Active: The project has reached a stable, usable state and is being actively developed.
Issue Tracker (Support)
https://github.com/proycon/codemeta-harvester/issues The number of open issues on the issue tracker The number of closes issues on the issue tracker
Documentation
License
Author(s)
Maintainer(s)
Contributor(s)
Producer
Programming Language
  • shell
Software dependencies
  • codemetapy
Metadata validation
★ ★ ★ ☆ ☆
Created
2022-01-05 16:21:48
Last modified
2025-04-17 11:08:44 Last commit (main branch). Gives an indication of project development activity and rough indication of how up-to-date the latest release is. Number of commits since the last release. Gives an indication of project development activity and rough indication of how up-to-date the latest release is.