dane-download-worker

Basic "DANE worker" that downloads input data via HTTP(s) URLs for further processing by other DANE workers. Depends on DANE-server

Tool suite: DANE

The following closely related tools are in a tool suite together with dane-download-worker:

  • Experimental: The technology is implemented and ready for experimental settings (beta), but requires further work and validation.
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

DANE 0.4.3

Utils for working with the Distributed Annotation and Enrichment system [view more]
  • Multimedia > Video
  • Scientific/Engineering > Artificial Intelligence
  • Software Development > Libraries > Python Modules
Created: 2019-11-25
Modified: 2024-05-13
  • Experimental: The technology is implemented and ready for experimental settings (beta), but requires further work and validation.
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

DANE-server 0.3.1

Back-end for the Distributed Annotation 'n' Enrichment (DANE) system [view more]
Created: 2020-01-22
Modified: 2023-06-19
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

dane-asr-worker 0.1.0

  •   Nanne van Noord
  •   Jaap Blom
Automatic speech recognition through an external service. Depends on DANE-server [view more]
  • Multimedia processing
Created: 2022-02-15
  • Software Library
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.

dane-workflows 0.9.0

  •   Jaap Blom
  •  
  •   The Netherlands Institute for Sound and Vision
Python library for setting up simple data processing workflows (using DANE) [view more]
  • Multimedia processing
Created: 2022-07-18

Citation

You can cite this software using the following citation generated from its metadata:

  • van Noord, Nanne
  • Blom, Jaap
dane-download-worker 0.9.0 .

Logs & Reviews

Name
Automatic software metadata validation report for dane-download-worker 0.9.0
Author
  • codemetapy validator using software.ttl
Date
2024-07-20 03:04:29
Review
Please consult the CLARIAH Software Metadata Requirements at https://github.com/CLARIAH/clariah-plus/blob/main/requirements/software-metadata-requirements.md for an in-depth explanation of any found problems

Validation of dane-download-worker 0.9.0 failed (score 1/5) due to one or more requirement violations:

1. Violation: Software source code *MUST* have a proper README. (This is missing in the metadata)
2. Violation: Software source code *MUST* state its license (This is missing in the metadata)
3. Info: Software source code *SHOULD* link to a continuous integration service that builds the software and runs the software's tests (This is missing in the metadata)
4. Warning: The producer of the software source code *SHOULD* be expressed (This is missing in the metadata)
5. Info: An interface type *SHOULD* be expressed: Software source code should define one or more target products that are the resulting software applications offering specific interfaces (This is missing in the metadata)
6. Warning: Documentation *SHOULD* be expressed (This is missing in the metadata)
7. Info: Reference publications *SHOULD* be expressed, if any (This is missing in the metadata)
8. Info: The technology readiness level *SHOULD* be expressed (This is missing in the metadata)
9. Info: A research domain *SHOULD* be expressed as a category using the NWO Research Fields vocabulary, if applicable (This is missing in the metadata)
10. Info: A research activity *SHOULD* be expressed as a category using the TaDiRaH vocabulary (This is missing in the metadata)
Rating
★ ☆ ☆ ☆ ☆
(log file starts at Sat Jul 20 03:04:27 UTC 2024)

[harvester info] --> Processing dane-download-worker (https://github.com/CLARIAH/dane-download-worker) [Sat Jul 20 03:04:27 UTC 2024]

[harvester info] Git updating cached clone of https://github.com/CLARIAH/dane-download-worker...

[harvester info] No releases found, falling back to default git branch!

[harvester info] Using 'main'

[harvester info] Git reference: main

[harvester info] Scanning directory /tmp/codemeta-harvester.cache/dane-download-worker for harvestable resources...

[harvester info] found codemeta.json for dane-download-worker (md5sum 36fe0b5d4c13aa905b266f087474cfa5); **NOTE: this is considered authoritative and most other detection methods will be skipped now!**

[harvester info] Inferring repostatus information from git activity (used only as a fallback if not explicitly provided)...

[harvester info] Inferred repostatus https://www.repostatus.org/#inactive

[harvester info] Setting group DANE

[harvester info] Reconciliating: codemetapy  --baseuri https://tools.clariah.nl --baseuri https://tools.clariah.nl --includecontext --addcontext https://w3id.org/nwo-research-fields --addcontext https://w3id.org/research-technology-readiness-levels --addcontextgraph https://vocabs.dariah.eu/rest/v1/tadirah/data?format=text/turtle --trl --identifier "dane-download-worker" --codeRepository "https://github.com/CLARIAH/dane-download-worker" --validate /etc/software.ttl --enrich --textv "Please consult the CLARIAH Software Metadata Requirements at https://github.com/CLARIAH/clariah-plus/blob/main/requirements/software-metadata-requirements.md for an in-depth explanation of any found problems" -O /tmp/out/dane-download-worker.codemeta.json /tmp/codemeta-harvester.cache//tmp/99-repostatus.dane-download-worker.codemeta.json /tmp/codemeta-harvester.cache//tmp/10-jsonld.dane-download-worker.codemeta.json /tmp/codemeta-harvester.cache//tmp/04-applicationSuite.dane-download-worker.codemeta.json 

-- begin log --

Passed 3 files/sources but specified 0 input types! Automatically guessing types...

Detected input types: [('/tmp/codemeta-harvester.cache//tmp/99-repostatus.dane-download-worker.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/10-jsonld.dane-download-worker.codemeta.json', 'json'), ('/tmp/codemeta-harvester.cache//tmp/04-applicationSuite.dane-download-worker.codemeta.json', 'json')]

Adding to contextgraph: /tmp/turtle

Initial URI automatically generated, may be overriden later: https://tools.clariah.nl/dane-download-worker

Processing source #1 of 3

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/99-repostatus.dane-download-worker.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.clariah.nl/dane-download-worker

[CODEMETA COMPOSITION (https://tools.clariah.nl/dane-download-worker)] processed 1 new triples, total is now 2

Processing source #2 of 3

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/10-jsonld.dane-download-worker.codemeta.json

    Injected (possibly temporary) URI https://tools.clariah.nl/dane-download-worker

[CODEMETA COMPOSITION (https://tools.clariah.nl/dane-download-worker)] overriding old https://codemeta.github.io/terms/developmentStatus (https://www.repostatus.org/#inactive -> wip)

[CODEMETA CORRECTION (https://tools.clariah.nl/dane-download-worker)] automatically converting status wip to repostatus URI

[CODEMETA COMPOSITION (https://tools.clariah.nl/dane-download-worker)] processed 43 new triples, total is now 43

Processing source #3 of 3

Parsing json-ld file from /tmp/codemeta-harvester.cache//tmp/04-applicationSuite.dane-download-worker.codemeta.json

    NOTE: Not a valid JSON-LD document, @context missing! Attempting to inject automatically...

    Injected (possibly temporary) URI https://tools.clariah.nl/dane-download-worker

[CODEMETA COMPOSITION (https://tools.clariah.nl/dane-download-worker)] processed 1 new triples, total is now 44

Remapping URI to (possibly) new identifier and version component: https://tools.clariah.nl/dane-download-worker -> https://tools.clariah.nl/dane-download-worker/0.9.0

[CODEMETA VALIDATION (dane-download-worker)] license not set

[CODEMETA VALIDATION (dane-download-worker)] done

[CODEMETA ENRICHMENT (dane-download-worker)] automatically adding runtimePlatform Python derived from programmingLanguage Python

[CODEMETA ENRICHMENT (dane-download-worker)] considering first author as maintainer

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #1: Violation: Software source code *MUST* have a proper README. (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #2: Violation: Software source code *MUST* state its license (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #3: Info: Software source code *SHOULD* link to a continuous integration service that builds the software and runs the software's tests (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #4: Warning: The producer of the software source code *SHOULD* be expressed (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #5: Info: An interface type *SHOULD* be expressed: Software source code should define one or more target products that are the resulting software applications offering specific interfaces (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #6: Warning: Documentation *SHOULD* be expressed (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #7: Info: Reference publications *SHOULD* be expressed, if any (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #8: Info: The technology readiness level *SHOULD* be expressed (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #9: Info: A research domain *SHOULD* be expressed as a category using the NWO Research Fields vocabulary, if applicable (This is missing in the metadata)

VALIDATION https://tools.clariah.nl/dane-download-worker/0.9.0 #10: Info: A research activity *SHOULD* be expressed as a category using the TaDiRaH vocabulary (This is missing in the metadata)

-- end log --

[harvester info] Output written to /tmp/out/dane-download-worker.codemeta.json

[harvester info] <-- Finished processing dane-download-worker (https://github.com/CLARIAH/dane-download-worker) [Sat Jul 20 03:04:29 UTC 2024]

        

Metadata Properties

Version
0.9.0
Interface types
  • Unknown
Source code repository
 https://github.com/CLARIAH/dane-download-worker  Stars are an indicator of the popularity of this project on GitHub
Category
  • Multimedia processing
Development Status
  • WIP: Initial development is in progress, but there has not yet been a stable, usable release suitable for the public.
Issue Tracker (Support)
https://github.com/CLARIAH/dane-download-worker/issues  The number of open issues on the issue tracker  The number of closes issues on the issue tracker
Author(s)
Maintainer(s)
  •   Nanne van Noord
Contributor(s)
  •   Martijn van de Donk (The Netherlands Institute for Sound and Vision)
  •   Govert Brinkmann (The Netherlands Institute for Sound and Vision)
Funder
Programming Language
  • Python 3
Runtime Platform
  • Python
Software dependencies
  • Python 3.10
Metadata validation
★ ☆ ☆ ☆ ☆
Created
2022-02-08