yadg: yet another datagram

yadg is a set of tools and parsers aimed to process raw instrument data.

Given an experiment represented by a dataschema, yadg will process the files and folders specified in each experimental step of the dataschema, and produce a datagram – a unified data structure containing all measured (“raw”) data in a given experiment.

The produced datagram is associated with full provenance info, and the data within the datagram contains instrumental error estimates and is annotated with units.

DEPRECATED in yadg-4.2

The post-processing features within yadg are deprecated as of yadg-4.2 in favour of the dgpost library, and will be completely removed in yadg-5.0.

You can read more about yadg in our paper: [Kraus2022b].

yadg user manual

• How to use yadg
• Key features of yadg
• Citing yadg

yadg offloads the responsibility of processing the raw data files to its modules, called parsers. The currently implemented parsers are documented in the following links:

yadg parsers

• dummy: A dummy parser
• basiccsv: Common tabular file parser
• meascsv: Legacy MCPT log file parser
• flowdata: Flow data parser
• electrochem: Electrochemistry data parser
• chromtrace: Raw chromatogram trace file parser
• chromdata: Post-processed chromatography data parser
• qftrace: Network analyser trace file parser
• xpstrace: XPS trace file parser
• xrdtrace: X-ray diffractogram trace file parser
• masstrace: Mass spectroscopy trace file parser