Data sections

A dataset is the top-level grouping for data contributed by a single data source, typically with a coherent thematic scope (e.g. LUCAS topsoil, a national soil survey, a project-specific campaign series). Every campaign must belong to a dataset.

Prerequisites

Notebook cell

In load_ai4sh_dataset_meta.ipynb, the Manage dataset cell runs:

process_file = 'import_data/dataset/manage_process/manage_dataset.json'

structured_process_D, scheme_params_D = Initiate_process(notebook_path, scheme_file, process_file)

if structured_process_D is not None:
    Run_process(structured_process_D, scheme_params_D)

Manage process file

Path: ./ai4sh/import_data/dataset/manage_process/manage_dataset.json

{
  "process": [
    {
      "root_process_id": "import_tabular_data",
      "process": "manage_dataset",
      "delete": false,
      "overwrite": false,
      "parameters": {
        "name": "land use and coverage area frame survey (lucas) topsoil data",
        "alias": "lucas",
        "display_name": "Land Use and Coverage Area frame Survey (LUCAS) topsoil data",
        "data_source_id__data_source_name": "esdac-jrc",
        "contact_name": "esdac - european commissiony",
        "contact_email": "ec-esdac@jrc.ec.europa.eu",
        "begin_date": 20090501,
        "end_date": 20120801,
        "species_id__species_name": "soil",
        "profiling_id__profiling_name": "depth_cm",
        "license_id__license_name": "jrc-lucas",
        "substance_array": "soil",
        "keyword_array": "topsoil, soil health, soil health indicator, europe",
        "url": "https://esdac.jrc.ec.europa.eu/resource-type/soil-point-data",
        "abstract": "LUCAS topsoil survey data.",
        "laboratory": 1,
        "territory_id__territory_name": "eu",
        "spatial_reference_id__spatial_reference_name": "geographic"
      }
    }
  ]
}

Parameters

Parameter Description
name Full name of the dataset (lowercase)
alias Short identifier used for FK lookup in campaign manage files
display_name Display label
data_source_id__data_source_name FK lookup: data source by alias
contact_name Dataset contact name
contact_email Dataset contact email
begin_date Start date as integer (YYYYMMDD)
end_date End date as integer (YYYYMMDD)
species_id__species_name FK lookup: biological classification (typically soil)
profiling_id__profiling_name FK lookup: z-dimension profiling method (e.g. depth_cm)
license_id__license_name FK lookup: license by name
substance_array Comma-separated substance keywords
keyword_array Comma-separated search keywords
url Dataset landing page
abstract Free-text description
laboratory Flag: 1 if laboratory analyses are included, 0 otherwise
territory_id__territory_name FK lookup: geographic territory
spatial_reference_id__spatial_reference_name FK lookup: coordinate reference system

Next step

Proceed to Manage campaign.

Updated: