Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
data.nitrates
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
DREAL Pays de la Loire
Centre de Services de la Donnée
Eau et milieux aquatiques
data.nitrates
Merge requests
!6
Passage en v0.2.0
Code
Review changes
Check out branch
Download
Patches
Plain diff
Merged
Passage en v0.2.0
dev
into
master
Overview
0
Commits
24
Pipelines
0
Changes
1
Merged
ronan.vignard
requested to merge
dev
into
master
11 months ago
Overview
0
Commits
24
Pipelines
0
Changes
1
Expand
Finalisation des vignettes pour l'import des données brutes
0
0
Merge request reports
Viewing commit
eef034fd
Prev
Next
Show latest version
1 file
+
91
−
18
Inline
Compare changes
Side-by-side
Inline
Show whitespace changes
Show one file at a time
eef034fd
Ajout de la logique
· eef034fd
ronan.vignard
authored
1 year ago
dev/flat_import_hubeau_rw_data.Rmd
+
91
−
18
Options
@@ -7,7 +7,7 @@ editor_options:
```{r development, include=FALSE}
library(testthat)
library(
xlsx
)
library(
hubeau
)
library(datalibaba)
library(RPostgreSQL)
library(sf)
@@ -62,32 +62,105 @@ tables_list <- tables_list |>
```
# Import des données Hub'eau ESU
# Import des données Hub'eau ESU
dans un dataframe par millésime
À reprendre avec la fonction correspondante
du package [{hubeau}](https://github.com/inrae/hubeau)
On utilise la fonction `get_qualite_rivieres_analyse()`
du package [{hubeau}](https://github.com/inrae/hubeau)
```{r create-nitrate_analyse_esu_2020, eval=FALSE}
nitrate_analyse_esu_2020 <-
get_json_data
(code_parametre = "1340",
code_region = "52",
date_debut_prelevement = "2020-01-01",
date_fin_prelevement = "2020-12-31",
size = "5000")
nitrate_analyse_esu_2020 <-
hubeau::get_qualite_rivieres_analyse
(code_parametre = "1340",
code_region = "52",
date_debut_prelevement = "2020-01-01",
date_fin_prelevement = "2020-12-31",
size = "5000")
```
```{r create-nitrate_analyse_esu_2021, eval=FALSE}
nitrate_analyse_esu_2021 <-
get_json_data
(code_parametre = "1340",
code_region = "52",
date_debut_prelevement = "2021-01-01",
date_fin_prelevement = "2021-12-31",
size = "5000")
nitrate_analyse_esu_2021 <-
hubeau::get_qualite_rivieres_analyse
(code_parametre = "1340",
code_region = "52",
date_debut_prelevement = "2021-01-01",
date_fin_prelevement = "2021-12-31",
size = "5000")
```
```{r create-nitrate_analyse_esu_2022, eval=FALSE}
nitrate_analyse_esu_2022 <- get_json_data(code_parametre = "1340",
code_region = "52",
date_debut_prelevement = "2022-01-01",
date_fin_prelevement = "2022-12-31",
size = "5000")
nitrate_analyse_esu_2022 <- hubeau::get_qualite_rivieres_analyse(code_parametre = "1340",
code_region = "52",
date_debut_prelevement = "2022-01-01",
date_fin_prelevement = "2022-12-31",
size = "5000")
```
```{r create-nitrate_analyse_esu_2023, eval=FALSE}
nitrate_analyse_esu_2023 <- hubeau::get_qualite_rivieres_analyse(code_parametre = "1340",
code_region = "52",
date_debut_prelevement = "2023-01-01",
date_fin_prelevement = "2023-12-31",
size = "5000")
```
# Création d'une table pour le nouveau millésime
```{r create-nitrate_data_ars, eval=FALSE}
# Charger les données dans une nouvelle table en base
datalibaba::poster_data(data = data_ars_2023,
table = "nitrate_data_analyse_ars_2023",
schema = "nitrates",
db = "si_eau",
overwrite = TRUE,
user = "admin")
# Ajouter un commentaire sur la table
datalibaba::commenter_table(comment = "Analyses Nitrates ARS (2023)",
table = "nitrate_data_analyse_ars_2023",
schema = "nitrates",
db = "si_eau",
user = "admin")
```
# Modification du type des champs si besoin
```{r modify_column_type, eval=FALSE}
# Modifier le type de colonne pour les champs de date
collectr::modify_column_type(database = "si_eau",
schema = "nitrates",
table = "nitrate_data_analyse_ars_2023",
column_name = "plv_date",
column_type = "date",
role = "admin")
```
# Archivage de la version précédente de la table
```{r archive_table, eval=FALSE}
# Archiver la version actuelle de la table avec tous les millésimes
collectr::archive_table(database = "si_eau",
schema = "nitrates",
new_schema = "zz_archives",
table = "nitrate_data_analyse_ars",
role = "admin")
```
# Insertion des données du nouveau millésime en base dans la table globale
```{r import_and_merge_tables, eval=FALSE}
# Insérer les données de la table du dernier millésime vers la table complète
collectr::import_and_merge_tables(database = "si_eau",
source_table = "nitrate_data_analyse_ars_2023",
source_schema = "nitrates",
target_table = "nitrate_data_analyse_ars",
target_schema = "nitrates",
role = "admin")
# Actualiser le commentaire sur la table
datalibaba::commenter_table(comment = "Analyses Nitrates ARS (2007-2023)",
table = "nitrate_data_analyse_ars",
schema = "nitrates",
db = "si_eau",
user = "admin")
```
```{r development-inflate, eval=FALSE}
Loading