Skip to content

feat: ✨ stage basic raw data #108

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
martonvago wants to merge 17 commits into
base: main
Choose a base branch
from
Draft

feat: ✨ stage basic raw data #108

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
c559150
feat: :sparkles: stage raw data
martonvago May 28, 2026
b4608bb
feat: :sparkles: track staging with git lfs
martonvago May 28, 2026
30214ad
refactor: :recycle: end early if no raw data
martonvago May 28, 2026
627ee16
chore: :wrench: add vas to known words
martonvago May 28, 2026
df75685
Merge branch 'main' into feat/data-raw-to-staging
martonvago May 28, 2026
455a4ac
refactor: :recycle: add underscore prefix to functions
martonvago May 28, 2026
a7eba5f
Merge branch 'feat/data-raw-to-staging' of github.com:onlimit-study/f…
martonvago May 28, 2026
6660927
refactor: :recycle: handle repeating resources
martonvago Jun 11, 2026
f68dae6
Merge branch 'main' into feat/data-raw-to-staging
martonvago Jun 11, 2026
c53d9d8
refactor: :recycle: reorder functions
martonvago Jun 12, 2026
28e412e
feat: :sparkles: stage raw data for resources without special transfo…
martonvago Jun 15, 2026
78b9cdd
feat: :sparkles: get form-event mapping from redcap
martonvago Jun 15, 2026
dd099f8
refactor: :recycle: don't infer schema when reading csv
martonvago Jun 15, 2026
9fe2811
chore: :wrench: ignore typo
martonvago Jun 15, 2026
ac12427
feat: :sparkles: download form-event mapping
Jun 15, 2026
9986f85
refactor: :recycle: remove unnecessary lambda
martonvago Jun 15, 2026
587e717
Merge branch 'feat/raw-to-staging-basic' of github.com:onlimit-study/…
martonvago Jun 15, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitattributes
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1,2 @@
raw/** filter=lfs diff=lfs merge=lfs -text
staging/** filter=lfs diff=lfs merge=lfs -text
6 changes: 6 additions & 0 deletions .typos.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,3 +5,9 @@ extend-exclude = [
# Auto-generated by Flower
"resources"
]

[default]

[default.extend-words]
vas = "vas"
fase = "fase"
8 changes: 6 additions & 2 deletions justfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -79,10 +79,14 @@ preview-website: build-docs
build-readme:
uvx --from quarto quarto render README.qmd --to gfm

# Download data dictionary from REDCap
download-data-dict:
# Download metadata from REDCap
download-metadata:
uv run python scripts/redcap_metadata.py

# Download data from REDCap
download-data:
uv run python scripts/redcap_data.py

# Stage raw data
stage-data:
uv run python scripts/stage_data.py
Loading