Skip to content

docs: clarify NULL handling for quoted vs unquoted CSV values in BigQuery#908

Merged
zajca merged 2 commits intomainfrom
docs/improve-null-handling-documentation
Apr 10, 2026
Merged

docs: clarify NULL handling for quoted vs unquoted CSV values in BigQuery#908
zajca merged 2 commits intomainfrom
docs/improve-null-handling-documentation

Conversation

@zajca
Copy link
Copy Markdown
Member

@zajca zajca commented Apr 9, 2026

Summary

  • Expanded the "Handling NULLs" section to explain the difference between unquoted (,,) and quoted ("") empty values in CSV
  • Added a comparison table showing backend-specific behavior (Snowflake vs BigQuery STRING vs numeric columns)
  • Documented why treatValuesAsNull only works on unquoted values in BigQuery (maps to BQ's nullMarker which skips quoted fields)
  • Highlighted the inconsistency where the same CSV value ("") produces NULL for numeric columns but empty string for STRING columns in BigQuery

Test plan

  • Review the rendered markdown for correct table formatting
  • Verify technical accuracy of the BigQuery nullMarker behavior description

🤖 Generated with Claude Code

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

zajca and others added 2 commits April 9, 2026 11:18
…lues in BigQuery

Expand the Handling NULLs section to explain:
- The difference between unquoted (,,) and quoted ("") empty values in CSV
- Backend-specific behavior comparison (Snowflake vs BigQuery STRING vs numeric)
- Why treatValuesAsNull only works on unquoted values in BigQuery
- The inconsistency where the same CSV value produces NULL for numeric but empty string for STRING columns

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Make it explicit that the difference in NULL handling for quoted empty
strings is a limitation of BigQuery's CSV parser, not Keboola Storage,
and that BigQuery provides no workaround for this behavior.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@zajca zajca marked this pull request as ready for review April 9, 2026 10:25
@zajca zajca requested review from jirkasemmler and odinuv April 9, 2026 10:25
@zajca zajca merged commit 5195ab1 into main Apr 10, 2026
1 check passed
@zajca zajca deleted the docs/improve-null-handling-documentation branch April 10, 2026 12:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants