Skip to content

[REVIEW] Port NVStrings datetime conversion ops to cudf strings column#3232

Merged
harrism merged 26 commits intorapidsai:branch-0.11from
davidwendt:port-nvs-datetime-ops
Nov 18, 2019
Merged

[REVIEW] Port NVStrings datetime conversion ops to cudf strings column#3232
harrism merged 26 commits intorapidsai:branch-0.11from
davidwendt:port-nvs-datetime-ops

Conversation

@davidwendt
Copy link
Copy Markdown
Contributor

This is porting of the NVStrings datetime conversion methods to strings_column_view functions.

NVStrings methods addressed in this PR:

timestamp2long
long2timestamp

New names will be: to_timestamps, from_timestamps() respectively

@davidwendt davidwendt requested review from a team as code owners October 28, 2019 19:44
@davidwendt davidwendt self-assigned this Oct 28, 2019
@davidwendt davidwendt added 2 - In Progress Currently a work in progress strings strings issues (C++ and Python) labels Oct 28, 2019
@jrhemstad jrhemstad requested a review from trxcllnt October 28, 2019 20:09
@codecov
Copy link
Copy Markdown

codecov bot commented Oct 28, 2019

Codecov Report

Merging #3232 into branch-0.11 will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@             Coverage Diff             @@
##           branch-0.11   #3232   +/-   ##
===========================================
  Coverage         87.3%   87.3%           
===========================================
  Files               49      49           
  Lines             9214    9214           
===========================================
  Hits              8044    8044           
  Misses            1170    1170

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3722385...a9d8d55. Read the comment docs.

Copy link
Copy Markdown
Member

@harrism harrism left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One suggestion.

@jrhemstad
Copy link
Copy Markdown
Contributor

@trxcllnt does simt::chrono have https://en.cppreference.com/w/cpp/chrono/parse and https://en.cppreference.com/w/cpp/chrono/format?

If so, this PR could be vastly, vastly simplified by using those.

@davidwendt davidwendt changed the title [WIP] Port NVStrings datetime conversion ops to cudf strings column [REVIEW] Port NVStrings datetime conversion ops to cudf strings column Nov 7, 2019
@davidwendt davidwendt added 3 - Ready for Review Ready for review by team and removed 2 - In Progress Currently a work in progress labels Nov 7, 2019
@harrism harrism dismissed jrhemstad’s stale review November 8, 2019 01:24

All review comments addressed.

@harrism
Copy link
Copy Markdown
Member

harrism commented Nov 8, 2019

@davidwendt This is ready to merge once you resolve conflicts.

@rwlee
Copy link
Copy Markdown
Contributor

rwlee commented Nov 15, 2019

As part of this port, can we get fixes for some of the issues opened up against these operators?

-- Negative timestamp support for from_timestamp (long2timestamp), #3116
-- The 2 issues in this github issue #3353, data corrupt from reading past end of string and blind consumption of literals. The data corruption from reading past the end of string may be fixed because the length is no longer unsigned.
-- Documentation update to accurately reflect functionality, resolves #3118
-- Ideally something that fits this feature request too #3320

@davidwendt
Copy link
Copy Markdown
Contributor Author

As part of this port, can we get fixes for some of the issues opened up against these operators?

-- Negative timestamp support for from_timestamp (long2timestamp), #3116
-- The 2 issues in this github issue #3353, data corrupt from reading past end of string and blind consumption of literals. The data corruption from reading past the end of string may be fixed because the length is no longer unsigned.
-- Documentation update to accurately reflect functionality, resolves #3118
-- Ideally something that fits this feature request too #3320

All of these will require significant work. This PR is intended to just port the existing function. New follow on PRs will be created to address these issues.

@harrism harrism requested a review from jrhemstad November 17, 2019 21:28
@harrism
Copy link
Copy Markdown
Member

harrism commented Nov 17, 2019

Crap, accidentally deleted a " in the CMakeLists.txt when I resolved conflicts. Sorry @davidwendt .

@harrism harrism dismissed jrhemstad’s stale review November 18, 2019 21:29

All comments addressed.

@harrism harrism merged commit 2eab329 into rapidsai:branch-0.11 Nov 18, 2019
@davidwendt davidwendt deleted the port-nvs-datetime-ops branch November 22, 2019 14:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

5 - Ready to Merge Testing and reviews complete, ready to merge strings strings issues (C++ and Python)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants