Merge code ? DataPackage / datasets ...

[s-celles]

Hello,

A lot of datasets are also available at https://github.com/datasets
They are called DataPackage.

They are available using Python and

https://github.com/datapackages/datapackage-py (Work In Progress) or https://github.com/trickvi/datapackage

Pinging @vitorbaptista @pwalsh @trickvi @rgrp

There is some overlap between these projects so maybe merging might be considered.

At least we should all be aware of existence of others projects.

Kind regards

PS : Datasets are also available at https://github.com/vincentarelbundock/Rdatasets

[rufuspollock]

Hi, great suggestion and we'd love to connect up with PyDataset (awesome project btw!)

You can find out more about the idea behind Data Packages and the tooling on: http://data.okfn.org/

Generally, i think there is a really good connection in that PyDataset is a really nice library for making data available in your python projects and it can directly build on and leverage data packages and the data package python library. We are really keen to see such tools :-)

[iamaziz]

Hey thanks, indeed the idea is to eventually have a sort of online datasets repository, where a dataset could be (somehow) cached locally once accessed. Instead of shipping the whole set with the package installation. At this stage, PyDataset is relatively limited and it relies entirely on the Rdatasets collection.

data.okfn.org looks great, well maintained, and (more importantly) scalable. Definitely it would be cool to integrate a sort of interface or wrapper to get/publish data there. Would love to see pydataset helps with this :)