Mr big Data gitmaster - Group Planet initial directory - #7

Open

jsrawan-mobo wants to merge 89 commits into

hackerdojoml:masterfrom

jsrawan-mobo:master

Commits on May 14, 2011

test
Jag Srawan
committed
ce28924
Test commit.

Scott L. Burson
authored and
Scott L. Burson
committed
dc19e8c
test
lbling
committed
85c2d7a

Commits on May 15, 2011

Added initial folders.
Jag Srawan
committed
4cb0203
Reference Docs
Jag Srawan
committed
48c1662
Made eclipse compatible project.
Jag Srawan
committed
6701f75
Added files for pydev project.
Jag Srawan
committed
4d8689d
Fixed up readme.
Jag Srawan
committed
1d616bc
Add 100K data for generation.
Jag Srawan
committed
8ae30fa
Added inputGen, can read and dump as json. Need to do rest still.
Jag Srawan
committed
5370266

Commits on May 16, 2011

partially working with arrays, but cannot search.
Jag Srawan
committed
3d680b0
Now working for 1000 randomly selected data points
Jag Srawan
committed
a2179d4
Added Zip Codes to lat, long
Jag Srawan
committed
32b6873
Now with lat long.
Jag Srawan
committed
6141e27
Now working with lat long.
Jag Srawan
committed
033e9b5
Updated to remove zip code.
Jag Srawan
committed
0729fec
reduce min node count to 100 to reduce tree size.
Jag Srawan
committed
e1ca0ce

Commits on May 18, 2011

test
Jag Srawan
committed
872aeb6
Here's what I have so far. This is completely untested. mr-equi-hist.py

Scott L. Burson
authored and
Scott L. Burson
committed
cda7e7b

Commits on May 19, 2011

Cleaned up results.
Jag Srawan
committed
22f919f
Made data numeric.
Jag Srawan
committed
fdf478e
Added planet model lib for read/writing to file.
Jag Srawan
committed
180eeaf

Commits on May 20, 2011

Now we can print node model to file, however, need to get applicable nodes.
Jag Srawan
committed
a3118fd
almost working, but results have changed.
Jag Srawan
committed
8de893e
Now works with our iterative model file approach. Can try mapreduce job.
Jag Srawan
committed
2a3a7c6
expected result, for testing.
Jag Srawan
committed
944a873
Added project files to access Scott's work.
Jag Srawan
committed
c71fdf7
Now we can graph.
Jag Srawan
committed
9509d1a
Working with digraph, need to balance out tree.
Jag Srawan
committed
9d285e2
Works!
Jag Srawan
committed
9e30e72
refactored code. No duplicates
Jag Srawan
committed
3bfd3c0
Now working well with graphviz!
Jag Srawan
committed
9db67fd
Initial presentation.
Jag Srawan
committed
5b5266a

Commits on Feb 20, 2012

Now working again. Looks like rowmath needs help
Jag Srawan
committed
7692933
latest changes
Jag Srawan
committed
9b9330f
removed compiled python
Jag Srawan
committed
c17dd7c
Upgraded to latest pygraph routine.
Jag Srawan
committed
deeb762

Commits on May 26, 2012

Initial data set and results thus far. RMLSE 0.95 :(
jsrawan-mobo
committed
dc619c9
now lm in a loop
jsrawan-mobo
committed
3671944
Campaign.r with mikes original data.
jsrawan-mobo
committed
81ed583
Campaign.r with mikes original data.
jsrawan-mobo
committed
36701d4
now with cleaning.
jsrawan-mobo
committed
4934b7b

Commits on May 29, 2012

Commits on May 30, 2012

Does not work. Validation error goes off the hook once all params are included...
jsrawan-mobo
committed
2af5d3f

Commits on May 31, 2012

Mike gbm, without any output
jsrawan-mobo
committed
d560e54

Commits on Jun 16, 2012

From Eugene's. Submitted to kaggle already.
jsrawan-mobo
committed
ce6d349

Commits on Jun 17, 2012

Now RMLSE equals the first submission that we made with RMLSE 0.76 (predicted against training set is 0.73)
jsrawan-mobo
committed
4105376
from competition
jsrawan-mobo
committed
9d5fa2e
This is running as per the submitted values. Noticed small difference, something to do with floating point between windows and linux.
jsrawan-mobo
committed
d8175e7
Whoops. Fixed now.
jsrawan-mobo
committed
75aa521
Modified but worse results.
jsrawan-mobo
committed
431e98f
temp not working
jsrawan-mobo
committed
5ed4396
unvalidated.
jsrawan-mobo
committed
3409c3d
fix xtest.
jsrawan-mobo
committed
db1c7ae

Commits on Aug 18, 2012

works on ubuntu12 with latest.
jsrawan-mobo
committed
c5e8b43
Now checkin working copy.
jsrawan-mobo
committed
8f01bf2

Commits on Jan 26, 2013

titanic submits
jsrawan-mobo
committed
9e49bbf
added inputs
jsrawan-mobo
committed
1963883

Commits on Feb 2, 2013

yelp readme
jsrawan-mobo
committed
75d601b

Commits on Feb 9, 2013

initial yelp normalization
jsrawan-mobo
committed
d499e23

Commits on Feb 10, 2013

Commits on Feb 11, 2013

Now clusters are index by business_id, for fast lookup.
jsrawan-mobo
committed
58acc58
Runs through, now we need to validate, somehow, by taking average over each cluster.
jsrawan-mobo
committed
155b4ec
Clean up error handling.
jsrawan-mobo
committed
8447c15
Validation Works!! we have 130K users in 3k clusters..
jsrawan-mobo
committed
23bba4a
added auxilary files.
jsrawan-mobo
committed
6f654eb
Now user'ids included in cluster assignments.
jsrawan-mobo
committed
c0153a3
dump stats fails on reducer!
jsrawan-mobo
committed
38356f6

Commits on Apr 7, 2014

walmart version 1
jsrawan-mobo
committed
de33d6d
remove lock files
jsrawan-mobo
committed
f2819fa
submission on small trees
jsrawan-mobo
committed
2502325
submission 2
jsrawan-mobo
committed
60d8dad
submission full trees and data
jsrawan-mobo
committed
a257239

Commits on Apr 8, 2014

added WMAE
jsrawan-mobo
committed
404e9a8
WMAE is much better, however, only after exluding negative and small values
jsrawan-mobo
committed
1b26981
submission 7
jsrawan-mobo
committed
880cbc3
submission 8
jsrawan-mobo
committed
fb78064

Commits on May 20, 2014

leave in reload state
jsrawan-mobo
committed
a8eee4e

Commits on Sep 17, 2014

walmart
jsrawan-mobo
committed
179165e