Skip to content

Leamare parallelism#271

Open
leamare wants to merge 7 commits into
tempestphp:mainfrom
leamare:leamare-parallelism
Open

Leamare parallelism#271
leamare wants to merge 7 commits into
tempestphp:mainfrom
leamare:leamare-parallelism

Conversation

@leamare

@leamare leamare commented Mar 13, 2026

Copy link
Copy Markdown

Multi threaded solution. Was kind of procrastinating it while looking at other solutions and experimenring with different approaches. Doing it mostly as a recreational/educational programming session.

@leamare

leamare commented Mar 13, 2026

Copy link
Copy Markdown
Author

/bench

@brendt

brendt commented Mar 13, 2026

Copy link
Copy Markdown
Member

Benchmarking complete! Best execution time: 3.702s

Full results:

{
  "results": [
    {
      "command": "cd /Users/brentroose/Dev/100-million-row-challenge/app/Commands/../../.benchmark/pr-271 && php -dmax_execution_time=300 tempest data:parse --input-path=\"/Users/brentroose/Dev/100-million-row-challenge/app/Commands/../../data/real-data.csv\" --output-path=\"/Users/brentroose/Dev/100-million-row-challenge/app/Commands/../../data/real-data-actual.json\"",
      "mean": 3.7106389577599996,
      "stddev": 0.011058815537161877,
      "median": 3.7046943741600002,
      "user": 13.442552700000002,
      "system": 0.56315312,
      "min": 3.7022768741600003,
      "max": 3.7279116661600002,
      "times": [
        3.70278483316,
        3.7022768741600003,
        3.71552704116,
        3.7046943741600002,
        3.7279116661600002
      ],
      "memory_usage_byte": [
        85590016,
        85688320,
        85966848,
        85966848,
        85966848
      ],
      "exit_codes": [
        0,
        0,
        0,
        0,
        0
      ]
    }
  ]
}

@brendt

brendt commented Mar 13, 2026

Copy link
Copy Markdown
Member

Benchmarking complete! Best execution time: 3.709s

Full results:

{
  "results": [
    {
      "command": "cd /Users/brentroose/Dev/100-million-row-challenge/app/Commands/../../.benchmark/pr-271 && php -dmax_execution_time=300 tempest data:parse --input-path=\"/Users/brentroose/Dev/100-million-row-challenge/app/Commands/../../data/real-data.csv\" --output-path=\"/Users/brentroose/Dev/100-million-row-challenge/app/Commands/../../data/real-data-actual.json\"",
      "mean": 3.71458275588,
      "stddev": 0.00510579663197663,
      "median": 3.7123682974800003,
      "user": 13.437635500000003,
      "system": 0.5645031399999999,
      "min": 3.7094549224800004,
      "max": 3.7214896304800003,
      "times": [
        3.71835563148,
        3.7214896304800003,
        3.7094549224800004,
        3.71124529748,
        3.7123682974800003
      ],
      "memory_usage_byte": [
        85999616,
        86016000,
        86016000,
        86032384,
        86032384
      ],
      "exit_codes": [
        0,
        0,
        0,
        0,
        0
      ]
    }
  ]
}

@brendt brendt removed the verified label Mar 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants