[Autoloop] [Autoloop: perf-comparison]

Open
#218 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
25/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Quiet
Tech stack
pandas, python, typescript
Domain
performance, testing-qa

Research direction

Start in benchmarks/pandas and benchmarks/tsb, reviewing the five paired files named in the patch preview: insert_pop_column, natsort_strings, and the three string-accessor benchmarks. Use the workflow's patch artifact as the concrete reference. Done means the five pandas/TypeScript benchmark pairs are present and the accumulated benchmark comparison remains consistent.

Written by the indexing model from the issue text.

Description

agentic-workflows autoloop automation

🤖 This PR is maintained by Autoloop. Each accepted iteration adds a commit to this branch.

Goal

Systematically benchmark every tsb function against its pandas equivalent, one function per iteration. Results are published to the playground benchmarks page.

Current best metric: 643 benchmark pairs

Latest iteration (290)

Added 5 new benchmark pairs:

  • string_accessor_lower_strip — str.lower() + str.strip() on 100k strings
  • string_accessor_len_replace — str.len() + str.replace() on 100k strings
  • string_accessor_split_join — str.split() on 100k strings
  • insert_pop_column — insertColumn + popColumn on 10k-row DataFrame
  • natsort_strings — natSorted on 10k natural-order strings

Total: 508 → 643 benchmark pairs accumulated on this branch.

Generated by Autoloop · ● 1.9M · ◷

[!NOTE]
This was originally intended as a pull request, but the git push operation failed.

Workflow Run: View run details and download patch artifact

The patch file is available in the agent artifact in the workflow run linked above.

To create a pull request with the changes:

# Download the artifact from the workflow run
gh run download 24919519451 -n agent -D /tmp/agent-24919519451

# Create a new branch
git checkout -b autoloop/perf-comparison

# Apply the patch (--3way handles cross-repo patches where files may already exist)
git am --3way /tmp/agent-24919519451/aw-autoloop-perf-comparison.patch

# Push the branch to origin
git push origin autoloop/perf-comparison

# Create the pull request
gh pr create --title '[Autoloop] [Autoloop: perf-comparison]' --base main --head autoloop/perf-comparison --repo githubnext/tsessebe
Show patch preview (396 of 396 lines) 
From fa861a099486416627401d4543a1eff2f98ab1fb Mon Sep 17 00:00:00 2001
From: "github-actions[bot]" <github-actions[bot]@users.noreply.github.com>
Date: Sat, 25 Apr 2026 01:43:50 +0000
Subject: [PATCH] [Autoloop: perf-comparison] Iteration 290: add 5 benchmark
 pairs (string_accessor lower/strip, len/replace, split/join, insert_pop,
 natsort)

Run: https://github.com/githubnext/tsessebe/actions/runs/24919519451

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
---
 benchmarks/pandas/bench_insert_pop_column.py  | 33 +++++++++++++++++
 benchmarks/pandas/bench_natsort_strings.py    | 29 +++++++++++++++
 .../bench_string_accessor_len_replace.py      | 27 ++++++++++++++
 .../bench_string_accessor_lower_strip.py      | 27 ++++++++++++++
 .../bench_string_accessor_split_join.py       | 25 +++++++++++++
 benchmarks/tsb/bench_insert_pop_column.ts     | 35 +++++++++++++++++++
 benchmarks/tsb/bench_natsort_strings.ts       | 29 +++++++++++++++
 .../tsb/bench_string_accessor_len_replace.ts  | 32 +++++++++++++++++
 .../tsb/bench_string_accessor_lower_strip.ts  | 32 +++++++++++++++++
 .../tsb/bench_string_accessor_split_join.ts   | 30 ++++++++++++++++
 10 files changed, 299 insertions(+)
 create mode 100644 benchmarks/pandas/bench_insert_pop_column.py
 create mode 100644 benchmarks/pandas/bench_natsort_strings.py
 create mode 100644 benchmarks/pandas/bench_string_accessor_len_replace.py
 create mode 100644 benchmarks/pandas/bench_string_accessor_lower_strip.py
 create mode 100644 benchmarks/pandas/bench_string_accessor_split_join.py
 create mode 100644 benchmarks/tsb/bench_insert_pop_column.ts
 create mode 100644 benchmarks/tsb/bench_natsort_strings.ts
 create mode 100644 benchmarks/tsb/bench_string_accessor_len_replace.ts
 create mode 100644 benchmarks/tsb/bench_string_accessor_lower_strip.ts
 create mode 100644 benchmarks/tsb/bench_string_accessor_split_join.ts

diff --git a/benchmarks/pandas/bench_insert_pop_column.py b/benchmarks/pandas/bench_insert_pop_col
... (truncated)
Dominant language
TypeScript
Stars
9
Forks
4
Avg merge
3d 3h
Merged PRs (30d)
15

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from githubnext/tsb

All issues in githubnext/tsb

Similar issues

More TypeScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.