Skip to content

Instantly share code, notes, and snippets.

@nateberkopec

nateberkopec/0_roadmap.md

Last active March 31, 2025 19:35
Show Gist options
  • Save nateberkopec/ffdd047bca2ca059dc1ace8ca4ef338b to your computer and use it in GitHub Desktop.
Save nateberkopec/ffdd047bca2ca059dc1ace8ca4ef338b to your computer and use it in GitHub Desktop.
Download ZIP
Speedshop Retainer Roadmap + Changelog
Raw
0_roadmap.md

Speedshop Retainer Roadmap

This is the roadmap for the Speedshop Ruby on Rails performance retainer service. It was last updated March 28th, 2025. Items are in rough priority order.

In-Progress:

  1. Alerting and dashboard scorecards: We want everyone to be on the same footing with SLOs for queues and tracking our core set of 20 metrics, plus your app's specific key metrics (see next bullet). The output will be a scorecard page that's pass/fail on each point.
  2. Formalizing key metrics with everyone: Since we started the retainer, we learned it's helpful to have a set of 3 or fewer key metrics to monitor and improve upon over the course of the retainer. If we haven't already formalized these with you, we'll do so.
  3. Automated checks: jemalloc, YJIT, RMP, SQL comments, bcrypt version. We have a few automated checks that can be implemented just by reading your source code and doing a couple of static checks. We'll also ship some detailed guides for "why" and "how" to implement each.
  4. Sidekiq/Puma auto-tuner: Yuki continues to work away at adaptive concurrency for Puma and Sidekiq. No more setting thread counts, and automatically adjusts to changing workloads.

Backlog

  1. A "performance score". This score, similar to Lighthouse, basically audits your team and app on a number of set "checks" (there will probably be 50 in total). Some of this is “are you running with jemalloc”, others might be “response time below subjective Nate thresholds or meeting best practices”.
  2. Client portal. Uses magic link sign in based on email domain.
  3. Core Web Vitals monitoring
  4. Ruby Platform-Kai, a semi-public meetup for Ruby platform teams.
  5. Quarterly executive briefings on long-term trends, risks, growth opportunities in platform we’re seeing, like a mini-conference.
  6. Ultra Tier. Aimed specifically at companies of >100 Ruby engineers. Includes additional training, company laptop usage, more.
  7. Mini Tier. Aimed at companies of 10 devs or less. Limited communication, no sync calls.
Raw
1_changelog.md

Speedshop Retainer Changelog

This is the changelog for the Speedshop Ruby on Rails performance retainer service. This was last updated March 28th, 2025.

March 2025

  1. Office Hours. You can now sign up for regular office hours, 30 minutes every 2 weeks.
  2. Retainer Roadmap and Changelog. We're working on more services and extensions to the retainer service. You can keep up with stuff yet to come in the Roadmap, and stuff done already in the Changelog.
  3. Free Ongoing Education/Workshops. We started a book club for The Rails Performance Apocrypha.

January 2025

  1. Permanent retainer call link. You now have a permanent link you can use to schedule calls with Nate at any time.
  2. rubocop-scrutineer, our new gem of custom cops. 4 highly opinionated custom Rubocops that help you to write faster Rails applications.
  3. jemalloc tuning and Ruby thread timeslice experiments. We started conducting tests for tuning jemalloc and Ruby thread timeslices.
  4. ids_must_be_indexed Github Action. Not retainer-only but funded by retainer work, this Github Action checks PRs for columns which might be foreign keys and which don't have indexes.
  5. Faster bundle installs. We showed all our retainer clients how to change a simple setting to get faster bundle install times.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment