Sprint - May 13 to May 24, 2024 #22184

benjackwhite · 2024-05-08T13:04:12Z

Global Sprint Planning

3 things that might take us down

Clickhouse fire rages

Team sprint planning

For your team sprint planning copy this template into a comment below for each team.

# Team ___

**Support hero:** ___

## Retro

<!-- Grab the high and low priority items from last time and add whether that item was completed or not -->

- 

## Hang over items from previous sprint

<!-- For each item, decide to re-prioritise (and add below) or deprioritise -->

- Item 1. prioritised/deprioritise

## OKR

1. OKR, status (red/yellow/green) and action points if yellow/red


### High priority

-

### Low priority / side quests

-

The text was updated successfully, but these errors were encountered:

benjackwhite · 2024-05-08T13:24:55Z

Team Benterprise what-the-heck-is-siem Infra

Hang over items from previous sprint

🟡 SOC2 Audit work came in with a fair amount of follow up work taking a good chunk of @danielxnj
🟡 Switched gear to try Loki as our central log system to tick the SIEM box @danielxnj

Still a lot of work here to make it performant, get all the logs from different systems in etc.

🟢 Noticed big costs in Cloudwatch logs - investigated where it was coming from and dropped the issuse (halving the cost) @frankh
🟢 Get Vault UI and roles and accounts setup @danielxnj

We will let this take a back seat to focus on other things atm

🟢 New kafka setup (i.e. correct zones and size for migrating over to) @danielxnj
🔴 Get some or all logs running into SIEM tool @danielxnj

Ditched Wazuh as it seemed like a maintenance nightmare

🔴 Documentation for Canary deploys so that people can use them @frankh
🟢 Capacity planning dashboard with additional alerting @frankh
🟢 Verify and then document / publicize the IP allow list stuff @benjackwhite
🟢 Rollout security improvement fixes @benjackwhite
🟡 CDP v1.5 - Webhooks destination filtered by Action @benjackwhite

OKR

💪 Deploy with confidence 🟢

Finalize our Canary Deploy process 🟡

🚨 Improved alerting and monitoring 🟢

SIEM work has made this a priority

🔒 Deeper Security 🟡
💰 Continued cost control 🟢

High priority

Look into Loki performance as we will base our SIEM plan on it @frankh
Get as many other log sources into Loki as possible (Kubernetes audit logs, Cloudtrail, SQL/Clickhouse queries, Metabase, HogQL queries) @danielxnj
Get more useful auditing logs out of Django (auth attempts, access logs, HogQL queries) @benjackwhite
Get Metabase setup to tick the audit boxes (auditing, SSO etc.) @frankh @danielxnj
Continue with Soc2 Audit follow up @danielxnj
Fix all remaining High/medium pen test outcomes @benjackwhite
Offsite!

EDsCODE · 2024-05-08T14:20:01Z

mariusandra · 2024-05-08T14:37:15Z

Team Product your Analytics

Support hero: Thomas

Retro

We're still in the middle of it all. HogQL insights are out for everyone. We found a few blind spots (formula + differing results for breakdown options, MAU trends modal, dashboard issues), which we're hard at work on. Dashboards are getting better by the day, fixed a big insight issue today.

🟢 100% of all insight results for everyone use the new HogQL backend @mariusandra
- 🟡 Clean up insights - everyone
- 🟡 Fix existing insight bugs - everyone
- 🟡 Fix dashboardLogic @webjunkie
- ⚪ Convert filters to query for the /api/../insight endpoints
- ⚪ Remove all old legacy code @thmsobrmlr
Low priority / side quests
- 🟡 Start developing the new insight features (Sandy joined and worked on this!)
- ⚪ Fix shared dashboards reloads @Twixes
- ⚪ Project environments

Hang over items from previous sprint

Support & insight bugs.

OKR

No major change here.

HogQL-based querying
- Convert the remaining legacy queries to HogQL and release to public (Thomas, Julian, Marius)
  - 🟢 Insights – they are rolled out!! (still some bugs)
  - ⚪ Cohorts
- Remove legacy querying backend (Thomas, Julian)
  - 🟠 Clean up or rewrite dashboardLogic 👈 this sprint
  - 🟠 Convert filters to query (insights, notebooks, activity log, experiments) 👈 this sprint
- Missing Product Analytics features (Thomas, Julian)
  - ⚪ Breakdowns (multiple) in literally everything
  - 🟠 Make a list based on GitHub issues from customer requests… 👈 this sprint
  - ⚪ Fix those issues
- Missing HogQL features (Tom, Marius)
  - 🟠 Type system, JSON 👈 Data Warehouse is on this
  - ⚪ Missing things when building funnels
Querying and processing performance (Thomas, Julian)
- Global performance overview dashboards
  - ⚪ Insights
  - ⚪ Exports
  - ⚪ Cohort recalculations
- Query request tracing
  - ⚪ Possibly query runner Python optimizations
  - ⚪ Exports improvements
- ⚪ Identify top 5 query optimizations in terms of impact
Artificial Hog / Post Intelligence (Michael)
- ⚪ Ask a question to get a magical insight (aware of your taxonomy)
- ⚪ Figure out infra for upgrading queries and models
- ⚪ Product-wide framework for opting into sharing with OpenAI
Activation (side quest: Michael)
- ⚪ Michael to work with Growth to identify optimizations to getting started with Product Analytics

High priority

For most of the team:

1 week offsite

For everyone else:

Fix all reported and open insight issues
Fix dashboard and insight logics

Low priority / side quests

Better tracked here: PostHog/meta#200

Project environments

raquelmsmith · 2024-05-08T14:46:01Z

Team Growth

Retro

Retro items

High priority

@raquelmsmith
- Out 1.5 days this sprint
- UI for person profiles addon
- General project management & comms for person profiles addon
- Feature gating for activity panel
  - Migrate customers
- Feature gating for automatic provisioning
  - Migrate customers
@xrdt
- Put tasks into celery
  - Put sync_invoices tasks into celery so we can unlock parallelization and process isolation
  - Now have grafana metrics
- Billing admin improvements
  - Make plans_map json a series of selects so it's less error-prone
  - Find a way to enhance history messages for inlined objects (CustomerToStripeCustomer relation)
- compare_prices improvements
  - Add tests, make sure things like compare prices when we are overriding price_id_overrides works.
@zlwaterfield
- Get teams plan addon shipped
- New Teams Plan in app Billing UI
- Work through changes to subscribe to all products - billing page, pricing page, activation logic, pay gates, etc. - will do next week
- Better loading states for activate/deactivate subscriptions
- Help Frank get Frank Django 3.10 out w/ upgrade to nginx
- (nice to have) Do some cleaning of the billing repo - looking at https://github.com/HackSoftware/Django-Styleguide and trying to make the logic a cleaner and easier to read / debug
  - Has first PR that pulls trust scores out into a service
- (nice to have) Look into email subscription (this seems like an important topic to make sure we're staying compliant - https://posthog.slack.com/archives/C043VJ93L3B/p1713538664642819)

Q2 Goals

✅=finished 🟡=in progress 🔴=won't finish

⚪ Create a flow in product analytics onboarding to fill out a dashboard template using actions (Raquel)
🟡 Simplify our subscription flows (Zach, supported by Raquel)
🟡 Launch pricing changes (Bianca, Raquel)
- 🟡 Personless events - will help us reach more customers at an affordable price
- Data warehouse - it's becoming pretty useful, we should charge for it
- Session replay - we can reduce costs to improve retention and reach more people

This sprint

Only have 3 non-offsite days this sprint!

High priority

@raquelmsmith
- Get automatic provisioning feature gating out
- Personless events pricing UI on posthog.com and pricing tables
@xrdt
- Move remaining bits of sync_invoices to celery
- Finish PRs for updating unsubscription flow with auto-payment of outstanding invoices
- Testing compare_prices
- Billing admin improvements - make plans_map a dropdown of selects, feature_override reason
@zlwaterfield
- Finish the 6 project limit migration
- Migrating all enterprise customers to free teams addon + documenting for CS
- Looking into other revenue edge cases in reporting
- Planning for subscribing to all products next week

robbie-c · 2024-05-08T14:47:34Z

Team Web Analytics

Support hero: n/a

Retro

High priority

🟢 get session property filters in web analytics rolled out and working for all queries on the page (if not finished this sprint)

Low priority

🔴 Rolling out the session property filters for all queries, not just on web analytics
🔴 Ploughing through small feature requests for web analytics

Rolled out web analytics (with Beta tag) to 100%, but I'm not happy with query performance. Based on a hunch, I did a spike of using UUIDv7s (casted to UInt128) for the session id, so far it looks like it's a significant speedup, around 87% on clickhouse cloud, but needs to be tested in a prod-like env. See WIP RFC

Hang over items from previous sprint

deprioritised behind perf work: Rolling out the session property filters for all queries, not just on web analytics

OKR

Make querying fast enough for large customers
Do personless events work where necessary (unknown amount of work)
Iterate on customer feedback
Product management work

High priority

finish this spike on uuidv7s
if it's worth doing
- write the SQL for the new sessions table that uses is
- write and run a proper backfill job
- switch the hogql sessions table over to the new table
- make sure docs / sdks make it clear enough that session_ids should be a UUIDv7
then roll out session properties elsewhere in the app
mop up personless events, TBD(mykonos) what this involves

neilkakkar · 2024-05-08T15:26:09Z

Team Feature Success

Support hero: @neilkakkar
Days off:
Juraj: 5 + 3 days
Neil: 5 + 2 days

Retro

Surveys branching logic - @jurajmajerik - ❌
- Focused on a seamless dev environment before working on branching
- Refactoring survey popup code to make improvements easier
- MDE for experiments
Make sure Phani's onboarding goes well - @neilkakkar ✅
Create dumb feature flags service in rust, write down steps to make it production ready - @neilkakkar ✅ -> Feature Flags Rewrite: List of things to get done #22131
Make repeatedly showing dismissed surveys more ergonomic - Long running surveys don't work well #17863 - @Phanatic 🟡
Link survey security vulnerability - @Phanatic ✅

Hang over items from previous sprint

OKRs

Make sure feature flags can handle 10x current scale
Polish new experiments UI & collect feedback
Add most requested surveys functionality

High priority

Offsite hackathon + wrapup - @jurajmajerik / @neilkakkar
Surveys popup refactor - @jurajmajerik
Make sure Dylan's onboarding goes well - @neilkakkar
Implement the RFC for repeatable surveys - Add RFC for repeatable surveys meta#203 + some small bugs - @Phanatic

Stretch:

Feature Flags Rewrite: List of things to get done #22131 make some progress on rewrite - @neilkakkar

Low priority / side quests / maybe Neil will get to this next year

Temporal queues for feature success - @neilkakkar
Setup instrumentation for flip-flopping problem of experiment significance - @neilkakkar

benjackwhite added the sprint Sprint planning label May 8, 2024

benjackwhite pinned this issue May 8, 2024

Twixes closed this as completed May 29, 2024

Twixes unpinned this issue May 29, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sprint - May 13 to May 24, 2024 #22184

Sprint - May 13 to May 24, 2024 #22184

benjackwhite commented May 8, 2024 •

edited by jamesefhawkins

benjackwhite commented May 8, 2024 •

edited

EDsCODE commented May 8, 2024 •

edited by fuziontech

mariusandra commented May 8, 2024 •

edited by Twixes

raquelmsmith commented May 8, 2024

High priority

robbie-c commented May 8, 2024 •

edited

neilkakkar commented May 8, 2024 •

edited

Sprint - May 13 to May 24, 2024 #22184

Sprint - May 13 to May 24, 2024 #22184

Comments

benjackwhite commented May 8, 2024 • edited by jamesefhawkins

Global Sprint Planning

3 things that might take us down

Team sprint planning

benjackwhite commented May 8, 2024 • edited

Team Benterprise what-the-heck-is-siem Infra

Hang over items from previous sprint

OKR

High priority

EDsCODE commented May 8, 2024 • edited by fuziontech

Team Data Shack

OKR Q2 2024

Objective

Retro

High priority

mariusandra commented May 8, 2024 • edited by Twixes

Team Product your Analytics

Retro

Hang over items from previous sprint

OKR

High priority

Low priority / side quests

raquelmsmith commented May 8, 2024

Team Growth

Retro

High priority

Q2 Goals

This sprint

High priority

robbie-c commented May 8, 2024 • edited

Team Web Analytics

Retro

Hang over items from previous sprint

OKR

High priority

neilkakkar commented May 8, 2024 • edited

Team Feature Success

Retro

Hang over items from previous sprint

OKRs

High priority

Low priority / side quests / maybe Neil will get to this next year

benjackwhite commented May 8, 2024 •

edited by jamesefhawkins

benjackwhite commented May 8, 2024 •

edited

EDsCODE commented May 8, 2024 •

edited by fuziontech

mariusandra commented May 8, 2024 •

edited by Twixes

robbie-c commented May 8, 2024 •

edited

neilkakkar commented May 8, 2024 •

edited