Frequently Asked Questions

Date of slack thread: 4/9/24

Anonymous: Hey team, was investigating if we could use statsig for ab testing, but there is a use case that doesn’t seem to be supported.

Let’s say that i’m doing a chat apps, where each users can belong to different group chats:

• Group Chat 1
  • User A
  • User B
• Group Chat 2
  • User A
  • User C

I’d like to run an experimentation on message reactions not at the user level, but at the group level. For example here, Group Chat 1 would have the new feature enabled while it’s not for Group Chat 2.

According to the current doc, we can use custom Unit IDs, but while it works great for companies (1 user only belongs to 1 company), it’s not suited for groups (where 1 user can belong to multiple groups).

Do you see a way I could still make this work or it’s not yet possible at the moment?

Vijaye (Statsig): Yes, you can use customIDs (chatID) for this exact same scenario. There is no requirement for the user to belong only to one chat group.

When running experiments with chatID, your unit count will be based on chatID.

cc: @Anonymous to confirm and validate this.