How it’s done now

  1. create an experiment in a system
  2. use the experiment in the code (branch, PR, merge, deploy)
  3. change exposure of experiment
  4. evaluate experiment and finish it
  5. remove changes in code
  6. remove experiment

How I’d like it to be

  1. branch, change code
  2. PR (prefix or better yet set evaluation test)
  3. implicitly experiment created and exposure set to default
  4. automatically gradually expose
  5. show progress in PR
  6. merge/close PR to end the experiment

How it’s done

  1. build cli
    1. get’s the relevent PRs code
    2. creates the conditions and the experiments
  2. experiments system
    1. auto expose
    2. comment on PR

Code -> Code CLI