Figure out QA matrix for noble migration

[legoktm]

Description

Because this release is different, the list of scenarios we want to test will be different.

Here's my rough draft so far:

• A fresh 2.12.0 install on noble (prod and virtualized)
• A fresh 2.11.1 install on focal -> upgrade to noble (prod and virtualized)
• A long-running instance on focal -> upgrade to noble (prod)
• A pre-focal long-running instance on focal -> upgrade to noble (prod)

[zenmonkeykstop]

What difference would you expect between a focal and pre-focal long-running instance? The focal update was all fresh installs IIRC, so apart from application backups nothing would have been carried over.

[legoktm]

Just that, something in the application backup. Pre-focal things are the biggest unknown unknowns for me just because I wasn't around for that and can't think of the types of errors that could happen.

So walking through that will be more confidence boosting. Also because we have said instance available, I think calling it out as an explicit scenario we've considered is worthwhile.