That's basically it. If you want to be really thorough:
There are some entries in the datastore table that start with vw_
Make sure that the contenttype table doesn't contain vwpage or vwcomment.
Make sure that the package table doesn't contain a vaultwiki or vw entry.
There are also entries in the blocktype, block, cms_widgettype tables with vw in the name.
If you have to remove any of the above manually, change the following setting for a few minutes:
Settings > Options > Server Settings and Optimization Options > Disable Content Caching = Yes.
After visiting a few pages the entries you removed should be cleared from the cache and you can set it back to No.
Rebuild the search index.
Rebuild the activity stream.
Unfortunately, as you noticed, upgrading a version does not re-add the product entries. It just performs any steps between the current version and whatever version is logged in the database. If you had a partially removed product already, you would have to remove the vw_upgradelog table in order to work around that issue. If this table is missing, VaultWiki thinks it has not been installed yet and will recreate all the data.