In some cases you may remove a package without errors in your Visual Studio solution but after deployment you find errors like the following.
Could not load file or assembly 'episerver.cms.addons.blocks' or one of its dependencies. The system cannot find the file specified.
You may also find derelict packages in /modules/_protected or /bin folders.
See below for required steps when removing Episerver packages and deploying.
Use the Remove additional files at destination option found in the Visual Studio deployment wizard. It can be seen when you click the File Publish Options drop down in the following screenshot. Before doing this see step 5 of this article for additional required configuration changes.
For accomplishing this in VSTS see this blog post.