Sitefinity Custom Widget – deploying external assembly

We are building a custom widget for Sitefinity. Looking at the options available we have chosen to go with the external MVC assembly approach to reduce dependencies. However, it appears that we still need to reference the custom widget assembly from the Sitefinity project in Visual Studio which would involve copying the assembly over, adding the reference and then redeploying Sitefinity.