Just remember that when you do upgrade your armory your marines will not be able to get ammo from it. Either leave a mess of ammo on the ground around it or build a secondary armory while your primary upgrade. Else you'll have 5 guys milling around the spawn wondering why they can't load up.
Comments
In the menu appears a button to upgrade it.