Another sanity test for business people confused by IT. If IT is saying you need to inflict the cost of a 64bit migration of all SharePoint servers NOW, check to see how much RAM designs include. If RAM remains 4GB you can be sure that you IT depart is just parroting something they heard or read and really have no true idea why this is the case.
For 4 GB of RAM or less 32 bit architecture is not only fine its sufficient and perhaps better. The benefit of going 64 bit is that you can expand the RAM, and until you are prepared to get more RAM for servers you have no real reason to go 64 bit.