Another important aspect to look into before your launch your start-up in a foreign country is the laws and regulations of that country. Some countries require foreigners to get special licenses or permits, depending on the type of business. Other countries don't.
To avoid legal complications down the road, it is a worthwhile investment to hire a lawyer to look into these issues and let you know what you need to start your business without getting into legal trouble.