Keep the phone plugged in for 15 minutes and then try to turn it on by pressing POWER & HOME keys together.
Note: This is something which worked in my case. I cannot assure that this could work in all cases.
Here I am describing some technical issues which I faced and how I fixed them. I hope this will be helpful for those who may face the same.