Dear Kedar,
I had similar issue and I think you are missing one configuration step.
As far as I can understand, there is an SRM System which you want to connect from Portal.
In the Portal Backend system connection iview you should fill in the SAP WebDispatcher host and port for Web Application Server property.
Hope this would help
Best Regards,
Marek