shortening a url

[peter_brickles]

HI Guys im harvesting urls from google for a project

and get the following results

http://www.proconnectmarketing.co.uk...lSf6AoR0PaV87Q
http://www.firstimpression.comDEFfin...p7_4f-GM5qJI7g
http://www.firstimpression.comDEFfin..._bEP_cn0VEE9bA
http://www.iabuk.net/blogDEFtaking-t..._Dcxrgnob0cIGw

what i want to get to is

proconnectmarketing.co.uk
firstimpression.com
firstimpression.com
iabuk.net

is there any easy way to accomplish this with sed grep awk or any other cli tools ?

Cheers Pete

[Lars Noodén]

Maybe something like this:

echo "http://www.iabuk.net/blog" | sed -e 's#^.*://##; s#/.*$##'

Normally it is s/// but using the pound (#) instead makes it easier (IMHO) to search for and remove the slashes (/)

[peter_brickles]

thanks Lars that works partially but if i get a domain with a co.uk (should have included one in my example with hindsight) it doesnt catch all any ideas ?

[Lars Noodén]

It catches all the ones that I can think to try. Can you post the one that gives sed trouble for you?

[bluefrog]

sed 's-http://\(.*\)/.*-\1-'