syed.rakib.al.hasan, I did use XAMPP, because it was so easy to install, and before I saw PaulWhipp's forum post. I've finally got Joomla working on it - after considerable effort (and much help from forums). Here's what worked for me.
I had to modify the php.ini file, and it's best to do that to begin with. You can find it in /opt/lampp/etc. I changed the line
error_reporting = E_ALL | E_STRICT
I also changed the line
error_reporting = E_ALL & ~E_STRICT
display_errors = On
(You have to call your editor from the command line using sudo to modify this file.)
display_errors = Off
Next, with the Joomla web install I ran into some serious errors, so I used the manual install. You can find a very good set of instructions for that at http://help.joomla.org/content/view/1944/302/. Be sure to install it WITHOUT filling in the $ftp_ variables in the configuration.php file (except set $ftp_enable = '0'). I tried using the ftp layer, and ran into innumerable problems. It works without it.
Once you complete the installation and have logged in as admin, choose Help > System Info > Directory Permissions. All the directories will probably show their status in red as Unwritable. At command level using sudo, you will need to change the owner of each of those directories to nobody. E.g.,
making sure you're located in the proper containing directory when you issue the command. After changing them, reload the current page in your browser, and they should now all show the status Writable in green. In the same way, change the owner of the file configuration.php to nobody. It's located in the directory in which you installed Joomla.
sudo chown -v nobody directoryname
Hope that works for you.