How can I remove index.php/ in my URLs?

In order to get rid of your index.php/ for eZ Publish in yur URLs edit the file settings/override/site.ini.append.php and add the following lines.

[SiteAccessSettings]
ForceVirtualHost=true

In addtion place a proper .htaccess file in the root of your webfolder.