possibly you will have to use .htaccess (restrincting access to the file via browser)
and when user clicks on download, read the file with php and force-download it
the link might have to be something like donwload.php?id=2332556
where id corresponds to that file... or maybe download.php?file=test.mp3
its up to you to decide..