When you press delete button, is a file actually deleted?

No, A file isn't deleted when you press that delete button. Actually what happens is your OS flips a bit telling that you don’t need this file for now and can be overwritten, if required. You could use several tools to recover deleted files because they are not actually deleted but are ready to be overwritten.