Yes you can. To do this you must use your IP  from your setup email as the FTP address. Login with your username and password.

Once the domain has propagated you can use ftp.yourdomain.com.