You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
[self-hosted]
My main use case for Trigger.dev is to download large files (5Gb-50Gb) and to perform heavy processing on them automatically. Once they are processed, I want them to stay stored in a local folder that will persist. I don't want to upload them to S3 or anything else. I have 10TB bare-metal servers (100$/mo, lot cheaper than S3) that have trigger.dev installed on them, so the idea is really that it's downloaded once and then I don't have to pay the network / storage cost again.
My only issue right now is I'm not able to bind /my_persistent_data:/anywhere_in_task_docker. I've asked on the Discord community and it seems to be no way around this.
Describe the solution you'd like to see
To allow us to alter the way the task container are spawn, or even better to allow a docker-compose setting to list folders that need to be bound.
Describe alternate solutions
The solutions proposed in the Discord are to setup a localhost S3 server, I spent 3 hours trying to do this and it's far from simple, especially if you want it to fit in a docker-compose. I tried to setup a localhost FTP server until I realised both options wouldn't work anyway as I can't create a docker network between these services and the task container you spawn.
Additional information
No response
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
[self-hosted]
My main use case for Trigger.dev is to download large files (5Gb-50Gb) and to perform heavy processing on them automatically. Once they are processed, I want them to stay stored in a local folder that will persist. I don't want to upload them to S3 or anything else. I have 10TB bare-metal servers (100$/mo, lot cheaper than S3) that have trigger.dev installed on them, so the idea is really that it's downloaded once and then I don't have to pay the network / storage cost again.
My only issue right now is I'm not able to bind /my_persistent_data:/anywhere_in_task_docker. I've asked on the Discord community and it seems to be no way around this.
Describe the solution you'd like to see
To allow us to alter the way the task container are spawn, or even better to allow a docker-compose setting to list folders that need to be bound.
Describe alternate solutions
The solutions proposed in the Discord are to setup a localhost S3 server, I spent 3 hours trying to do this and it's far from simple, especially if you want it to fit in a docker-compose. I tried to setup a localhost FTP server until I realised both options wouldn't work anyway as I can't create a docker network between these services and the task container you spawn.
Additional information
No response
The text was updated successfully, but these errors were encountered: