Skip to content

feat: Allow customization of CLI docker command that spawns task container #1779

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
palbrecht1 opened this issue Mar 9, 2025 · 0 comments

Comments

@palbrecht1
Copy link

Is your feature request related to a problem? Please describe.

[self-hosted]

My main use case for Trigger.dev is to download large files (5Gb-50Gb) and to perform heavy processing on them automatically. Once they are processed, I want them to stay stored in a local folder that will persist. I don't want to upload them to S3 or anything else. I have 10TB bare-metal servers (100$/mo, lot cheaper than S3) that have trigger.dev installed on them, so the idea is really that it's downloaded once and then I don't have to pay the network / storage cost again.

My only issue right now is I'm not able to bind /my_persistent_data:/anywhere_in_task_docker. I've asked on the Discord community and it seems to be no way around this.

Describe the solution you'd like to see

To allow us to alter the way the task container are spawn, or even better to allow a docker-compose setting to list folders that need to be bound.

Describe alternate solutions

The solutions proposed in the Discord are to setup a localhost S3 server, I spent 3 hours trying to do this and it's far from simple, especially if you want it to fit in a docker-compose. I tried to setup a localhost FTP server until I realised both options wouldn't work anyway as I can't create a docker network between these services and the task container you spawn.

Additional information

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant