zlacker

[parent] [thread] 3 comments
1. jbvers+(OP)[view] [source] 2023-11-20 17:11:09
>> Timeouts: for all HTTP Target task handlers the default timeout is 10 minutes, with a maximum of 30 minutes.

Good luck with a long running batch.

replies(1): >>latchk+Q
2. latchk+Q[view] [source] 2023-11-20 17:13:31
>>jbvers+(OP)
If you're going to implement your own queue, you can make it run for however long you want.

Again, I'm getting downvoted. The whole point of my comment isn't about using GCP Tasks, it is about what I would do if I was going to implement my own queue system like the author did.

By the way, that 30 minute limitation can be worked around with checkpoints or breaking up the task into smaller chunks. Something that isn't a bad idea to do anyway. I've seen long running tasks cause all sorts of downstream problems when they fail and then take forever to run again.

replies(1): >>jbvers+Ls
◧◩
3. jbvers+Ls[view] [source] [discussion] 2023-11-20 18:48:16
>>latchk+Q
Well you can't really.. If you're gonna use HTTP and expect a response, you're gonna be in for a fun ride. You'll have to go deal with timeout settings for:

  - http libraries
  - webservers
  - application servers
  - load balancers
  - reverse proxy servers
  - the cloud platform you're running on
  - waf
It might be alright for smaller "tasks", but not for "jobs".
replies(1): >>latchk+Cu
◧◩◪
4. latchk+Cu[view] [source] [discussion] 2023-11-20 18:54:30
>>jbvers+Ls
Have you ever used Cloud Tasks?
[go to top]