zlacker

[parent] [thread] 3 comments
1. mark24+(OP)[view] [source] 2019-05-27 17:22:51
The Java SDK for SQS automatically drops >256k messages into an S3 bucket and stores a pointer to the message in SQS itself. You set the bucket and the client transparently handles retrieving a message from SQS/S3 when necessary.

Based on the structure of the message (UUIDv4) you could probably roll your own implementation in any language.

replies(1): >>Jemacl+1y
2. Jemacl+1y[view] [source] 2019-05-27 22:54:54
>>mark24+(OP)
That's a good idea, but wouldn't sending and later retrieving millions of S3 objects be expensive?
replies(1): >>maniga+ZD
◧◩
3. maniga+ZD[view] [source] [discussion] 2019-05-28 00:20:49
>>Jemacl+1y
Yes, and slow, if you're actually doing it for millions. The comment was saying the library only does it for messages that are over the size limit though.
replies(1): >>Jemacl+5X
◧◩◪
4. Jemacl+5X[view] [source] [discussion] 2019-05-28 05:15:38
>>maniga+ZD
Gotcha.
[go to top]