zlacker

[parent] [thread] 1 comments
1. ramesh+(OP)[view] [source] 2023-09-12 20:23:08
>What's the best way to use LLama2-70b without existing infrastructure for orchestrating it?

That's an exercise left to the reader for now, and is where your value/moat lies.

replies(1): >>thewat+p3
2. thewat+p3[view] [source] 2023-09-12 20:37:21
>>ramesh+(OP)
> That's an exercise left to the reader for now, and is where your value/moat lies.

Hopefully more on-demand services enter the space. Currently where I am we don't have the resources for any type of self orchestration and our use case is so low/sporadic that we can't simply have a dedicated instance.

Last I saw the current services were rather expensive but I should recheck.

[go to top]