zlacker

[parent] [thread] 2 comments
1. idopms+(OP)[view] [source] 2023-05-22 19:18:22
> They can't even put a stop to child sexual abuse material on the Internet, which almost nobody wants. How are they ever going to stop AI development then?

They can't stop CSAM because of the tradeoff against privacy, not for technical reasons. AI development requires expensive, specialized hardware. Just not really comparable things.

replies(2): >>Anthon+q3 >>182716+hc
2. Anthon+q3[view] [source] 2023-05-22 19:38:22
>>idopms+(OP)
> AI development requires expensive, specialized hardware.

Does it though? I can run LLaMA on my desktop. Training requires hardware which is more expensive if you want it to run quickly, but it's in the range of tens of thousands of dollars. That's not beyond the means of many individuals, much less organizations. And in a few years it will be hundreds of dollars.

3. 182716+hc[view] [source] 2023-05-22 20:25:35
>>idopms+(OP)
It might not require specialized hardware in the future as GPUs get more powerful and we have other techniques such as LoRA for fine-tuning the models. We might see a distributed training [1] effort harnessing thousands of gamer GPUs worldwide, as well. All of this powered by open source software. Also there could be advances in the training software making it vastly more efficient.

1. https://arxiv.org/pdf/2301.11913.pdf

[go to top]