zlacker

https://github.com/lucidrains/imagen-pytorch

>>throwa+(OP)
Is this a joke?

>>Cobras+t8
No

>>throwa+(OP)
Lucidrains is a champ. If theyre on HN, bravo and thanks for all the reference implementations!

>>throwa+Od
To expand a bit for the grandparent, if you check out this authors other repos you'll notice they have a thing for implementing these papers (multiple DALLE-2 implementations for instance). You should expect to see an implementation there pretty quickly I'd guess.

>>w1nk+Bk1
Not to diminish their contribution but implementing the model is only one third of the battle. The rest is building the training dataset and training the model on a big computer.

>>xtreme+gO1
You're not wrong that the dataset and compute are important, and if you browse the author's previous work, you'll see there are datasets available. The reproduction of DALL-E 2 required a dataset of similar size to the one imagen was trained on (see: https://arxiv.org/abs/2111.02114).

The harder part here will be getting access to the compute required, but again, the folks involved in this project have access to lots of resources (they've already trained models of this size). We'll likely see some trained checkpoints as soon as they're done converging.

>>w1nk+Bk1
Thank you. I just saw a GitHub repo, empty except for a citation and a claim that it was an implementation of Imagen, and thought it was perhaps some satirical statement about open source or something. With the context it makes a lot more sense.