do you have code for BERT?

Where can I get some examples of this framework? How do I use it？

Hi! In the original paper implementation they are using dims [1:] : x = x_padded[1:].view_as(x) their code but in your implementation you are using [:-1]: x = x_padded[:-1].view_as(x) your code which produces wrong matrix at the output.

I think I found a bug here in line 94-95, this should be on the outer loop, or you are add too much layers and channels like this

Is the output linear layer parameter of the MultiHeadAttention class incorrectly set in mha.py file? in_features should be heads*d_k?

I'm unable to run the "in_paint.py" script. It is throwing the following error: Could anyone please help me with it? RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 6 but got size 5 for tensor number 1 in the list.

The classifier-free guidance equation of diffusion models here is wrong, which is $$\epsilon_\theta(x_t, c) = s\epsilon_\text{cond}(x_t, c) + (s - 1)\epsilon_\text{cond}(x_t, c_u).$$ However, the correct equation is given in the Imagen paper, Section 2.2, Equation (2), as $$\epsilon_\theta(x_t, c) =...

I don't see it anywhere. Is the code calling it by some external link in the code in this repo somewhere?