65 points by t55 18 hours ago | 4 comments
macawfish 11 hours ago
Wow.

I can't wait to see ideas from the diffusion image generation world (like controlnet) work their way into language models.

soulofmischief 9 hours ago
I've built diffusion based text models, it's old hat and not necessarily the most performant way to generate text. However it does produce interesting results and I'd love to test some ideas at scale.
joejoo 10 hours ago
There’s already a few models that are diffusion based.
notrealyme123 15 hours ago
This was posted here already a few weeks ago.
gitroom 8 hours ago
Yeah I always end up lost in papers like this too, even with my CS degree, the research keeps leveling up nonstop.
holoduke 15 hours ago
Whenever I try to read and understand this paper, I feel extremely dumb. I have my degree in CS, but this is just too complex for me to understand.
evertedsphere 14 hours ago
an undergraduate degree in a field is not enough to understand recent research in a specialised subfield of a subfield and you shouldn't beat yourself up over that

there's nothing wrong with you, you just need the right background and you can go get that. see e.g. the fast.ai course

smrtinsert 8 hours ago
Do you mean the fast.ai stable diffusion lectures? The initial series doesn't get too deep at all from what I remember.
tippytippytango 6 hours ago
I wouldn’t beat yourself up over it. Very few papers can be understood without reading a significant amount of the neighboring literature and the history of how that work came to be. There are norms and customs and a kind of academic language in every community that you won’t be able to see unless you’ve read a lot from that community. Even if you have the right math level it’s tricky.

A single paper is part of a conversation, not something that stands alone. Trying to read one random paper is like finding a 1000 page thread on an obscure topic that has been running for 10+ years and reading only the last page. It won’t make any sense without reading back a ways.

AlexCoventry 15 hours ago
Ask ChatGPT o3 about anything you don't understand, ask it about anything in its responses you don't understand. Keep drilling down until you do understand. Takes patience, but you can learn a lot very fast, this way.
echelon 9 hours ago
ChatGPT o3 understands the latest literature and isn't going to hallucinate weird details or make incorrect analogies or math?

I'd worry about learning the wrong things.

Ey7NFZ3P0nzAe 6 hours ago
I disagree. It's all about rephrasing information that is in the paper. Possinly a few other papers too.
vessenes 6 hours ago
o3 with a pdf or in deep research mode is excellent. Especially if you’re disciplined about staying to what’s research. But really, it’s excellent, better than benchmarks indicate, I’d say.
IncreasePosts 11 hours ago
Might want to study some stats or other math.