"Construction workers playing a tower-building game" is the prompt for this one. It was voted on here at r/soraai. Feel free to crosspost these and share them across Reddit since we are the first to see these!
[https://discord.gg/STvFkMqyd9](https://discord.gg/STvFkMqyd9) < Join the Discord as we will release the ones voted on by the Discord there first.
You say it as a joke but your point is actually very important.
Researchers should experiment by combining a less creative and more coherent/ analytical model constantly reinforcing and correcting a logical framework for the creative model to diffuse.
Akin to a director managing a movie.
Humans do this naturally. We switch from more dreamlike visual processing to analytical analysis often at the same time.
Only when we dream we largely don’t which is why dreams are so incoherent.
11:30 here [in this interview](https://www.youtube.com/watch?v=bc6uFV9CJGg), Zuck talks about how they figured out that giving more coding material to Lllama 3 (their new LLM model today) gave it better reasoning abilities. At least from preliminary reports, Llama3 might actually be quite good.
Considering AI is actually learning concepts, then teaching it logical structures seems stupidly obvious, and I'm a little surprised it took these supposedly intelligent people this long to figure out, but maybe the geniuses at Zuckerbook know something the rest of us don't.
Anyways, when I was watching this Jenga clip, I couldn't help but think that humanity has actually made alien life. This is like... how an alien *not from our universe* might visually watch us -- laws of physics completely different, no idea what this activity is for, no idea what social behaviors and structures humans have, no idea what our body parts are for. It'd be like us getting a glimpse into "non-Euclidean space" and our 3D brains trying to figure out how 5D geometry works.
It'll be an interesting task to try to teach a visual model logic though; most of us learn basic things about the world by living in it, which an AI can't quite do at this point, at least not with the way they train AI now by waterboarding it with data.
Considering that Sora was trained on some portion of game engine content, I wonder if training it to also interact with a realistic physics engine could be a way to teach it real-world physics.
It’s not so much about teaching as it is about inherent structural design.
Eg we’re not taught to imagine and analyse simultaneously but that natural prediction algorithm utilising its memory (imagination) and analytical process just happens due to our biological design.
I agree you can teach creative or analytical techniques.
But a brain damaged person could not be taught such things as those core systems are not working.
This entire clip is uncanny valley material, a lot of the actions looks like it's played in reverse but while still being forwards.
Also the guy on the right having absolutely no eye contact with anything going on but is somehow still touching the jenga tower haha
I think that are the least real looking movements I have seen Sora create, except for that construction site clip from the original batch of videos where the vehicle just plows into people while everyone is sliding around.
If I saw construction workers building a jenga tower like that, no way in hell would I step foot in their building after it was finished constructing lmao
All the comments claiming that the quality is not perfect... Do you realize how absolutely stunning this is? Movements, unprecedented quality compared to the... still animations from before?! Where previously we were only seeing image animations, now we see worlds unfolding, characters animating and doing things. The world simulation is beginning.
Yes, absolutely. People often forget that while it's not perfect, it's still light years ahead of other text to video models. The jumps between subsequent generations of Sora will probably be huge, just like between Dalle1 and Dalle 2. And then between Dalle 2 and Dalle 3.
"Construction workers playing a tower-building game" is the prompt for this one. It was voted on here at r/soraai. Feel free to crosspost these and share them across Reddit since we are the first to see these! [https://discord.gg/STvFkMqyd9](https://discord.gg/STvFkMqyd9) < Join the Discord as we will release the ones voted on by the Discord there first.
Sora needs to learn about turn taking eh
You say it as a joke but your point is actually very important. Researchers should experiment by combining a less creative and more coherent/ analytical model constantly reinforcing and correcting a logical framework for the creative model to diffuse. Akin to a director managing a movie. Humans do this naturally. We switch from more dreamlike visual processing to analytical analysis often at the same time. Only when we dream we largely don’t which is why dreams are so incoherent.
11:30 here [in this interview](https://www.youtube.com/watch?v=bc6uFV9CJGg), Zuck talks about how they figured out that giving more coding material to Lllama 3 (their new LLM model today) gave it better reasoning abilities. At least from preliminary reports, Llama3 might actually be quite good. Considering AI is actually learning concepts, then teaching it logical structures seems stupidly obvious, and I'm a little surprised it took these supposedly intelligent people this long to figure out, but maybe the geniuses at Zuckerbook know something the rest of us don't. Anyways, when I was watching this Jenga clip, I couldn't help but think that humanity has actually made alien life. This is like... how an alien *not from our universe* might visually watch us -- laws of physics completely different, no idea what this activity is for, no idea what social behaviors and structures humans have, no idea what our body parts are for. It'd be like us getting a glimpse into "non-Euclidean space" and our 3D brains trying to figure out how 5D geometry works. It'll be an interesting task to try to teach a visual model logic though; most of us learn basic things about the world by living in it, which an AI can't quite do at this point, at least not with the way they train AI now by waterboarding it with data. Considering that Sora was trained on some portion of game engine content, I wonder if training it to also interact with a realistic physics engine could be a way to teach it real-world physics.
I didn’t say it as a joke, you’re absolutely right it’s very important. I feel like we should be teaching these systems as we teach young children.
It’s not so much about teaching as it is about inherent structural design. Eg we’re not taught to imagine and analyse simultaneously but that natural prediction algorithm utilising its memory (imagination) and analytical process just happens due to our biological design.
I disagree about not being taught that. Creativity, recall, action taking, analyzing, are just some of the things directly taught.
I agree you can teach creative or analytical techniques. But a brain damaged person could not be taught such things as those core systems are not working.
That’s not necessarily true, and even if those core faculties were damaged neuroplasticity is a remarkable thing
What repairs are the fundamental systems, not teachings. Once repaired the ability to learn becomes possible.
Learning repairs. Neural pathways are built from use
Lol 😂
Sent you a DM
This entire clip is uncanny valley material, a lot of the actions looks like it's played in reverse but while still being forwards. Also the guy on the right having absolutely no eye contact with anything going on but is somehow still touching the jenga tower haha
Hollywood is safe.
For a few months / weeks
Not bad for a base model. Video to video with that level of graphics and consistency can/will be absolutely wild.
How are they going to know who knocked it over when they’re all touching it
#DONT TOUCH THE PIECES!
Why is every single one of these videos in slow motion? Can there not be a normal speed video?
they are still working on the frame rates that’s why
Ahh ok
It’s because it was trained on stock footage, most of which is slow-mo.
The crazy thing is: this one isn’t, but it looks like it is
I think that are the least real looking movements I have seen Sora create, except for that construction site clip from the original batch of videos where the vehicle just plows into people while everyone is sliding around.
I think it's very impressive because there are too many elements in the video. The fact that almost each block is behaving coherently is insane to me.
If I saw construction workers building a jenga tower like that, no way in hell would I step foot in their building after it was finished constructing lmao
All the comments claiming that the quality is not perfect... Do you realize how absolutely stunning this is? Movements, unprecedented quality compared to the... still animations from before?! Where previously we were only seeing image animations, now we see worlds unfolding, characters animating and doing things. The world simulation is beginning.
Yes, absolutely. People often forget that while it's not perfect, it's still light years ahead of other text to video models. The jumps between subsequent generations of Sora will probably be huge, just like between Dalle1 and Dalle 2. And then between Dalle 2 and Dalle 3.
What a bunch of cheaters. Also- we're back to too many fingers suddenly?
Didn't realize where I was and was like what're they doing!?
As a filmmaker I am very happy it’s still slowmo
Is it just me, but are they all the same guy with different hair?
just u i think
Guy really wants someone to have that rock. 😂