Using AI to scan a 3D image

Aug 4, 2022 1:21 PM

DoctorDerk

Views

1988077

Likes

2090

Dislikes

75

Edit: Thanks everyone for the upvotes! I tried giving everyone an upvote as well. A shout out to @TempleOfTolerance for pointing out that its using AI by Nvidia called 'Instant NGP/Nerf'. Hope I got it right. Either that or @IGotsDemGoodies suggests that its LIDAR used in in Apple devices. Take care everyone!

3dscan

digital_art

artificial_intelligence

Well THAT was pretty fucking awesome...

3 years ago | Likes 210 Dislikes 3

Cool

3 years ago | Likes 1 Dislikes 0

3 years ago | Likes 6 Dislikes 1

this is really cool but 99% of what makes this cool is the video editing and not the scanning bit.

3 years ago | Likes 3 Dislikes 0

Duuuuude

3 years ago | Likes 2 Dislikes 1

I tried way too long to get this to loop. Sadly it's beyond my skill ☹️ v

3 years ago | Likes 2 Dislikes 0

3 years ago | Likes 2 Dislikes 0

3 years ago | Likes 4 Dislikes 1

"hey babe, so for this next one you need to be on this bed over here"

3 years ago | Likes 2 Dislikes 1

SUPER FUCKING COOL!

3 years ago | Likes 2 Dislikes 1

It's not AI, but ok. There's a more advanced method today which is Gaussian Splatting.

9 months ago | Likes 1 Dislikes 0

Yeah, listen, can you go to Camera>Video>settings>resolution and change it from 144p to at least 1080p? Thanks.

3 years ago | Likes 2 Dislikes 1

Saucewise from the girl in the video herself: https://twitter.com/karenxcheng/status/1554864997586505729

3 years ago | Likes 1 Dislikes 0

Fully loopsauced from the cameradude himself: https://twitter.com/jperldev/status/1554877869972549633

3 years ago | Likes 1 Dislikes 0

fuck. my mind just glitched.

3 years ago | Likes 2 Dislikes 1

3d modeling with the photo as a texture?

3 years ago | Likes 2 Dislikes 1

The phone does the "modeling" with LIDAR while capturing the textures.

3 years ago | Likes 2 Dislikes 1

Very close, it's photogrammetry. So the photos are combined automatically into a 3D model. You can absolutely do it yourself!

3 years ago | Likes 3 Dislikes 0

Sorcery !

3 years ago | Likes 2 Dislikes 0

Not new, not AI. LIDAR in Apple devices is new-ish, but not strictly necessary to do this.

3 years ago | Likes 6 Dislikes 2

Photogrammetry right? He's building a 3D enviro from the combined photos. Editing seems like the wrong word but its still a neat technique!

3 years ago | Likes 10 Dislikes 0

Similar but not quite the same. Traditional photogrammetry techniques can be tedious & time consuming. InstantNGP takes seconds to train.

3 years ago | Likes 2 Dislikes 2

Did some for a short film recently, only it was of the landscapes we filmed at (using a drone) in case we needed them for CGI.(we did lol)

3 years ago | Likes 2 Dislikes 0

Probably 5 square kilometres at a guess, very cool, not particularly difficult to do either.

3 years ago | Likes 2 Dislikes 0

Is this like related to the technique they used in the first Matrix movie where Neo dodges bullets and all?

3 years ago | Likes 1 Dislikes 0

Not really, buuut you could use the bullet time camera footage from the matrix to generate a 3D model of neo (kinda)

3 years ago | Likes 2 Dislikes 0

You can do photogrammetry with just a phone camera and a bit of software tho! I think you can even do it in blender which is free ^^

3 years ago | Likes 2 Dislikes 0

REALLY curious what the software was for this

3 years ago | Likes 3 Dislikes 0

I was very disappointed when I learnt how Matrix/bullet time was done. This is much closer to what I wanted it to be.

3 years ago | Likes 2 Dislikes 1

What are you talking about? That was an incredible technique.

3 years ago | Likes 1 Dislikes 0

Sure, it was clever and novel. But I'd hoped for something a bit more sci-fi than "interpolate a bunch of cameras".

3 years ago | Likes 1 Dislikes 0

What's the process/ tools used?

3 years ago | Likes 2 Dislikes 0

So we live in the future now, right?

3 years ago | Likes 58 Dislikes 1

?1

3 years ago | Likes 1 Dislikes 0

First part of Back to the Future 2 took place in 2015, so we've been living in the future for a while now.

3 years ago | Likes 3 Dislikes 0

Yeah. Too bad it's "Neuromancer", not Star Trek.

3 years ago | Likes 2 Dislikes 0

3 years ago | Likes 11 Dislikes 0

Always did

3 years ago | Likes 7 Dislikes 0

More like the past. Depending on how you wanna look at it, this tech is 2 to 10 to 20 years old. At least.

3 years ago | Likes 3 Dislikes 1

True, but given into the hands of the public with such ease is certainly a sign of the future.

3 years ago | Likes 1 Dislikes 0

Absolutely. It's been around in phones for the past 5 or 6 years.

3 years ago | Likes 2 Dislikes 0

Earliest relevant paper I know of is "Building Rome in a Day", Agarwal et al., 2011.

3 years ago | Likes 4 Dislikes 0

Is there a source that isn't a 1995-esque potato video? we need pixels.

3 years ago | Likes 3 Dislikes 1

I wonder how that would look if you used an HTC Evo 3D to do the scan.

3 years ago | Likes 2 Dislikes 1

All of this was done with a phone? Sometimes the future is cool.

3 years ago | Likes 3 Dislikes 0

Video recorded on a phone, I bet it was edited/processed on some other more powerful system.

3 years ago | Likes 1 Dislikes 0

Scaniverse. It's pretty fucking rad.

3 years ago | Likes 40 Dislikes 2

The structure from motion and egomotion techniques have come so far since I was in school. This stuff is amazing

3 years ago | Likes 1 Dislikes 0

Oh boo, IOS only!

3 years ago | Likes 20 Dislikes 2

Needs LiDAR

3 years ago | Likes 11 Dislikes 1

He was using a phone, no lidar on those right?

3 years ago | Likes 4 Dislikes 1

it does, kind of https://www.youtube.com/watch?v=A6PAVB39UXw

3 years ago | Likes 2 Dislikes 0

That won’t be datamined for anything unsavory. Nope nope!

3 years ago | Likes 5 Dislikes 0

There's also Polycam, but to use it to its maximum potential, have to pay for the subscription.

3 years ago | Likes 9 Dislikes 0

theres a free scanning tool on android, forget what its called. results will vary based on your phone's sensors

3 years ago | Likes 2 Dislikes 0

And what's it called?

3 years ago | Likes 2 Dislikes 0

live 3d scanner, its a beta app

3 years ago | Likes 3 Dislikes 0

.

3 years ago | Likes 1 Dislikes 0

answered

3 years ago | Likes 2 Dislikes 0

This is made with NVIDIA Nerf. I have a bunch of tutorials on it if anyone is interested. https://www.youtube.com/watch?v=y5K-afDrSwU

3 years ago | Likes 2 Dislikes 0

I was kind of hoping it would turn out really awkward looking and with his face stretched across the mirror but this is neat too.

3 years ago | Likes 416 Dislikes 0

What they said.

3 years ago | Likes 8 Dislikes 0

I'm sure this wont be used for anything nsfw

3 years ago | Likes 122 Dislikes 6

3 years ago | Likes 5 Dislikes 0

3 years ago | Likes 64 Dislikes 0

Mirror porn? oh baby

3 years ago | Likes 8 Dislikes 0

" I hope this will be used for everything nsfw." Fixed.

3 years ago | Likes 6 Dislikes 0

Oh yes, definitely what was I thinking

3 years ago | Likes 1 Dislikes 0

Right?! Like into her vagina, and out her earhole!

3 years ago | Likes 22 Dislikes 2

I'm not sure that's how it works

3 years ago | Likes 7 Dislikes 0

Dont know till ya try!

3 years ago | Likes 4 Dislikes 0

Made me snort. Well done!

3 years ago | Likes 3 Dislikes 0