This is the kind of stuff that would really make sense in VR, it would be so much easier to clean a model this way.
@stephanelegendre7624
11 ай бұрын
I had that exact problem and you solved it in a very creative and smart way. You deserves way more subs! Calm relaxing voice + great tips, love it.
@estrangeiroemtodaparte
11 ай бұрын
I have a feeling I will be visiting this video many times. Thank you, sir!
@IXNXMXI
7 ай бұрын
Thank you for this tutorial, it is really very practical, greetings from Colombia
@DejayClayton
11 ай бұрын
Here's a method for automating Gaussian Splitting cleanup. Generate a 3D grid of evenly-spaced coordinates to be used as vantage inspection points. Visit each inspection point, and from that point, look 360 degrees in each axis, looking outwards. Note which splats are visible from the vantage point, based on how many pixels the splat contributes to any rendered view. After collecting metrics from each inspection point, notice which splats contribute minimally when measured across all inspection points. Then, either remove those splats, or push them backwards away from whichever vantage point saw those splats most visibly, in case those splats contribute to background texture in a way that was just calculated from the wrong depth. Repeat this entire process multiple times until all superfluous splats are processed or removed.
@AlexTuduran
11 ай бұрын
Great video Olli, as usual. One mention though: That's not a Unity plugin, it's a Unity project in which the dev made the tooling for creating, editing and viewing the splats. You could say it's a framework component for working with splats. Keep these videos comming, it's great to see progress on the matter.
@OlliHuttunen78
11 ай бұрын
That’s a good point.
@tobiasdierl4557
5 ай бұрын
Great Video! One sidenote, there is another open source programm called CloudCompare that you can use to trim your gaussian splats, but i have to admit you don´t have a gaussan splat live preview while working in the programm. You see a Pointcloud. One major advantage of the programm is the fact that you can generate a mesh that gets aproximated from the pointcloud. You could use that Mesh as a collision Mesh in a game Engine, etc. And one drawback is the fact that you have to convert your original .py file into a .py file format that is compatible with CloudCompare via the command prompt and when your finished change it back to the original .py file format. (So it can be importet into UE5 for example) Just wanted to point that out. I will try the unity Plugin presented here next because i think it is more user friendly ;) Keep it up!
@OlliHuttunen78
5 ай бұрын
Ok. Thanks. I’m collecting all these different programs that can be used around Gaussian Splatting. I’ll check this CloudCompare. Sounds interesting.
@alpaykasal2902
11 ай бұрын
Great video Olli. Thanks. I did go through this last week (using your c4d living room render actually) and I found that I could never get the walls or cieling (for example) as clean as i want because, once artifacts are removed, then the previously solid/clear surfaces become patchy. Dark camouflage-like pattern throughout. It made me wish for a 'rebuild' tool which closes up some of the damage created by cleaning all the extra floaters. This can be seen in this video at 9:08 . I know you don't have an answer to that :) but it's good to know we're al facing the same issue. Thanks for all your work Olli!
@Olstman
4 ай бұрын
Great! Thank you for tutorial! Are there any filtering methods? Obviously, each splat has X and Y coordinate, perhaps there is a filter that finds the most stretched on one axis or two axes splats and selects them. As a rule, they are the ones that clog the whole view. As a Guru in Gaussian Splatting topic, perhaps you have heard sometigng of such tools?
@andrejdantzler
11 ай бұрын
Great and clear video. Thank you!!
@daviddoudouable
10 ай бұрын
Nice ❤❤❤❤ It would have been fantastic to see at the end a side by side comparison of the quality of the walls after and before cleaning the gs 😊 the blurs are removed but it should affect too the quality of the global rendering, isn't it? ❤
@indibarsarkar3936
11 ай бұрын
Great video!! 😃 Maybe try opening the PLY file in a text editor to see how the splats are represented :)
@Atlas_Redux
11 ай бұрын
You can remove most floaters automatically now with 3dgsconverter
@RiccaDiego
6 ай бұрын
Mazing tutorial! But when I try to import the gaussian splat on the tools menu, there is an error that I can't find anywhere on internet: "output folder must be within project, was "C:/User...". Don't matter wat I do, this error keeps comming. I'm using the 2022.3.21f1 version of Unity.
@orxion
Ай бұрын
perfect, thx .. can you also compress the final file? also my main problem is to place the "object" to the middle ..
@JB-fh1bb
11 ай бұрын
I’m *shocked* there are no AI tools for this type of work. If we naively assume that walls, floor, and ceiling are flat surfaces at right angles to each other, then we add understanding of doors, picture frames, stairs, etc we could do a two-pass process where structure is first identified then points within them kept as everything in open air is eliminated.
@arjuneswarrajendran
10 ай бұрын
Can you share the scanning workflow for the apartment? how did you mange to scan the entire aprtment including roof with minimal artifact, and also about the pattern of your orbit to capture. Thank you
@hgatmit
7 ай бұрын
great tutorial. I haven't tried yet, but it appears that in v0.8.0 you can subtract from selection by pressing CTRL key
@OlliHuttunen78
7 ай бұрын
Yes. Developer fixed it pretty soon after this video. Which is great. I recommend also test the Super splat service in web. It is very versatile tool for cleaning Gaussiann models.
@hgatmit
7 ай бұрын
@OlliHuttunen78 I'v been trying the supersplat after your good review of top editing tools, but as I recall supersplat don't save the spherical harmonics back in the ply/splat. I also noticed a lower fidelity in the models that were previously saved after a "clean-up", so this is why I'm trying the Unity plugin..
@OlliHuttunen78
7 ай бұрын
Well. Now the Spherical Harmonic data issue is fixed on super splat. In Unity I opened and used the project file which comes with the code. In there the selection tool button is visible.
@RobertWildling
11 ай бұрын
Wonderful! I am really happy to have found your channel! - Question: Isn' there also an Unreal editing tool? I think it is not free, though...
@OlliHuttunen78
11 ай бұрын
In fact, Luma AI has just released a version update of their plugin for Unreal. it's free and very fast to render Gaussian splat models.
@RobertWildling
11 ай бұрын
@@OlliHuttunen78 But is it possible to EDIT gaussian splatting with that plugin? Would love to see you do a video on that 🙂
@OlliHuttunen78
11 ай бұрын
It seems that it has only the cutouts tools and you cannot delete individual splats like in this Unity tool. Perhaps I will make a video about it.
@Atlas_Redux
11 ай бұрын
@@OlliHuttunen78 You can't edit in Unreal Engine or Unity itself, but you can use Super-Splat which with SH (spherical harmonic data) enabled output to standardized 3DGS PLY which can be used in UE and Unity with all plugins. Or you can use CloudCompare with 3dgsconverter. You can also try using 3dgsconverter on your incompatible PLYs, as despite it is supposed to be made only to work with CloudCompare and back again, it worked with Super-Splat before it had its own compatibility.
@CameronCrichtonVFXArtist
10 ай бұрын
Unity 2023.1.20f1 does not have the selection tool available.
@topa3d
15 күн бұрын
you can just click the EDIT button on the Inspector while Gaussian Splats Hierarchy item is selected. The edit button activates the selector (but doesn't give you the selector icon as shown in the video)
@jag24x
11 ай бұрын
This is brilliant! Thanks for sharing! Can you reload this back into sibr viewer? Also have you done any rendering in Unity with a camera path?
@OlliHuttunen78
11 ай бұрын
Yes it can be reloaded into Sibr. Just check my previous video about that. There is a one config file trick that need to be done before sibr viewer will open the ply file. I haven’t done any video rendering in Unity but I’m sure it can be done.
@bharath2788
4 ай бұрын
Hi Olli thanks for the video! i'm using 2022.3.7. I can't see the selection tool. Is there something I'm missing?
@ramonbroadcast
Ай бұрын
I can't either in 2022.3.44 !
@topa3d
15 күн бұрын
@@ramonbroadcast you can just click the EDIT button on the Inspector while Gaussian Splats Hierarchy item is selected. The edit button activates the selector (but doesn't give you the selector icon as shown in the video)
@topa3d
15 күн бұрын
you can just click the EDIT button on the Inspector while Gaussian Splats Hierarchy item is selected. The edit button activates the selector (but doesn't give you the selector icon as shown in the video)
@bryanalban7868
2 ай бұрын
i cant see the Scene GaussiansSplatts after the Export. I dont know what is the misstake =(
@mrlopre
7 ай бұрын
thank you
@CyrilPreiss0
11 ай бұрын
Very interesting ! any way to upload the modified ply to Luma ai ?
@modme1market
10 ай бұрын
Hi, thank you so much for your tutorial. I'm getting an error when importing the PLY from LUMA that says: PLY vertex size mismatch, expected 248 but the file has 27. Thi sis happening with all of them. Not sure what to do from here.
@modme1market
10 ай бұрын
All fixed now. luma changed the layout
@alvydasjokubauskas2587
9 ай бұрын
Me too still getting same errors, maybe I should reupload the file once again?
@PeeP_Gainz_DEV
11 ай бұрын
what about flexicubes from Nvidia?
@aaronjaggars321
6 ай бұрын
Is there an unreal engine 5 version
@OlliHuttunen78
6 ай бұрын
Yes. There is at least 4 different Gaussian Splatting plugins for Unreal 5, but none of them has this neat selection tool to clean artifacts. But most of them has cut out boxes. Check my other videos where I go through them. For example this one: kzitem.info/news/bejne/mqaNsaKvsGllf44si=sW7o7NF_2BAQo3fD
@randfur
11 ай бұрын
Very sad that the interfaces are so unsuitable for common uses.
@chiliu9967
7 ай бұрын
yeah I found it really look good in Unity but can't be exported as obj or add interaction to it like normal objects in unity.. can it?
@greenstonegecko
4 ай бұрын
this is the worst that this software will ever be. It will only get better from here
Пікірлер: 48