- 889
- 21 208 733
NVIDIA Developer
Приєднався 29 січ 2009
This channel is a showcase of technologies and demos that are likely to be of interest to NVIDIA Developers - specifically videos that exist to promote graphics, gaming, AI, and compute technologies for developers. Please note that not all videos are sponsored or created by NVIDIA, so we cannot be responsible for the content itself. If you do find content on this channel that is illegal, offensive, or inappropriate, please send us a message and we will take steps to correct the matter.
For access to all the tools and training necessary to successfully build apps on all NVIDIA technology platforms, join our NVIDIA Developer Program.
Thank you!
The NVIDIA Developer Program team
For access to all the tools and training necessary to successfully build apps on all NVIDIA technology platforms, join our NVIDIA Developer Program.
Thank you!
The NVIDIA Developer Program team
Immersive Desert World -- From Idea to 3D Scene in Three Minutes | NVIDIA Research
NVIDIA researchers used NVIDIA Edify, a multimodal architecture for visual generative AI, to build a detailed 3D desert landscape within a few minutes in a live demo at SIGGRAPH’s Real-Time Live event.
During the event - one of the prestigious graphics conference’s top sessions - NVIDIA researchers showed how, with the support of an AI agent, they could build and edit a desert landscape from scratch within five minutes. The live demo highlighted how generative AI can act as an assistant to artists by accelerating ideation and generating custom secondary assets that would otherwise have been sourced from a repository.
Learn more: blogs.nvidia.com/blog/real-time-3d-generative-ai-research-siggraph-2024/
#nvidiaresearch, #nvidia, #siggraph2024, #generativeai
During the event - one of the prestigious graphics conference’s top sessions - NVIDIA researchers showed how, with the support of an AI agent, they could build and edit a desert landscape from scratch within five minutes. The live demo highlighted how generative AI can act as an assistant to artists by accelerating ideation and generating custom secondary assets that would otherwise have been sourced from a repository.
Learn more: blogs.nvidia.com/blog/real-time-3d-generative-ai-research-siggraph-2024/
#nvidiaresearch, #nvidia, #siggraph2024, #generativeai
Переглядів: 2 952
Відео
Introducing fVDB: Deep Learning Framework for Generative Physical AI with Spatial Intelligence
Переглядів 10 тис.День тому
fVDB (Early Access) is a GPU-optimized deep learning framework for sparse, large-scale, high-performance spatial intelligence. It builds NVIDIA accelerated AI operators on top of NanoVDB to enable reality-scale digital twins, neural radiance fields, 3D generative AI, and more. fVDB is the infrastructure for generative physical AI with spatial intelligence. Apply for the fVDB Early Access Progra...
How to Deploy NVIDIA NIM in 5 Minutes
Переглядів 9 тис.День тому
NVIDIA NIM is a set of microservices for deploying AI models. Tap into the latest AI foundation models-like Stable Diffusion, esmfold, and Llama 3-with downloadable NIM microservices for your application deployment. Join Neal Vaidya, developer advocate at NVIDIA, for a demo on how to quickly deploy NVIDIA NIM microservices, locally with Python or programmatically through Docker. This tutorial f...
SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised Distillation
Переглядів 1,1 тис.День тому
Physically-simulated models for human motion can generate high-quality responsive character animations, often in real-time. Natural language serves as a flexible interface for controlling these models, allowing expert and non-expert users to quickly create and edit their animations. Many recent physics-based animation methods, including those that use text interfaces, train control policies usi...
NeuralVDB: High-resolution Sparse Volume Representation using Hierarchical Neural Networks | NVIDIA
Переглядів 2,7 тис.День тому
We introduce NeuralVDB, which improves on an existing industry standard for efficient storage of sparse volumetric data, denoted VDB [Museth 2013], by leveraging recent advancements in machine learning. Our novel hybrid data structure can reduce the memory footprints of VDB volumes by orders of magnitude, while maintaining its flexibility and only incurring small (user-controlled) compression e...
From Microfacets to Participating Media: A Unified Theory of Light Transport w/Stochastic Geometry
Переглядів 1,7 тис.День тому
Stochastic geometry models have enjoyed immense success in graphics for modeling interactions of light with complex phenomena such as participating media, rough surfaces, fibers, and more. Although each of these models operates on the same principle of replacing intricate geometry by a random process and deriving the average light transport across all instances thereof, they are each tailored t...
Walkin’ Robin: Walk on Stars with Robin Boundary Conditions | NVIDIA Research
Переглядів 853День тому
Numerous scientific and engineering applications require solving boundary value problems (BVPs) like the Laplace and Poisson equations on geometrically intricate domains. We describe a unified Monte Carlo approach to solving elliptic BVPs with Dirichlet, Neumann and Robin boundary conditions using the walk on stars algorithm, which unlike conventional numerical methods, does not require any cum...
ConsiStory: Training-Free Consistent Text-to-Image Generation | NVIDIA Research
Переглядів 811День тому
Text-to-image models offer a new level of creative flexibility by allowing users to guide the image generation process through natural language. However, using these models to consistently portray the same subject across diverse prompts remains challenging. Existing approaches fine-tune the model to teach it new words that describe specific user-provided subjects or add image conditioning to th...
A Free-Space Diffraction BSDF | NVIDIA Research
Переглядів 775День тому
Free-space diffractions are an optical phenomenon where light appears to “bend” around the geometric edges and corners of scene objects. In this paper we present an efficient method to simulate such effects. We derive an edge-based formulation of Fraunhofer diffraction, which is well suited to the common (triangular) geometric meshes used in computer graphics. Our method dynamically constructs ...
A Differential Monte Carlo Solver For the Poisson Equation | NVIDIA Research
Переглядів 2,1 тис.День тому
The Poisson equation is an important partial differential equation (PDE) with numerous applications in physics, engineering, and computer graphics. Conventional solutions to the Poisson equation require discretizing the domain or its boundary, which can be very expensive for domains with detailed geometries. To overcome this challenge, a family of grid-free Monte Carlo solutions has recently be...
Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulation | NVIDIA Research
Переглядів 916День тому
The proliferation of 3D representations, from explicit meshes to implicit neural fields and more, motivates the need for simulators agnostic to representation. We present a data-, mesh-, and grid-free solution for elastic simulation for any object in any geometric representation undergoing large, nonlinear deformations. We note that every standard geometric representation can be reduced to an o...
Real-Time Neural Appearance Models | NVIDIA Research
Переглядів 44 тис.День тому
We present a complete system for real-time rendering of scenes with complex appearance previously reserved for offline use. This is achieved with a combination of algorithmic and system level innovations. Our appearance model utilizes learned hierarchical textures that are interpreted using neural decoders, which produce reflectance values and importance-sampled directions. To best utilize the ...
Area ReSTIR: Resampling for Real-Time Defocus and Antialiasing | NVIDIA Research
Переглядів 824День тому
Recent advancements in spatiotemporal reservoir resampling (ReSTIR) leverage sample reuse from neighbors to efficiently evaluate the path integral. Like rasterization, ReSTIR methods implicitly assume a pinhole camera and evaluate the light arriving at a pixel through a single predetermined subpixel location at a time (e.g., the pixel center). This prevents efficient path reuse in and near pixe...
Decorrelating ReSTIR Samplers via MCMC Mutations | NVIDIA Research
Переглядів 589День тому
Monte Carlo rendering algorithms often utilize correlations between pixels to improve efficiency and enhance image quality. For real-time applications in particular, repeated reservoir resampling offers a powerful framework to reuse samples both spatially in an image and temporally across multiple frames. While such techniques achieve equal-error up to 100× faster for real-time direct lighting ...
Modeling Hair Strands with Roving Capsules | NVIDIA Research
Переглядів 567День тому
Modeling Hair Strands with Roving Capsules | NVIDIA Research
Stabler Neo-Hookean Simulation: Absolute Eigenvalue Filtering for Projected Newton | NVIDIA Research
Переглядів 561День тому
Stabler Neo-Hookean Simulation: Absolute Eigenvalue Filtering for Projected Newton | NVIDIA Research
Fluid Control with Laplacian Eigenfunctions | NVIDIA Research
Переглядів 634День тому
Fluid Control with Laplacian Eigenfunctions | NVIDIA Research
Surface-Filling Curve Flows via Implicit Medial Axes | NVIDIA Research
Переглядів 778День тому
Surface-Filling Curve Flows via Implicit Medial Axes | NVIDIA Research
Simulate Elastic Objects in Any Representation with NVIDIA Kaolin Library
Переглядів 1,5 тис.2 дні тому
Simulate Elastic Objects in Any Representation with NVIDIA Kaolin Library
Power Generative AI with Performance-optimized Llama 3.1 NVIDIA NIMs
Переглядів 1,5 тис.2 дні тому
Power Generative AI with Performance-optimized Llama 3.1 NVIDIA NIMs
JETSON AI LAB | Research Group Meeting (7/23/2024)
Переглядів 7092 дні тому
JETSON AI LAB | Research Group Meeting (7/23/2024)
Audio Flamingo: A Model That Understands Audio Beyond Transcriptions | ICML 2024
Переглядів 1,4 тис.14 днів тому
Audio Flamingo: A Model That Understands Audio Beyond Transcriptions | ICML 2024
Diffusion Texture Painting | NVIDIA Research
Переглядів 1,3 тис.14 днів тому
Diffusion Texture Painting | NVIDIA Research
Build Your Live Media Application for AI-Enabled Infrastructure with NVIDIA Holoscan for Media
Переглядів 77621 день тому
Build Your Live Media Application for AI-Enabled Infrastructure with NVIDIA Holoscan for Media
JETSON AI LAB | Research Group Meeting (7/9/2024)
Переглядів 63921 день тому
JETSON AI LAB | Research Group Meeting (7/9/2024)
Getting Started with the NVIDIA Riva Parakeet NIM
Переглядів 1,3 тис.Місяць тому
Getting Started with the NVIDIA Riva Parakeet NIM
JETSON AI LAB | Agent Studio - Multimodal VLM + Function-calling LLM
Переглядів 5 тис.Місяць тому
JETSON AI LAB | Agent Studio - Multimodal VLM Function-calling LLM
JETSON AI LAB | Research Group Meeting (6/25/2024)
Переглядів 738Місяць тому
JETSON AI LAB | Research Group Meeting (6/25/2024)
Getting Started: NVIDIA cuOpt on AWS Marketplace
Переглядів 689Місяць тому
Getting Started: NVIDIA cuOpt on AWS Marketplace
I dont know what this is for but, Awesome!
ъ.Ъ
So this would be used like baking a texture? But for a whole shader? This seems super interesting. Does it depend on a static scene or is it trained "for any lighting"?
I'm really impressed, i want to ask if it is possible to use now?
We need real ms measurements, hardware, resolution, surface area of the frame that's shading with neural shaders. Yes this is supposedly faster, but you also admitted that the original materials can barely run in real time. Seems like this is going to lead to another manufactured deficiency in graphics or performance.
Reminded me of raymarching
Where is the notebook in the description?
Rip, I think it's this article? Build a RAG using a locally hosted NIM
Big step towards generating an object with enough detail to 3d print the objects.. AI modeling leading to functional 3d objects with enough detail to 3d print is a huge goal...
16K textures sounds good. Gaming GPUs will need a LOT MORE VRAM tho.
Nvidias bad vram policy will limit the usage.
we want real machine learning, not these dumbass chatbots LMAO.
Praise Nvidia!
Didn't they write paper about it like... 9 months ago? I am 100% sure I saw all of this and read at least part of that paper.
Nice.
AMD will try to copy it in 3-4 years :P
is there any way we can combine this with blender in future?
I hope the motion capture from video comes fast
Nice, thanks 😁
Where does NVIDIA find these people?
I wonder how this would respond to non-euclidean renderization (although it is very possible that's not how it works and i misunderstood the function of this since most of these concepts are too advanced for me)
No one will feel heavy textures and geometry in fast paced action games, but in, for example, architecture or industrial design they would be much more useful.
The demo is cool, this will be a great speedup for artists to clean up and finalize/customize. And for designers to quickly iterate for scene looks.
Rare Nvidia video with comment section enabled
Well i cant wait for this shit to come out, amd is just gonna be sidelined lmfao,😂
was unreal engine software used??
Nope, this is Nvidia Omniverse
@@StiekemeHenk Nvidia Omniverse Composer
@@StiekemeHenk kk.
3ms to render the hd model at the end? No offense but that's terrible considering you need hundreds of models for an average game scene, and all that needs to fit under 16ms for 60fps
It scales well across an entire scene - ie one model may be 3ms but the entire pipeline is being used - 2 models wouldn't take 6ms. Unreal and Unity scale the same way - a lot has to occur to merely enable any object to be rendered, but the majority of it only has to happen in broad passes that render a great many objects at once.
I can stil distinguish the full data VDB vs Neural one. But this is really an impressive job compared to the other compression methods. Shoutout to Nvidia!
😮 wich software is this ????
Insane
What in the fark!!! 😱 I wish I could work in NVIDIA, even if it's a water boy job or janitor, that too, without any pay just to witness the magical work behind the curtains. 😢
I love how Nvidia is not waiting for the rate limiting step which is the consoles in innovative gaming development further every generation!
i swear nvidia is the only company doing any innovation. other software “developers” are so dim that nvidia has to pick up the entire computation load. At what point do people realize the nvidia processor is the main, central, processor not the other guys. I would buy an nvidia CPU before seeing the specs if one was announced.
amazing work
Is it available for Android now?
No? Of course not. You need high end pc hardware to run these AI models.
Can you guys please release FVDB as open access? Every time Nvidia unveils something new, it's always closed and selective early access. AI Workbench, Neural VDB, MONAI Cloud, and more. For me, my application status is always stuck at 'We have received your application and we will review it shortly.' It never changes. Would be awesome if everyone could get access! Thanks!
pretty sure it's using voxels, which is why nothing is said about topology. makes sense, as most diffusion models work pixel by pixel.
Noice
Wow, very impressive! ^-^
This visual generative combined with the possible new 3D Vision AI technology it would be amazing…
I hope this available for Apple SceneKit one day! 🙏
it does not show how to add the client to the computer. the most important thing!!!
C++_CUDA has good documentation. Many thanks for the ability to use in functions __device__ void foo(){A* obj=new A; }; dynamic memory allocation in this way is very convenient. If NVIDIA engineers gave the ability to access obj from __host__ it would be super
Ho Lee Fuk
Wait a minute! So, if I prompt anything, I'll get a well-retopologized 3D model in a second, just like you demonstrated with the skull? This is game-changing! But do we have a limited set of prompts based on your 3D library, or can we prompt anything we want and get it in 3D, well retopologized?
🥲
Unreal
YIKES
Это нам, игрокам в копутеры, надо-надо. Работайте, братья💪🏻💪🏻💪🏻
YOU are a super TV presenter girl from Nvidia, Thank you very much for showing such an extensive educational video, you are beautiful, you did a good job showing such important news about the physical indicators of new technologies for life introduced by Nvidia into the technology sector of different countries on the planet, Nvidia company is super number one all over the planet in innovations and software code in microelectronics