r/StableDiffusion 13h ago

Meme So relaxing, first NVIDIA DLSS 5 Neural Rendering test ( t2v)

Enable HLS to view with audio, or disable this notification

integrated_multimodal_description: [Shot 1] Live-action television sitcom style inside Penny’s warmly lit bedroom in her apartment from The Big Bang Theory. A medium-wide shot frames Deadpool lying comfortably on top of the bed in his recognizable red-and-black masked tactical suit, his head resting against the pillows. Penny, played by Kaley Cuoco, sits beside him on the edge of the bed, wearing casual sleepwear. She looks down at Deadpool with an affectionate, slightly amused smile and gently pats his upper chest in a slow, comforting rhythm. The camera pushes in with small amplitude at slow speed as Penny, a young woman with a soft, warm, clear singing voice (S1), sings gently to him: [English] Soft kitty,
Warm kitty,
Little ball of fur.

Happy kitty,
Sleepy kitty,
Purr Purr Purr

Soft kitty,
Warm kitty,
Little ball of fur.

Happy kitty,
Sleepy kitty,
Purr Purr Purr Deadpool remains completely still and listens contentedly, his masked white eye shapes slowly narrowing as though he is becoming sleepy. Penny continues patting his chest in time with the song. As she finishes the final “Purr Purr Purr,” Deadpool gives a relaxed sigh and snuggles deeper into the pillows while Penny smiles down at him. The camera holds on the tenderly absurd bedside moment.

overall_soundscape: Quiet bedroom room tone continues beneath Penny’s singing, accompanied by subtle bedsheet movement, gentle fabric taps against Deadpool’s suit, and his soft relaxed breathing. A faint studio-audience chuckle follows the sight of Deadpool settling sleepily into the pillows.

non_diegetic_music: N/A

https://github.com/lisitskyaa/ComfyUI-DLSS5-NR?fbclid=IwY2xjawUD0lBwZG9mBWV4dG4DYWVtAjEwAGJyaWQRMVM3cUpUUUhaaGZQNmlLZ25zcnRjBmFwcF9pZBAyMjIwMzkxNzg4MjAwODkyAAEeHHM88fwGf57GgXYuPBn_q2TksCGxbf3DFDJhKpn4ZMAR9toPQAJ0GOpaL8g_aem_ZmFrZWR1bW15MTZieXRlcw

0 Upvotes

26 comments sorted by

8

u/Sleepy_Bandit 13h ago

So how exactly are you using it? To upscale? To provide details? To do the actual rendering?

1

u/Sad_Coach_1433 13h ago

It's before upscaling suppose to give upscaling better image to go by

1

u/OkMeat6773 13h ago

how long does it take? and which hardware are you running it on? can you show us a brief comparison before/after? ty

1

u/Sad_Coach_1433 13h ago

https://reddit.com/link/p77akqa/video/6pgdrw0omxmh1/player

i'm on a 5060 ti 16gig 32 system ram the dlss 5 node step took about 90secs this is same prompt no dlss 5 just rtx vsr pro upscale

2

u/giantcandy2001 12h ago

Facial ghosting is worse in your final render.

1

u/OkMeat6773 13h ago edited 13h ago

Ah, okay... sorry. In the video you shared, this is before DLSS 5?

2

u/Sad_Coach_1433 13h ago

First clip is with dlss 5 this one is without

2

u/Sad_Coach_1433 13h ago

Don't even know if it make much of a difference with it tbh 🤔

1

u/robomar_ai_art 13h ago

Try do it with lower resolution like upscale 960×544 to ful HD, then we can see better. 90sec is quick

1

u/Sad_Coach_1433 13h ago

I gen the video at 540p then upscaled by 3x

1

u/MomentJolly3535 13h ago

any nvidia RTX or 50x only ?

3

u/Slapper42069 12h ago

2070s with modified dll, 0.7 seconds per pic at 1920x1080

1

u/MomentJolly3535 12h ago

interesting, can you give us the link of the modified dll ?

1

u/Slapper42069 12h ago

I found the info about discord server providing it on a nexusmod page for dlss5 mod for stellar blade(?) if i remember correctly

1

u/Sad_Coach_1433 13h ago

any 50 series gpu

1

u/Sad_Coach_1433 13h ago

might work on 40 series i dont know i have 5060 ti

1

u/Sad_Coach_1433 13h ago

If you going to be able to do Dlss5 on 40 series then don't see why wouldn't work this is all experimental node at the moment because five is not officially out yet the dlss 5 dll file was leaked it was found in NBA 2k 27.

1

u/ANR2ME 4h ago

Does DLSS5 only available on Windows? 🤔

1

u/cc_aa_tt_zz 12h ago

Applying DLSS 5 to realistic video is completely pointless; you can achieve the same result simply by tweaking the contrast and brightness settings yourself. DLSS 5 might be slightly useful for 3D-rendered videos (like animated films), but it is truly useful when integrated into a 3D engine.

3

u/legarth 12h ago

You're only kind of right, and not for the reason you mention. The reason why DLSS works in 3D engines is not because the content "looks" 3d. It is because it uses motion vectors supplied by the engine to better understand the scene.

But even so it DLSS can work with pixel data only. It just isn't very noticeable because it is runing in real time and thus is limited by compute.

However an AI model could be trained to output motion vectors as awll and that could potentially make it more useful.... although in the grand scheme of things there are better ways.

1

u/cc_aa_tt_zz 12h ago

I know, I said it is slightly useful for 3d-rendered videos, BUT it is truly useful when integrated into a 3D engine. And even with motion vectors, a realistic mask applied on a realistic video is ... totally useless lol Once again, it could be (very) slightly usefull for 3d-rendered video (I personnally tested it on Shrek movies with my own custom "dlss5 player").

1

u/Royal_Carpenter_1338 12h ago

personally i think it will be on photorealistic images from models like krea 2, it tends to make flat skin and shadows, no clue though havent tested yet, but i do think you are right it is literally trained for games with polygons and weird edges

1

u/KurtMod 11h ago

Bien joué pour l'intégration rapide !

-1

u/TheAncientMillenial 12h ago

Windows only, meh.