Rain On Me by Lady Gaga & Ariana Grande AI Upscaled and Frame Interpolated to 4K 144fps (dropped to 60fps on YouTube)


Each of these videos took me about a whole day just to "make" :\
Hope you enjoy the effort I put in and enjoy the result as much as I do!

* All Ari 4K 60fps Playlist *
[ Ссылка ]

* 4K + 4K 144fps ProRes Source Download *
[ Ссылка ]

* Official Video *
[ Ссылка ]


* AI Models Used *
- Artemis HQ v11 (in Video Enhance AI)
- RIFE 2.4 (in Flowframes)

* About Artemis (HQ/MQ) *
The Artemis (HQ/MQ) model removes "artefacts" like film grain, sharpens blurred or out of focus objects, adds detail to the existing image where possible. It can only improve so much to low-quality parts of the videos or where there is a lot of film grain, it also can not perfectly remove film grain.

* About RIFE *
The RIFE (Real-Time Intermediate Flow Estimation) model generates new in-between frames by comparing the previous and next frames to create the estimated flow of movement, it can generate very smooth and very clear frames. It fails and creates very large artefacts on "aggressive" fade to black or lighting changes such as flashes, it cannot detect scene changes very well ("perfectly"), and also fails on fast-moving patterns where a pattern moves to a point where it matches or is closest to the 'next' frame.

* Encoding Info *
The video was re-encoded and compressed as few times "as possible" until the final encode to provide the best result. The final 4K 144fps version was encoded into ProRes Proxy which causes some very small "blocky" artefacts but it is worth it for the size and performance of the video.

* Notes *
I used TransitionChooser, a tool that allows for manual scene change picking so that I could (as best as humanly possible) have the most correct scene changes as possible so that there was little to no merging of scenes and I also used it to hide artefacts (mentioned above in RIFE) swapping them for blended frames instead.
I also use FFmpeg for any re-encoding required that wasn't done by the other tools automatically.
- - - - -
If you see dropped frames or "skips" in the video try opening the URL in 'mpv' instead, that solved it for me.

* Software Links *
Video Enhance AI (Artemis HQ/MQ) [Paid]: [ Ссылка ]
Flowframes (RIFE): [ Ссылка ]
TransitionChooser (for RIFE): [ Ссылка ]
FFmpeg (Encoding): [ Ссылка ]
RIFE CLI (Dev): [ Ссылка ]


If you would like to see something in particular in the future let me know, take care!
- Fadexz

#ArianaGrande #RainOnMe #4K60 #4KUpscale #FrameInterpolation

свернуть