-
Notifications
You must be signed in to change notification settings - Fork 20
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Vsov plugin how to use? #47
Comments
Hello. If you would like to use RIFE for motion interpolation, a snippet could be import vapoursynth as vs
from vapoursynth import core
import vsmlrt
from vsmlrt import RIFEModel, Backend
backend = Backend.OV_CPU() # or `Backend.OV_GPU(fp16=True)` on Intel GPUs
src = core.lsmas.LWLibavSource("source.mp4")
ph = (src.height + 31) // 32 * 32 - src.height
pw = (src.width + 31) // 32 * 32 - src.width
padded = src.std.AddBorders(right=pw, bottom=ph).resize.Bicubic(format=vs.RGBH, matrix_in_s="709")
flt = vsmlrt.RIFE(padded, model=RIFEModel.v4_4, backend=backend)
res = flt.resize.Bicubic(format=vs.YUV420P8, matrix_s="709").std.Crop(right=pw, bottom=ph)
res.set_output() In general, you could use the vsov plugin through the |
Thanks for your reply. I want to try it using this: https://github.com/CrendKing/avisynth_filter Specifically the vapoursynth filter. Can you give me an example of that last part: " or the plugin directly by providing the video source clip and the ai model in the onnx format to the core.ov.Model() interface." Thanks again. |
flt = core.ov.Model(padded, "path_to_onnx") I will not answer questions related to other repositories. |
Tested with https://github.com/AmusementClub/vs-mlrt/releases/tag/v13.1
|
fp16 clip is only supported with TRT, use Please never report problems under unrelated issues. |
I think you misunderstood sth...
Same error.
So, this is a typo right? edit: I see it. |
import vapoursynth as vs
from vapoursynth import core
import vsmlrt
from vsmlrt import RIFEModel, Backend
backend = Backend.OV_CPU() # or `Backend.OV_GPU(fp16=True)` on Intel GPUs
src = core.lsmas.LWLibavSource("source.mp4")
ph = (src.height + 31) // 32 * 32 - src.height
pw = (src.width + 31) // 32 * 32 - src.width
padded = src.std.AddBorders(right=pw, bottom=ph).resize.Bicubic(format=vs.RGBS, matrix_in_s="709")
flt = vsmlrt.RIFE(padded, model=RIFEModel.v4_4, backend=backend)
res = flt.resize.Bicubic(format=vs.YUV420P8, matrix_s="709").std.Crop(right=pw, bottom=ph)
res.set_output() |
Ok. My sample script: import vapoursynth as vs import vsmlrt ret = core.resize.Bicubic(clip=ret, format=vs.RGBS, matrix_in_s="470bg", range_s="full") output_ret = core.resize.Bicubic(clip=ret,format=vs.YUV420P8, matrix_s="709") output_ret.set_output() |
I decided to use this because I have a GTX 1660. My next question is how do I use a different model like "rife_v4.6_ensemble.onnx" What do I put in the value for the script to specify that external model? "model= " |
When you import a function from a module, you should know how to get all its available flags. Lines 961 to 971 in cf2bfbf
To use rife_v4.6, just use model=46 instead.
|
ret = vsmlrt.RIFE(clip=ret, multi=5, model=RIFEModel.v4_6, backend=backend, ensemble=True) |
Ok. How do i then specify rife_v2 one in my script? |
|
Put up a blessed guide to install or compile these functions on Linux for the love of whatever deity they create. |
Any examples on how to use vsov vapoursynth plugin?
Are there any examples pertaining to motion interpolation?
Thank you in advance.
The text was updated successfully, but these errors were encountered: