Skip to content

Commit

Permalink
Docs
Browse files Browse the repository at this point in the history
  • Loading branch information
AndrewHazelden committed Sep 17, 2024
1 parent b164ee4 commit f19b171
Show file tree
Hide file tree
Showing 6 changed files with 91 additions and 4 deletions.
Binary file modified docs/Images/mastering-180vr-resolve-deliver-page.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 3 additions & 1 deletion docs/Mastering-180VR-Stereo-for-AVP-HMDs.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,9 @@ It is possible to display this stereo 3D footage on a stereo 3D aware monitor wi

![Nobe Display NDI](Images/mastering-180vr-node-display-ndi.png)

An interesting VR media review approach that works today, is that an Apple Vision Pro HMD is capable of playing back an [NDI video stream](https://ndi.video/tools/) in real-time from a WiFi connection. One tool you can use for this task is the VisionOS store app called "[iXR OSC & NDI](https://apps.apple.com/us/app/ixr-osc-ndi/id6642664920)".
An interesting VR media review approach that works today, is that an Apple Vision Pro HMD is capable of playing back an [NDI video stream](https://ndi.video/tools/) in real-time from a WiFi connection.

One tool you can use for this task is the VisionOS store app called "[iXR OSC & NDI](https://apps.apple.com/us/app/ixr-osc-ndi/id6642664920)". This tool currently supports 360VR content so you will have to reformat your media for live NDI formatted previews.

![Apple Vision Pro](Images/mastering-180vr-avp.jpg)

Expand Down
2 changes: 1 addition & 1 deletion docs/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
## <a name="overview"></a>Overview

![KartaVR](Images/kartavr_logo_256x120px.png)
**Version 5.7.4** - Released 2024-09-16
**Version 5.7.5** - Released 2024-09-17

"Karta" is the Swedish word for map. With KartaVR you can stitch, composite, retouch, and remap any kind of panoramic video: from any projection to any projection. This provides the essential tools for 360VR, panoramic video stitching, depthmap, lightfield, and fulldome image editing workflows.

Expand Down
83 changes: 83 additions & 0 deletions docs/Reframing-an-8K-VR-Video.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,83 @@
# Reframing an 8K VR Video

## Overview

This quick guide covers how to make a better vertical format social media VR reframe effect in a standard DaVinci Resolve 1080x1920px resolution video timeline.

## Using the new Workflow

Create the Resolve timeline at the correct frame size that matches your final output format.

Add the full length video clip to the Edit page **WITHOUT** any initial in/out point trimming performed in advance in either the Media Page, or the Edit page.

Set the clip-level mismatched resolution resizing in the Edit page inspector window to "Stretch".

Make a new compound from the footage by right-clicking on the clip in the Edit page timeline. In the contextual menu select "New Compound Clip…"

Open the Effects panel. Then expand and select the "Toolbox \> Effects \> KartaVP" section. Add a new "kvrViewer" effects template using the search field in the dialog.

*Note: You may have to update your existing Kartaverse plugins inside the (free) Reactor package manager. For this workflow to really shine, you need to have an August 2024 or newer release of the KartaVP tools.*

In the Edit page Inspector window, switch to the Effects control page. Then click the little white "magic wand" icon, next to the entry for "kvrViewer". This allows you to access the effects template's internal nodes.

In the Fusion page, break the automatically created connection line going from the default "MediaIn1 \-\> kvrViewer1" node.

*Note: The next thing we are going to do is a little workflow trick brought to you by creative folks at Hugh Hou Films and the Kartaverse dev team. This workaround lets us bypass, in a single move, just about all of DaVinci Resolve's internal timeline based resolution limits and image resizing "image filter hits" that the conventional Edit page to Fusion page data I/O process causes by design. The visual difference from doing this extra step, is like night and day for image quality, when loading in 5.7K or 8K+ resolution media that will be used for horizontal to vertical format VR reframing conversions\! Nice. 👌*

Show the Media Pool tab at the top left of the Resolve Edit page. Drag the exact same video clip from the Media Pool bin into the Fusion page node graph area. For better organisation and tidiness, you might want to place this MediaIn2 node vertically, just above the initial MediaIn1 node.

Connect this newly added MediaIn2 clip to the kvrViewer nodes' Input1 image connection.

If you display the MediaIn2 clip in the Fusion viewer window, the top right corner of the image should list the original media's frame size, not the current timeline resolution. If you still see your camera's original 5.7K or 8K footage resolution listed, it means no image quality has been lost at this "direct media access" stage of the reframing process.

Adjust the kvrViewer node in the Inspector window to turn OFF the "auto-resolution" control. Auto-Resolution is typically used to match the input image resolution to the output image resolution and aspect ratio. We don't want this option to be used if going for vertical format video as our intended deliverable.

*Note: If we are going for a vertical format output the initial footage is sourced from either a 16:9 or 2:1 aspect ratio video file. The output image projection we want is going to be rendered to a 9:16 ratio for social media friendly vertical format video. 🎥*

For vertical format 1080p video output set the width to "**1080**". The set the height to "**1920**".

For vertical format 2160p video output set the width to "**2160**". The set the height to "**3840**".

Set the image projection to either "180VR" or "360VR," as required. This parameter needs to match your camera's native VR capture format. This image projection setting is simply defining the type of VR content we are loading into Resolve.

If the content is monoscopic video, enable the "Mono" setting on the kvrViewer node.

Save the Resolve project.

If you want to collapse left and right eye based SBS (Side-By-Side) or OU (Over/Under) stereo 3D footage down to monoscopic content, simply add a Kartaverse "kvrCropStereo" node to the node graph, just in front of the existing "kvrViewer" node. Set the kvrCropStereo node's Stereo "Input Mode" to match your stereo content frame layout. Then set the Stereo "Output Mode" to "Mono" so you are then going to be able to reframe a monoscopic 2D video for social media usage.

Return back to the Edit page timeline.

Bump the playhead either forwards, or backwards by a few frames to refresh the viewer window. This is needed to update the cached image shown in the Edit page viewer window.

At the bottom left of the Edit page viewer window a small square overlay control icon exists. Select the "Fusion Overlay" option to support accessing the kvrViewer on screen reframing view rotation and zooming controls.

Turn on the kvrViewer node's keyframe options in the Edit page Inspector \> Effects window for the "Center X/Y", "Angle", and "Zoom" controls.

Do your 360VR reframing steps as usual.

If you need to, use the Edit page Inspector windows' "magic wand" icon again to bring the kvrViewer Effects Template data into the Fusion page.

You can then access Fusion's much more flexible animation curve based tangent editing tools to refine the motion of the reframing work. The Fusion page has its own keyframe adjustment controls that are accessed using the Spline and Keyframe panels.

Once you like the motion of your reframed content, and have completed editing your video:

On the Deliver page you ideally want to export MP4 H.265 video at a social media friendly 1080x1920px or a larger 2160x3840px frame size. This is a video resolution that has a (9:16 aspect ratio) vertical format layout.

Render this footage to disk using the Deliver page render queue.

You can then upload the final reframed "flat" video content to social media platforms like Instagram, TikTok, or YouTube shorts that feature vertical format video as the default frame size.

## Render in Place Usage

If you are going to be working on a hybrid social media post that intermixes VR and non-VR video, you might consider using the "Render in Place" feature.

This would be done on a copy of the VR reframing timeline's video track on the Edit page. The Render in Place command would help by caching a flattened copy of the final reframed content, in a way you will see zero delay for editing and playback.

This is often relevant if you are doing a video editing project that lasts more than half a day, or so.

## Closing Thoughts

***Good Luck and happy reframing of your immersive memories\!\!\!***

May your social media feed become packed with even more exciting content from your life's adventures. 🤘
1 change: 1 addition & 0 deletions docs/_sidebar.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@
- [Install Kartaverse + Reactor](install)
- Workflows:
- [Mastering 180VR Stereo for AVP HMDs](Mastering-180VR-Stereo-for-AVP-HMDs)
- [Reframing an 8K VR Video](Reframing-an-8K-VR-Video)
- Fuses:
- [Kartaverse Fuse Nodes](fuses)
- [Vonk Ultra Data Nodes](https://docs.google.com/document/d/1U9WfdHlE1AZHdU6_ZQCB1I2nSa5I7TyHG2vKMi2I7v8/edit?usp=sharing)
Expand Down
5 changes: 3 additions & 2 deletions docs/version_history.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,9 @@

## Version History

### Version 5.7.4 - 2024-09-16
- Added "kvrVingette" DCTL fuse
### Version 5.7.5 - 2024-09-17
- Added "kvrVignette" DCTL fuse
- Updated the "kvrFisheyeStereo" macro that ships with the Kartaverse Lens Profiles atom package. This should fix a horizontal resolution mis-match issue with the RGB vs STMap output mode. Previously a different output resolution was seen in Resolve Studio vs Fusion Studio.

### Version 5.7.4 - 2024-09-07
- Kartaverse docs update
Expand Down

0 comments on commit f19b171

Please sign in to comment.