Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Native pen and touch support for Windows #1483

Merged
merged 2 commits into from
Aug 4, 2023

Conversation

cgutman
Copy link
Collaborator

@cgutman cgutman commented Jul 31, 2023

Description

This PR implements native pen and touch support for Windows using the Sunshine protocol extensions and InjectSyntheticPointerInput() which was introduced in Windows 10 1809. It also implements the core plumbing needed for supporting this feature on Mac and Linux.

Most major pen/touch features are supported including:

  • 10-point multitouch
  • Contact area
  • Pressure
  • Rotation and tilt
  • Hover (though not distance, due to Windows API limitations)
  • Pen buttons (only 1, due to Windows API limitations)

This implementation is currently limited to direct input devices where the pen/touch device is associated with a screen. It does not currently support independent devices like standalone drawing tablets (and likely never will on Windows, due to API limitations).

cc: @ABeltramo

Screenshot

Issues Fixed or Closed

Type of Change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Dependency update (updates to dependencies)
  • Documentation update (changes to documentation)
  • Repository update (changes to repository files, e.g. .github/...)

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have added or updated the in code docstring/documentation-blocks for new or existing methods/components

Branch Updates

LizardByte requires that branches be up-to-date before merging. This means that after any PR is merged, this branch
must be updated before it can be merged. You must also
Allow edits from maintainers.

  • I want maintainers to keep my branch updated

@cgutman cgutman added the protocol update This PR includes an update to the streaming protocol label Jul 31, 2023
@cgutman cgutman mentioned this pull request Jul 31, 2023
11 tasks
@XPRAMT
Copy link

XPRAMT commented Dec 15, 2023

Using a stylus pen and multitouch may experience intermittent lag (approximately every 10 to 20 seconds).
https://www.youtube.com/watch?v=ZJRAMEsHK3g

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
protocol update This PR includes an update to the streaming protocol
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants