Skip to content
This repository has been archived by the owner on Feb 9, 2024. It is now read-only.

Use AI to locate the ball #27

Open
scotstan opened this issue Feb 25, 2021 · 0 comments
Open

Use AI to locate the ball #27

scotstan opened this issue Feb 25, 2021 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@scotstan
Copy link
Contributor

Great suggestion from @mikeestee

  1. Train an ONYX/TF model to turn "ball in video frame" into a "normalized x/y" coord.
  2. Update the simulator to render the ball as a video frame, instead of synthesizing it directly from the physics.
  3. Import that and then combine it with one or more concepts for controlling the servos
  4. Export to moab.
  5. ???
  6. Profit

We use openCV computer vision algorithms to find the dominate hue of the center pixel space during calibration. Then use that color for the Hough circle detection algorithm. It does mean you have to recalibrate for different color balls, and the detection is sensitive to changing ambient lights (dark room vs sunny).

Would require the synthesis of simulated data and/or lots of real frames of data. Since we have labeled data now from ideal conditions (i.e., we can easily save videos with meta-data of circles where the ball is), we can get a good start.

@scotstan scotstan added the enhancement New feature or request label Feb 25, 2021
@polzounov polzounov self-assigned this Feb 28, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants