Skip to content
Rich edited this page Sep 23, 2018 · 7 revisions

Welcome to the whalematch wiki!

Challenge

http://hackforthesea.tech/GLO/challenge/3

Questions

  • Do all whales have a unique blowhole?

We did not answer this yet.

  • When is the best time during the blow to capture the unique shape of the blow hole for ID purposes (fully open)?

We don't know yet. Video will capture a blowhole in various states. Multiple images will be generated in that state. All those images will be fed as input for matching. This will be a factor for accuracy going forward,

  • Does the image have to be taken from straight above the animal or can we capture the unique blowhole from a photo taken at an angle and if so what angle? (Typically snot collection happens from just behind the blow hole.

We don't know yet. This is also an accuracy concern we will consider moving forward.

  • Is there existing photo recognition software out there that we can utilize for this photo ID process?

Yes. There are many tools you can use. We a leveraging Keres in our image matching process.

  • Can the above mentioned software work in real time with video footage?

Yes. The question should be, do we need to this to occur in real-time or near real-time. It is possible to shift the sorting and matching process further upstream by leverage streaming tools with the Drone. This is an activity process question that will need consider cost and benefit.

Process

  • Take Video

  • Extract Stills from Video using a script

  • Extract tiles from Stills using a script

  • Manually identify Positive and negative matches to train the image matching program

  • Feed Stills to program and compare, and identify specific blowholes

Moving Forward

  • More Data Better Accuracy!
  • Need a dataset of unique whales and their identifier (name, etc)
  • Need a more positive images of the unique whales
Clone this wiki locally