Add analysis

• Add code for analyzing system data.
• On Android 10 Pixel 2, we also found the bug that the edge of small videos have weird artifacts. Thus, we now force both Android 9 and 10 to use higher resolution videos.

Bug fix and database improve

• Update FAQ.
• Improve tutorial.
• Add camera_id and view_id for the video table.
• Edit video file names.
• Improve the script of adding videos.
• Remove unused files.
• Edit video samples.
• Return camera id and view id when in gallery mode.
• Allow normal users to get negative labels.
• Update README.md
• Allow GET method for get_maybe_pos_labels call.
• Add a message on the labeling page when a batch passed the quality check.
• Update TODO.
• Address an iOs 13 Safari bug that video tags are not properly removed after changing pages.
• Prevent unnecessary calls to video play and pause.
• Add a hidden video testing page.
• Add a workaround for a Google Pixel Android 9 video tag bug.
• Edit text descriptions based on community feedback.
• Tweak css.
• Improve usability and text clarity.
• Now citizens and researchers work together in labeling data.
• Add several API calls for filtering labels.
• Change the logic and the symbol when showing label agreements.
• Fix a bug when counting and querying aggregated labels.
• Do not reveal the number of gold standards when counting.
• Update gitignore file.
• Update packages.
• Fix an error related to the package updates.
• Update survey link.
• Add buttons for researchers to fast check citizen labels in the gallery in the dashboard mode.

Add tutorial

• Add the interactive tutorial
• Add more FAQ.
• Fix a problem that when changing the source of video tags, if load() is not called, the video will not autoplay.
• Add a sign-in button.
• Remove the account tab on the menu bar.
• Fix a bug that using 192.168.x.x domain pushes pageviews to the production google analytics.
• Change the feedback form to the survey.
• Wording changes.
• Add pulsing effect to the log-in button.
• Add tutorial table to the database to record the state that the user visits or passes the tutorial.
• Update website template.
• Change the hyperlink to the camera network.
• Record the best action type in the tutorial table to the user table.
• Add a script to backup database.
• Add the database backup directory to the gitignore file.
• Show the tutorial prompt dialog when the user fails the quality check for over 3 times.
• Update README.md
• Update TODO list.
• Tweak text description.
• Update FAQ.
• Improve tutorial.

Function improvements (continued)

• Tweak text descriptions.
• Move TODO from different files to a single file.
• Add examples with both steam and smoke on the index page.
• Add text description of user score to the labeling page.
• Add a link to the introduction video to the index page.
• Add a link to the viewer for each video in the gallery when in the researcher mode.
• Replace 'Collection' to 'Contribution'.
• Add raw score (the number of viewed unlabeled videos) for each user to the database.
• Display the raw score in the front-end.
• Remove user_raw_score and user_score from the connection table.
• Add the api call to get label statistics.
• Show the label statistics on the front-end when labeling.
• Add more positive videos.
• Improve the flow for adding videos.
• When querying batches, make sure that half of them are partially labeled. In this way, we can speed up labeling.
• Now the gold standard videos have at least one negative and one positive videos, which prevents spamming.
• Fix the migration script problem.
• Upgrade python packages.
• Add loading icon for the galley.
• Improve loading icon logic for the labeling tool.
• Increase the countdown duration when labeling.
• Reduce the number of videos at the first page to 16 because of video number restrictions before mobile safari version 12.
• Fix a problem that when google sign-in api failed, the system get stuck in the loading state.
• Update website template to improve the functionality of the dialog box.
• Update website template to improve accessibility and usability.
• Fix a css bug in the submit button when counting down.
• Improve the automatic check for video autoplay.
• Fix a bug that in track protection mode (Firefox), the page will hang forever because the browser is unable to load the google analytics.
• Improve the track protection detection in the google analytics tracker.
• Add browser support checks.
• Add a script to mark bad videos.
• Improve video autoplay detection.
• Add frequently asked questions (FAQ) page.
• Add a google form to collect feedback on the FAQ page.
• Change max-age in the apache2 cache control to 5 seconds (this used to be 60 seconds, and the browser will cache the label statistics, which can be wrong).
• Fix other miscellaneous bugs.

Function improvements

• For simplicity, the weights of the labels provided by experts are no longer higher than other types of clients.
• Show user id on the account dialog.
• Add a column in the video table to store the most recent updated time of the label state.
• Sort the returned videos for the gallery page by the newly added label_update_time column.
• Improve the text descriptions for the front-end.
• Add control buttons for normal users to view different types of labels.
• Refactor code.
• Remove duplicates when querying videos by user id.
• Add an API call that returns 'maybe positive' labels.
• Remove the '?' mark from 'My Collection' gallery page.
• Change 'Y' and 'N' in 'My Collection' gallery page to 'A' and 'D'.

Usability and security improvements (continued)

• Fix a bug that researchers did not see the positive labels changed via the dashboard gallery when clicking the "My Collection" button.
• Add a button and a textbox for going to a specific page number on the gallery page.
• Tweak CSS.
• Return file name for admin users when querying videos with different types of labels.
• Add table of content to the README file.
• Document API calls in the README file.
• Add the ability for testing the application on a server with a local IP address.
• Fix a bug when calling get_pos_labels with no user_token.
• Change available methods for some API calls.
• Add a timestamp column to the view table.
• Allow researcher and expert-type users to downloading user token.
• Add more information when logging.
• Fix a bug that label_state is passed to the client when labeling (this reveals gold standards).
• Fix bugs when user_jwt is None for some API calls.
• Check if the request context is activated (has_request_context) when logging to avoid errors.

Usability and security improvements

This version improves several usability and security issues in the v1.0 release. The changes are summarized below:

• Update README.md to include the documentation of setting up https.
• Tweak the text to also ask people to label low opacity smoke.
• Fix a google sign-in problem that users cannot select a new account after signing in with one account.
• Add a script and several files for adding new videos.
• Fix the shell script for removing a detached screen on the background.
• Add a new file that contains latest camera findings.
• Remove gold standard videos from get_pos_labels and get_neg_labels API calls.
• Change get_pos_labels_by_researcher and get_neg_labels_by_researcher API calls to only admin (researchers and experts) access.
• Exclude gold standards from get_pos_labels_by_researcher and get_neg_labels_by_researcher API calls.
• Add a function to download all video labels for researchers on the gallery page.
• Allow expert-type users to access the advanced gallery dashboard (without the function for setting label states).
• Update the front-end related to the above API permission changes.
• Prevent blacklisted users from getting valid user_token from the server.
• Add a view table in the database to track records of viewed videos.
• Add current user scores to the connection and batch table.
• Reduce the duration for video playback testing.
• Prevent the "My Collection" button on the label page from opening a new tab.
• Sign each video batch with the user id and verify this when sending labels back to the server.
• Request a new video batch after google sign in or out (because the signature does not match).
• Fix a bug that the google client id will be wrong after google sign out.

Stable version for the community to test and label videos

This is a stable version which allows the community to start labeling videos. Gold standards are randomly placed in video batches to measure the reliability of each labeled video batch. This version is tested and worked on the following platforms:

• Android Chrome
• iPhone Safari
• Windows 10 Edge
• Windows 10 Chrome
• Windows 10 Firefox
• macOS Mojave Chrome
• macOS Mojave Safari
• macOS Mojave Firefox

Pre-release for curating gold standard videos

This is a stable version for curating video labels. The system now uses real data and allows researchers (client type 0) to filter and edit label states.

Pre-release for demo purposes

This is a stable version for demo purposes. The system has basic functionality, including labeling and showing videos with positive labels. The dataset used in this release is a fake one obtained from our previous work.