Some of the achievements do not behave as expected

[robert-marik]

Some of the achievements do not behave as expected, so I think that we should keep the information somewhere. Many issues are fixed in 2.16 and the teachers who use achievements should consider to upgrade.

Some issues remained:

• The achievements super_speed_math and speed_mather are obtained if the set is solved fast. However, the time gets reset when the user submits answer from another set. So if there are more than one set opened (which is often the case) and user switches between them, these achievements do not work as expected. I believe that it is required to track (save) the first submission for each set separately. However not sure if there is enough space in frozen_hash. There could be many sets with long ids.
  • Still open
• Night owl and related achievements do not use the course timezone. The server timezone is used.
  • Related patch is Pass information on the course timezone to the achievements #1331 (merged)
• If you use UTF-8 characters in the achievement description or student names, you may have problems with import/export.
  • Related patch is Allow UTF-8 in achievement export/import/score #1206 (merged)
• If the set where students learn to work with WeBWorK should not count to achievements, the documentation suggests to use the preable.at file. However, the answers still count to the total score.
  • The correct approach is Exclude files from evaluating achivements and incrementing counters. #1316 (merged)

[taniwallach]

set_id can be up to 100 characters (80 in WW 2.15); longer names would fail to be recorded in the past_answers table, and trigger errors. Since there can me many sets, it certainly seems that frozen_hash as a varchar(1024) is to small to store data on many assignments. If this is an issue overall - it could potentially be made larger.

Another option might be to Maybe the coursename_setting column can be used to store the data you want for super_speed_math and speed_mather?

[taniwallach]

The issues with super_speed_math and speed_mather need to be addressed in the future. The rest were fixed for WW 2.16.
Moving to a different project board for the rest.

[robert-marik]

Thank you for suggestions. I am not sure about the optimal method to resolve the problem. I would like to keep the data in the table related to achievements. Another option it to query past answers and find the oldest one in the current subset. But I am not sure if this is accessible from achievement evaluation environment. Anyway, since there have been many bugs in achievements for many years, apparently not many people use these features and there is no pressure to fix this minor issue.