-
Notifications
You must be signed in to change notification settings - Fork 0
/
calculates_results_stats.py
113 lines (103 loc) · 5.46 KB
/
calculates_results_stats.py
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
#!/usr/bin/env python3
# -*- coding: utf-8 -*-
# */AIPND-revision/intropyproject-classify-pet-images/calculates_results_stats.py
#
# PROGRAMMER: Viktoriya P.
# DATE CREATED: 03/10/2023
# REVISED DATE:
# PURPOSE: Create a function calculates_results_stats that calculates the
# statistics of the results of the programrun using the classifier's model
# architecture to classify the images. This function will use the
# results in the results dictionary to calculate these statistics.
# This function will then put the results statistics in a dictionary
# (results_stats_dic) that's created and returned by this function.
# This will allow the user of the program to determine the 'best'
# model for classifying the images. The statistics that are calculated
# will be counts and percentages. Please see "Intro to Python - Project
# classifying Images - xx Calculating Results" for details on the
# how to calculate the counts and percentages for this function.
# This function inputs:
# -The results dictionary as results_dic within calculates_results_stats
# function and results for the function call within main.
# This function creates and returns the Results Statistics Dictionary -
# results_stats_dic. This dictionary contains the results statistics
# (either a percentage or a count) where the key is the statistic's
# name (starting with 'pct' for percentage or 'n' for count) and value
# is the statistic's value. This dictionary should contain the
# following keys:
# n_images - number of images
# n_dogs_img - number of dog images
# n_notdogs_img - number of NON-dog images
# n_match - number of matches between pet & classifier labels
# n_correct_dogs - number of correctly classified dog images
# n_correct_notdogs - number of correctly classified NON-dog images
# n_correct_breed - number of correctly classified dog breeds
# pct_match - percentage of correct matches
# pct_correct_dogs - percentage of correctly classified dogs
# pct_correct_breed - percentage of correctly classified dog breeds
# pct_correct_notdogs - percentage of correctly classified NON-dogs
#
def calculates_results_stats(results_dic):
"""
Calculates statistics of the results of the program run using classifier's model
architecture to classifying pet images. Then puts the results statistics in a
dictionary (results_stats_dic) so that it's returned for printing as to help
the user to determine the 'best' model for classifying images. Note that
the statistics calculated as the results are either percentages or counts.
Parameters:
results_dic - Dictionary with key as image filename and value as a List
(index)idx 0 = pet image label (string)
idx 1 = classifier label (string)
idx 2 = 1/0 (int) where 1 = match between pet image and
classifer labels and 0 = no match between labels
idx 3 = 1/0 (int) where 1 = pet image 'is-a' dog and
0 = pet Image 'is-NOT-a' dog.
idx 4 = 1/0 (int) where 1 = Classifier classifies image
'as-a' dog and 0 = Classifier classifies image
'as-NOT-a' dog.
Returns:
results_stats_dic - Dictionary that contains the results statistics (either
a percentage or a count) where the key is the statistic's
name (starting with 'pct' for percentage or 'n' for count)
and the value is the statistic's value. See comments above
and the previous topic Calculating Results in the class for details
on how to calculate the counts and statistics.
"""
results_stats_dic = dict()
n_images = len(results_dic)
n_dogs_img = 0
n_notdogs_img = 0
n_match = 0
n_correct_dogs = 0
n_correct_notdogs = 0
n_correct_breed = 0
for file_name, pet_results in results_dic.items():
pet_image_name = pet_results[0]
classified_name = pet_results[1]
match_value = pet_results[2]
image_is_dog = pet_results[3]
class_is_dog = pet_results[4]
if image_is_dog:
n_dogs_img += 1
else:
n_notdogs_img += 1
if match_value:
n_match += 1
if image_is_dog and class_is_dog:
n_correct_dogs += 1
elif (not image_is_dog) and (not class_is_dog):
n_correct_notdogs += 1
if image_is_dog and class_is_dog and match_value:
n_correct_breed += 1
results_stats_dic["n_images"] = n_images
results_stats_dic["n_dogs_img"] = n_dogs_img
results_stats_dic["n_notdogs_img"] = n_notdogs_img
results_stats_dic["n_match"] = n_match
results_stats_dic["n_correct_dogs"] = n_correct_dogs
results_stats_dic["n_correct_notdogs"] = n_correct_notdogs
results_stats_dic["n_correct_breed"] = n_correct_breed
results_stats_dic["pct_match"] = 100.0 * n_match/n_images
results_stats_dic["pct_correct_dogs"] = 100.0 * n_correct_dogs/n_dogs_img
results_stats_dic["pct_correct_breed"] = 100.0 * n_correct_breed/n_dogs_img
results_stats_dic["pct_correct_notdogs"] = 100.0 * n_correct_notdogs/(n_images-n_dogs_img)
return results_stats_dic