USCensusPEP_PopulationEstimatebyRace: Changes committed for duplicate…

…s values (#1121)

* Auxilio Brazil Test Data and Readme file added

* reverted the changes

* SCHEDULES=cripts/us_census/pep/population_estimate_by_race:USCensusPEP_PopulationEstimatebyRace

* Lint errror fixed

* Added coments

scripts/us_census/pep/population_estimate_by_race/preprocess.py

@@ -1059,6 +1059,9 @@ def process(self):
                 (os.path.join(self.cleaned_csv_file_path,
                     "USA_Population_Count_by_Race_before_2000.csv"))
             generator_df = generator_df[generator_df['geo_ID'].str.len() > 1]
+            #Duplicate geo_ID instances were detected within the 1970-1979 data subset. To ensure data integrity, the older entries were eliminated, leaving only the most recent updates.
+            generator_df = generator_df.drop_duplicates(
+                subset=['geo_ID', 'Year'], keep='last')
             generator_df.to_csv(os.path.join(
                 self.cleaned_csv_file_path,
                 "USA_Population_Count_by_Race_before_2000.csv"),