Merge pull request #7 from EducationalTestingService/features/add_reg…

…ression_test_data

Add regression test data

README.md

@@ -16,6 +16,10 @@ pip install -e .
 ```
 The project was tested using Python 3.8.
 
+## Unit tests
+After activating the conda environment, simply run the code below: 
+`pytest -v tests`
+
 ## Datasets
 All the public GEC datasets used in the paper can be downloaded from [here](https://www.cl.cam.ac.uk/research/nl/bea2019st/#data).<br>
 Synthetically created datasets can be generated/downloaded [here](https://github.com/awasthiabhijeet/PIE/tree/master/errorify).<br>

regression_tests/original/FCE_10.txt

@@ -0,0 +1,10 @@
+Dear Sir or Madam ,
+I am writing in order to express my disappointment about your musical show " Over the Rainbow " .
+I saws the show 's advertisement hanging up of a wall in London where I was spending my holiday with some friends . I convinced them to go there with me because I had heard good references about your Company and , above all , about the main star , Danny Brook .
+The problems started in the box office , where we asked for the discounts you announced in the advertisement , and the man who was selling the tickets said that they did n't exist .
+Moreover , the show was delayed forty - five minutes and the worst of all was that Danny Brook had been replaced by another actor .
+On the other hand , the theatre restaurant was closed because unknown reasons .
+You promised a perfect evening but it became a big disastrous !
+I would like some kind of explanation and receive my money back .
+If you do n't agree , I will act consequently .
+I look forward to hearing from you .

regression_tests/original/FCE_127.txt

@@ -0,0 +1,127 @@
+Yours faithfully ,
+Unfortunately , Pat was n't very good at keeping secrets .
+Last Wednesday Carole received a letter .
+The stamp was from a foreign country and the address was written in Capital Letters .
+She did n't recognize the writing .
+She began to read " Dear Carolin ..
+There was only a person who used to call her by this name .
+It brought a lot of memories back to her .
+It was long time ago , when she was fourteen and Paul sixteen .
+He was her first love and also the first who kissed her .
+Paul had to move to Mexico because of his father 's work .
+When they were saying goodbye Paul " I will be the last person who will kiss you " . " It sounds nice but I do n't believe it " she replied .
+" You only have to wait " he said .
+But she did n't wait .
+She got married and had two children .
+At this moment Carole was living with her husband but they did n't love each other any more .
+Their love had finished .
+In his letter Paul said that he had become a rich man and he would come back to meet her again .
+Her friend Pat had explained the whole story at her husband .
+What she would do ?
+10 June 2000
+Dear Manager ,
+I would like to complain about your theatre and the musical show that I saw last week .
+I went to London for a holiday last week and read the advertisement about ' Over the rainbow ' in the hotel which I stayed .
+I saw Danny Brook and Tina Truelove were written on the advertisement paper and was very excited .
+However , Danny Brook did not appear on the stage until the end of musical showing time .
+I was really disappointed about it .
+Secondly , starting time was 19:30 but it started 20:15 so I was waited for 45 minutes .
+It was so long time to wait in the theatre .
+Thirdly , it mentioned about discounts .
+Despite of the fact that I am a student , I could not get any discounts .
+I also visited your restaurant after the show but already closed because the show finished late .
+Because of the reason above , I , indeed , spent awful last night in London .
+I would like you to refund , otherwise , I will take an action .
+I look forward to receiving reply to my enquiry .
+Sincerely
+Fashion of the future
+People will wear this kind of clothes 100 years later from now .
+If weather is hot then we do n't have to wear under wear because very thin and light clothes will support our bodies .
+There will be two functions for summer clothes that we do n't need to wear clothes like layer and layer .
+For example , T - shirts for women are included bra : easy to take it out when you wash it , is very simple and comfortable .
+What about short pants ?
+You do n't have to wear knickers .
+We can just put some thin pads in there .
+We ca n't feel it and easy to remove and just can wash it .
+Simplest is the best in summer !
+When it 's very cold winter , we just wear light clothes what we want , in our style .
+Because special warm and healthy material will be developed and use them inside thin clothes so we do n't need to put heavy clothes on our bodies .
+We can show our body line in winter as well .
+Most important thing is that we do n't have to kill the animals only for people 's cruel aims .
+Functions ' clothes are the way to love animals !
+DECEMBER 12TH
+PRINCIPAL MR .
+ROBERTSON
+DEAR SIR ,
+I WANT TO THAK YOU FOR PREPARING SUCH A GOOD PROGRAMME FOR US AND ESPECIALLY FOR TAKING US TO THE RIVER TRIP TO GREENWICH .
+I WOULD LIKE TO KNOW IF THERE IS ANY CHANCE OF CHANGING THE PROGRAMME BECAUSE WE HAVE FOUND A VERY INTERESTING ACTIVITY TO DO ON TUESDAY 14 MARCH . IT CONSISTS ON VISITING THE LONDON FASHION AND LEISURE SHOW IN THE CENTRAL EXHIBITION HALL .
+I THINK IT 'S A GREAT OPPORTUNITY TO MAKE GREATER USE OF OUR KNOWLEDGE OF ENGLISH LANGUAGE .
+ON THE OTHER HAND , WE COULD LEARN THE DIFFERENT WAYS TO GET TO THE CENTRAL EXHIBITION HALL .
+I SUGGEST THAT WE SHOULD GO TO THE NATIONAL ART GALLERY IN THE MORNING AND INSTEAD OF HAVING THE AFTERNOON FREE WE COULD GO TO THE FASHION AND LEISURE SHOW .
+I WILL BE WRITING ANXIOUSLY FOR YOUR RESPONSE .
+YOURS FAITHFULLY
+( FAMOUS PEOPLE , SUCH AS POLITICIANS AND FILM STARS , DESERVE TO HAVE A PRIVATE LIFE WITHOUT JOURNALISTS FOLLOWING THEM ALL THE TIME )
+FAMOUS PEOPLE SUCH AS SINGERS , FILM STARS , ETC ARE ALWAYS THE CENTRE OF ATTENTION .
+AS SOME OF THEM ARE CONSIDERED IDOLS , THEIR FANS WANT TO KNOW HOW THEY ACT IN THEIR PRIVATE LIVES , WITH THEIR FAMILY OR FRIENDS .
+AS A RESPONSE TO THIS DEMAND OF INFORMATION , JOURNALISTS FOLLOW FAMOUS PEOPLE DAY AND NIGHT IN MANY DIFFERENT WAYS , FOR EXAMPLE , CHASING THEIR CARS , TAKING PHOTOGRAPHS OR BREAKING INTO THEIR HOUSES WHILE THEY ARE ON HOLIDAYS .
+THIS SITUATION AFFECTS FAMOUS PERSONAL LIVES BECAUSE THEY ARE NOT ALLOWED TO HAVE PRIVACY
+THE MOST IMPORTANT THING IS THAT , ALTHOUGH THEY ARE FAMOUS , THEY ARE JUST NORMAL PEOPLE THAT DESERVE TO HAVE A PRIVATE LIFE WITHOUT JOURNALISTS AND FANS FOLLOWING THEM ALL THE TIME , AND ON THE OTHER HAND PEOPLE HAVE TO LEARN TO RESPECT THE FAMOUS RIGHT TO KEEP THEIR PERSONAL LIVES IN SECRET .
+IN MY OPINION FAMOUS PEOPLE ARE BEING OBLIGED TO PAY A PRICE FOR BEING FAMOUS THAT IN SOME CASS , COSTS MORE THAN THEY DESERVE TO PAY .
+To Mr. Robertson
+I am writing to tell you something about the three - day trip to London .
+I have seen your programme for the trip and I think it is going to be a great trip .
+Thank you very much for organising this trip and putting all your spare time and effort into it .
+Personally , I enjoy looking and learning about new inventions and all the science .
+That is why I think the trip to the science museum is a good idea .
+However , my class and I have seen an advertisement about a fashion and leisure show . We are attracted to this show and would like to go .
+Unfortunately , it is on 14th March , which is the day we will be visiting the science museum .
+This show is on the 14th March .
+It is in the Central Exhibition Hall and will start and ten o'clock and finish at five o'clock in the evening .
+Apparently , this show is free to all students , which means if we went , the cost of the trip will be cut down .
+I think it is a great opportunity because it is based on fashion .
+We like to keep up with the rage but I think it will help those who want to become a fashion designer later on .
+I have a suggestion on how the programme could be changed .
+The shopping time could be after the show and the free time exchanged for the science museum .
+If we go to the show , we can do without the free time .
+Please give this your careful consideration ..
+Yours sincerely ,
+In a country like the UK , we are all bound to have houses .
+We either own it , or we simply borrow it from other people . We take our homes for granted .
+Think about the people in the poor countries !
+They struggle to survive .
+However , as we approach the future , our homes will start to change .
+Have you ever thought about how the changes will affect our lives ?
+I doubt it .
+There will be lots of differences in our homes of the future from our homes now , but there may also be a lot of similarities .
+For one , the future homes might not be built out of bricks at all !
+It may be built out of a stronger substance or a more attractive one , such as glass .
+Non - breakable glass .
+Also , due to global warming , sea levels might rise and risk of flooding will also rise .
+Therefore , houses will be built on high supports .
+All domestic appliances such as showers , kettles , lights , TV and curtains may be voice activated .
+Incredibly high security will prevent robbery .
+The future homes will also have many similarities , such as having a separate bathroom , and not having one in a bedroom , or having two floors or having garages .
+It has been a pleasure sharing my thoughts with you .
+What do you think will happen in the future ?
+Dear Mrs. Jane Clark ,
+Recently I was at the annual international arts festival , that you organized .
+I 'm writing this letter to thank you for giving a possibility to know more about modern art .
+I think , it is a wonderful idea to organize such festivals each year , because it is very interesting to learn some news about life in other countries .
+Unfortunately , only six countries were represented this year at the festival , but I hope that soon there would be much more of them .
+I extremely liked all concerts , shows , exhibitions , but why there were n't any photograph exhibitions ?
+I think , you should make some next year .
+Then , I want to mark , that concert halls were too small , that is why they were overcrowded during some concerts .
+Then , I want to say , that plays and films were exellent , but it was n't enough of them for me .
+May be you should make more next year ?
+And at the end , my opinion is that one weekend ticket for all events is a great idea , because you do n't have to stay in queues to buy a ticket for a show , you want to go to .
+Yours sincerely ,
+Dear Lucia ,
+I was very pleased to receive your letter .
+You asked , if there are some school rules in my country .
+As you know , I 'm studying at the private Academy , so the rules in my institute are different from the rules in state institutes . I 'll give you an example .
+In our Acadamy we are not allowed to smoke .
+The fine for smoking on the Academy is territory is 100 dollars .
+So nobody smokes there .
+I do n't smoke , so I do n't care about this rule .
+But some of my friends really would like to change it .
+You also wanted to know about what I 'm allowed or not allowed to do at home .

regression_tests/original/FCE_128.txt

@@ -0,0 +1,128 @@
+Well , I have rather modern parents , so they do n't prohibit me to go to the discoes or somewhere with my friends .
+The only rule for me at home is to walk out with my dog three times a day .
+I hope it was interesting for you to know about the rules in my life .
+Look forward to hearing from you ,
+Dear Sir / Madam ,
+I was to Circle Theatre to watch ' Over the rainbow ' musical show , recently .
+I was trully dissapointed by it .
+My expectations were high after I 've read your leaflet in which it was advertised as ' London 's newest and best musical show ' .
+Now , I can assure you it was n't .
+Firstly , it was Danny Brook who was supposed to star .
+The substitute was far worse .
+Secondly , I had to wait fourty - five minutes before the show finally began .
+Another unkept promise are the discounts .
+There were n't any !
+Lastly , when I got hungry after the delay it appeared that the theatre restaurant is closed . You can believe me it was n't ' my perfect evening out ' and I have no other choice than asking to give my money back .
+I paid for something I did n't get so it is obvious that I want my money back .
+I got the £ 15 ticket .
+I 'd like you to send the money to this adress ; ul Taklowa 10
+Skoclow 43 - 430
+POLAND
+Yours sincerely ,
+Unfortunately , Pat was n't very good at keeping secrets .
+After two days the whole school knew .
+When Paul entered the school gate , other children began to tease him and laugh .
+Paul could n't stand it .
+He ran out quickly , leaving everyone behind .
+He felt very ashamed and did n't know what to do .
+Normally , he would go and talk to Pat but Pat betrayed him .
+They were no longer friends . '
+How could he , ' Paul thought ' Now the whole school knows Jean attracts me ' .
+As he was sitting there , he heard someone walking towards him .
+He turned around and saw ... Jean . '
+What are you dong here , why are n't you at school ? '
+she asked .
+Paul was like paralyzed .
+He could n't reply . '
+I had heard what you 've said about me ' , she said , I think it 's sweet ' .
+Paul could n't believe his ears .
+While he was thinking how to reply , Jean took his hand and led him to the school .
+When they entered everyone became silent .
+All the children were staring at them and Paul thought that Pat is n't that bad at all .
+Cambridge 13.06.00
+Dear Helen Ryan
+Competition Organiser
+I am glad to know about the news that I have received .
+It is a dream becames true and was really unexpected for me !
+I would like to travel on July because of it is more suitable for me .
+I think I will really enjoy if I could stay in tents it is going to be a new experience and looks exciting .
+About the activities while at the Camp I would like to enjoy swimming , not because I am good in it , just because I keen on and the other one is Photography .
+As I never did this in whole my life could you tell me if we have to do our own meals or I can find everything ready to eat there ?
+If no , what do you sugest ?
+The same question for clothes and money .
+How much I have to get in my pocket ?
+I hope has had your questions out of your mind .
+Yours sincerely
+Cambridge 13.06.00
+Dear friend
+Kim
+Last month , I enjoyed to help at a pop concert in Portugal .
+Everything were new for me .
+I had to ( lyd ) tidy up the place where they have to wait until their turn .
+The group asked me make sure that in the fridge they always could find a big variety of drinks including honey and lemon for throat .
+Other thing I had to do is keep an eye in the towels , I mean , dried towels because as you know that country is too hot , especially for my liking , as they have to change the clothes and looks fresh ; do n't ask me why .
+The pop concert happened in a big stadium called " Mararcanã " .
+I just did not enjoyed when they were making the instruments work for the big day .
+But what I particularly liked was see and ask autographs from the rest of the others groups .
+Do n't be jealous , I will make a copy for you , OK ?
+Love
+Dear Ms Jane Clark .
+I am writing to you with regard to the International Art Festival that was held recently .
+The festival was excenent in many ways , and especially it being an international festival was a challenging , but brilliant idea .
+I assume that this fact attracted people very much .
+In addition to that , organising one weekend with special price tickets was particularly good .
+I personally think that it helped many people who were not able to afford the tickets with proper price to come to the festival .
+Moreover , most of the events I went to were fantastic .
+However , I still have some comments to make to improve the festival next year .
+The festival was supposed to be an international one , but the artists and stars participated in it were from six countries only .
+Thus , I recommend that stars and artists of various nationalities should be invited .
+Also , some of the concert halls where the musicians performed were not big enough for the vast number of audiences .
+I think it would be much better to use bigger concert halls .
+Furthermore , I found that there were not many genres of neither the films nor the plays .
+So I suggest you have various kinds , and more numbers of plays and films next year .
+I hope that next year 's festival will be much more successful that this year 's one .
+Yours sincerely ,
+The Old Man and the Sea
+People all have different opinions about books .
+Some prefer realistic stories whereas others do unusual ones .
+But I prefer realistic stories such as Ernest Hemingway 's " The Old Man and the Sea ' .
+Above all , realistic stories teach me something of the life , or at least influence me .
+As far as I 'm concerned , my behaviour and attitudes towards a difficult situation began to change after reading this book .
+Here , the fishman is very old , but he is still challenging to everything he faces .
+When he caught a shark which was bigger than the ship , he never gave up taking it back to his village , even when sharks were around him .
+Real stories have huge impacts on me , and affect me a lot , often in good ways .
+In addition to that , realistic stories are more attractive , I personally do n't want to hear stories about very peculiar incidents as I know they can not be true .
+But , while reading realistic stories , I just fall deep into the story , into the writer 's own world .
+Ernest Hemingway 's sentences are precise , but still very powerful and alive .
+So when I read other sharks eating the shark the old man had caught , I got very angry and annoyed .
+Realistic stories thus , develop our imagination and creativity , which are essential in our lives .
+We all learn from reading books , but realistic stories have more influence on me and develop my personality .
+That 's why I prefer realistic stories to unusual ones .
+17th June 2000
+Dear Sir ,
+I would like to complain about a musical show .
+I was very disappointing a week holiday for me because I had got a lot of problem with the show .
+I had seen the advertisement that the actors were Danny Brook and Tina Truelove , but it was not Danny Brook .
+I was really disappointing because he is my famous actor .
+The musical should started at 19.30 , but it started at 20.15 .
+When I went to asked for the discount of ticket in the cashier desk they told me no discount available for this .
+I had seen the advertisement say that discount available .
+After the show I decide to had dinner in your theatre restaurant , but I could n't because it closed .
+It closed at 10 pm but the show finished at 10.30 pm .
+This was not perfect evening for me , so if you do n't give my money back , I will tell to the newspaper about it .
+I am looking forward to hear a good new .
+Yours sincerely ,
+Boo Sersuwan .
+I think in the next 100 years people will wear the space clothes with small engine in the back . because of the atmosphere .
+The atmosphere in the earth now starting badly every years .
+The carbon dioxide are growing very fast and people cut more trees , therefore not enough trees to such carbon dioxide and produce oxygen .
+The designer will have a lot of idea for how to make very nice and useful clothes .
+I think if we wear this clothes we will travel to every where easier than we use cars , ships , planes and space ships .
+This mean the engineering will find the way to useless petrol for it , so it must useful in the future .
+I think somebody will make a very big area to grow plant because they can sell the oxygen .
+This is a new business .
+I think I can win this price , because this clothe will produce in the future soon .
+17/06/00
+mr . MANAGER
+MY NAME JAMES CAMIREZ AND I'AM WRITING THIS LETTER TO YOU BECAUSE I HAVE SOME COMPLEINTS FOR THE DISAPPOINTING EVENING I HAD LAST NIGHT .
+FIRST OF ALL ON THE ADVERTISEMENT FOR THE SHOW IT SAYS THAT THE ACTOR WAS GOING TO BE DANNY BROOK AND INSTEAD OF HIM WAS A TOTALLY UNKNOWN CLOWN THAT HAD NO IDEA OF HOW TO ACT , IT WAS HORRIBLY DISAPPOINTING !