Handle repeating sequences in a file

[rien]

Consider the following two files:

private class ClassWithArray {
      private char[] chars = {'A','B','C','D','E','F','G','H','I','J','K','L','M',
                            'N','O','P','Q','R','S','T','U','V','W','X','Y','Z',
                            'a','b','c','d','e','f','g','h','i','j','k','l','m',
                            'n','o','p','q','r','s','t','u','v','w','x','y','z'};
}

private final class ClassWithMoreArrays {
         private final static char pwdArray [] = {
      	        'a', 'b', 'c', 'd', 'e', 'f', 'g', 'h',
      	        'i', 'j', 'k', 'l', 'm', 'n', 'o', 'p',
      	        'q', 'r', 's', 't', 'u', 'v', 'w', 'x',
      	        'y', 'z', 'A', 'B', 'C', 'D', 'E', 'F',
      	        'G', 'H', 'I', 'J', 'K', 'L', 'M', 'N',
      	        'O', 'P', 'Q', 'R', 'S', 'T', 'U', 'V',
      	        'W', 'X', 'Y', 'Z', ' '
        };
      
         private final static char base64Array [] = {
             'A', 'B', 'C', 'D', 'E', 'F', 'G', 'H',
             'I', 'J', 'K', 'L', 'M', 'N', 'O', 'P',
             'Q', 'R', 'S', 'T', 'U', 'V', 'W', 'X',
             'Y', 'Z', 'a', 'b', 'c', 'd', 'e', 'f',
             'g', 'h', 'i', 'j', 'k', 'l', 'm', 'n',
             'o', 'p', 'q', 'r', 's', 't', 'u', 'v',
             'w', 'x', 'y', 'z', '0', '1', '2', '3',
             '4', '5', '6', '7', '8', '9', '+', '/'
        };
      }

This will cause Dolos to exhibit the following peculiar behavior:

This is caused by a repeating sequence in the tokens, creating a fragment for each combination of these sequences. This results in bad performance and bad user experience.

This is partially fixed by #819, but not completely. Since the above example will also cause non-overlapping sequences.