[qm-elk] Add support for QM data enrichment

[vchrombie]

This PR contains gitlabqm and gitqm enrichers.

metrics discussion for gitqm: vchrombie/gsoc#9
output example for gitqm: gist-file-gitqm

micro-mordred configurations

project.json

{
    "potioncraft" : {
        "gitqm": [
            "https://github.com/vchrombie/gsoc.git"
        ],
        "gitlabqm:issue": [
            "https://gitlab.com/amfoss/cms-mobile"
        ],
        "gitlabqm:merge": [
            "https://gitlab.com/amfoss/cms-mobile"
        ]
    }
}

setup.cfg

[gitqm]
raw_index = gitqm_raw
enriched_index = gitqm
category = commit

[gitlabqm:issue]
api-token = xxxx
raw_index = gitlabqm-issues_raw
enriched_index = gitlabqm
sleep-for-rate = true
category = issue
no-archive = true

[gitlabqm:merge]
api-token = xxxx
raw_index = gitlabqm-merge_raw
enriched_index = gitlabqm
sleep-for-rate = true
category = merge_request
no-archive = true

[vchrombie]

Hi @valeriocos
I have completed working on the enricher but I had one doubt in the current implementation regarding to files_changed.

I think it is ready for review, please have a look when you are free. 😄

[coveralls]

Pull Request Test Coverage Report for Build 2314

• 0 of 0 changed or added relevant lines in 0 files are covered.
• 36 unchanged lines in 1 file lost coverage.
• Overall coverage decreased (-1.5%) to 80.663%

---

Files with Coverage Reduction	New Missed Lines	%
/home/travis/build/chaoss/grimoirelab-elk/grimoire_elk/utils.py	36	66.42%

Totals
Change from base Build 2313:	-1.5%
Covered Lines:	8368
Relevant Lines:	10374

---

💛 - Coveralls

[valeriocos]

Hi @vchrombie , the PR looks great, good job! I tested the PR on https://gitlab.com/Bitergia/devops/indexwarrior. I paid special attention to git, and compare the output of the data retrieved with git log --pretty=format:"%h%x09%an%x09%cd%x09%s" --all with the one available on the enriched indexes.

I left some comments mostly around the timezone. Please check them when you have time.

It would be convenient to add the schema of the quality models data at https://github.com/chaoss/grimoirelab-elk/tree/master/schema and the tests.

Thanks

EDIT: I forgot to add one of the things we discussed in the last GSoC meeting. The QM enrichers should go to a specific module, as similarly done for the SCMS ones. On the other hand, the tests for the QM enrichers don't need to be separated from the rest.

[vchrombie]

Hi @valeriocos
Thanks for the review. I have checked the comments. I have faced such issues while implementing the pipermailqm enricher. I fixed it. Updating the normalizing date function will fix most of the things.

EDIT: I forgot to add one of the things we discussed in the last GSoC meeting. The QM enrichers should go to a specific module, as similarly done for the SCMS ones. On the other hand, the tests for the QM enrichers don't need to be separated from the rest.

Sure, I will implement all these things and produce the next PR as an extension of this PR soon.

[vchrombie]

closing this PR, in reference to #926