forked from chaoss/grimoirelab-elk
-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy pathNEWS
243 lines (191 loc) · 10 KB
/
NEWS
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
# Releases
## grimoire-elk 0.103.0-rc.4 - (2022-09-07)
**New features:**
* Configurable study aliases\
Before this fix, the name of the study aliases was hard coded. From
now on, these values can be configured by passing them as parameters.
* git-branches study skip uncloned repo\
The git-branches study skips the repository when it is not cloned and
continues with the next one.
* Entry points to support enriching plugin mechanism\
This plugin mechanism allows ELK to use third-party enriching
backends. Developers only need to include the next snippet in their
package configuration and ELK will import them as any other core
backend. ``` entry_points={"grimoire_elk": "mybackend =
package.subpackage:get_connectors"}, ``` **NOTE**: In the previous
example, `get_connectors` is a function that returns the backend
classes needed to enrich a datasource. Take the next snipped as an
example: ``` def get_connectors(): return {"backend": [MyBackend,
MyBackendOcean, MyBackendEnrich, MyBackendCommand]} ```
**Bug fixes:**
* [raw/slack] Handle fields in "data.file"\
Avoid the 'Failed to insert data to ES' error when a document contains
at least one immense term in 'data.file' (whose UTF8 encoding is
longer than the max length 32766).
## grimoire-elk 0.103.0-rc.3 - (2022-08-23)
**New features:**
* Configurable study aliases\
Before this fix, the name of the study aliases was hard coded. From
now on, these values can be configured by passing them as parameters.
* Entry points to support enriching plugin mechanism\
This plugin mechanism allows ELK to use third-party enriching
backends. Developers only need to include the next snippet in their
package configuration and ELK will import them as any other core
backend. ``` entry_points={"grimoire_elk": "mybackend =
package.subpackage:get_connectors"}, ``` **NOTE**: In the previous
example, `get_connectors` is a function that returns the backend
classes needed to enrich a datasource. Take the next snipped as an
example: ``` def get_connectors(): return {"backend": [MyBackend,
MyBackendOcean, MyBackendEnrich, MyBackendCommand]} ```
**Bug fixes:**
* [raw/slack] Handle fields in "data.file"\
Avoid the 'Failed to insert data to ES' error when a document contains
at least one immense term in 'data.file' (whose UTF8 encoding is
longer than the max length 32766).
## grimoire-elk 0.103.0-rc.2 - (2022-07-22)
**New features:**
* Entry points to support enriching plugin mechanism\
This plugin mechanism allows ELK to use third-party enriching
backends. Developers only need to include the next snippet in their
package configuration and ELK will import them as any other core
backend. ``` entry_points={"grimoire_elk": "mybackend =
package.subpackage:get_connectors"}, ``` **NOTE**: In the previous
example, `get_connectors` is a function that returns the backend
classes needed to enrich a datasource. Take the next snipped as an
example: ``` def get_connectors(): return {"backend": [MyBackend,
MyBackendOcean, MyBackendEnrich, MyBackendCommand]} ```
* Configurable study aliases\
Before this fix, the name of the study aliases was hard coded. From
now on, these values can be configured by passing them as parameters.
**Bug fixes:**
* [raw/slack] Handle fields in "data.file"\
Avoid the 'Failed to insert data to ES' error when a document contains
at least one immense term in 'data.file' (whose UTF8 encoding is
longer than the max length 32766).
## grimoire-elk 0.103.0-rc.1 - (2022-07-21)
**New features:**
* Entry points to support enriching plugin mechanism\
This plugin mechanism allows ELK to use third-party enriching
backends. Developers only need to include the next snippet in their
package configuration and ELK will import them as any other core
backend. ``` entry_points={"grimoire_elk": "mybackend =
package.subpackage:get_connectors"}, ``` **NOTE**: In the previous
example, `get_connectors` is a function that returns the backend
classes needed to enrich a datasource. Take the next snipped as an
example: ``` def get_connectors(): return {"backend": [MyBackend,
MyBackendOcean, MyBackendEnrich, MyBackendCommand]} ```
* Configurable study aliases\
Before this fix, the name of the study aliases was hard coded. From
now on, these values can be configured by passing them as parameters.
**Bug fixes:**
* [raw/slack] Handle fields in "data.file"\
Avoid the 'Failed to insert data to ES' error when a document contains
at least one immense term in 'data.file' (whose UTF8 encoding is
longer than the max length 32766).
## GrimoireELK 0.102.0 - (2022-06-24)
**Bug fixes:**
* Poetry build version updated\
The current version of the `poetry` builder was old and caused some
problems when installing packages in developer mode. With this new
version, it's possible to install ELK in developer or editable mode
without using `setuptools` files (i.e. `setup.cfg` and `setup.py`).
**Others:**
* GrimoireLab dependencies update\
Dependencies have been updated to use the latest versions of
GrimoireLab packages:
- grimoirelab-toolkit >= 0.3
- perceval >= 0.19
- perceval-mozilla >= 0.3
- perceval-opnfv >=0.2
- perceval-puppet >= 0.2
- perceval-weblate >= 0.2
- graal >= 0.3
- cereslib >= 0.3
## GrimoireELK 0.101.1 - (2022-06-03)
**Bug fixes:**
* Pair programming regular expression improvement\
The regular expression to detect pair programming authors in git
datasource has been improved adding more connectors. The following
list shows the current connectors: - `[aA][nN][dD]` - `&` - `+`
* Fix fetching authors with min and max dates\
The old query only returns 10000 items due to ElasticSearch and
OpenSearch now use `composite` aggregation to paginate all buckets.
## GrimoireELK 0.101.0 - (2022-06-03)
**New features:**
* Anonymize parameters\
A new API function `anonymize_params(params)` allows to anonymize a
list of parameters that developers might consider secrets. It will
only take effect for those parameters which their names are defined on
`SECRET_PARAMETERS` constant.
* Dependencies file for development\
Include a new requirements.txt file to install the development version
from the repositories.
* Support to add identities to SortingHat from Enrich class\
New methods `add_identities` and `add_identity` are available on
`Enrich` class to add new identities to a `SortingHat` database.
Libraries using `elk` won't need to use `sortinghat` library to store
new identities while enriching items.
* Collect and enrich confluence by spaces\
Users can collect and enrich Confluence data from specific spaces
only, adding the option `--spaces=[SPACE1, SPACE2, ...]` to their
`projects.json`. The following example shows how to collect and to
enrich data from only the `DEV` and `SUPP` spaces only. ``` {
"project": { "confluence": [ "http://example.com
--spaces=[DEV, SUPP]" ] } } ```
* Add demographic study to mattermost\
Add the demographic study to the mattermost data source.
**Bug fixes:**
* Skip sources with wrong arguments\
Sources won't interrupt collection or enrichment processes when any of
their arguments are invalid. Instead, they will be skipped.
* Git fix 'is_git_commit_multi_author'\
This fixes the `is_git_commit_multi_author` field when the commit has
more than one author and `pair-programming` is enabled. This is
important for calculating `pair_programming_*` values.
* SortingHat as a required package\
SortingHat is required for running grimoireelk but it was set as an
extra dependency. From now on sortinghat is always installed with
grimoireelk.
* Confluence credentials not stored in raw indexes\
Credentials for Confluence datasource were stored in raw indices as
part of the URL. For now on, credentials that are part of URLs are
removed before any data is stored.
**Feature removals:**
* Drop Python 3.6 support\
Python 3.6 reached the end of life at the end of 2021. This means it
won't receive new updates or patches to fix security issues.
Therefore, this package will only work with Python >= 3.7 from now on.
* FINOS Meeting backend removed\
FINOS Meeting backend is not supported anymore. The Perceval backend
was archived in Bitergia repository so it shouldn't be part of the
core anymore because it's software not maintained.
## GrimoireELK 0.75.0 - (2020-06-20)
**New features:**
* Add support for RocketChat (#876)\
Added support for collecting and enriching the messages of RocketChat
instances. The schema of the enriched data has been included. Tests
have been added too. This work is a community contribution, which has
been possible thanks to Obaro Ikoh and Animesh Kumar.
## GrimoireELK 0.72.0 - (2020-04-24)
**New features:**
* code complexity per language (#782)\
Add language differentiation to code complexity analysis (Cocom)
* Add support for Gitter (#820)\
Added support for creating raw and enriched indexes of message from
Gitter. The visualizations and tests for extracted data have also been
added.
* Add support for Pagure (#821)\
Added support for creating raw and enriched indexes of Pagure. Issued
from a Pagure repository are enriched. Additionally, the comments of
these issues (if present) are also enriched. The schema for this
backend has also been added. Tests have been included accordingly.
* Store and process GitHub events\
ELK is enhanced to process and store events collected from the GitHub
API. The events currently supported are - LabeledEvent -
UnlabeledEvent - AddedToProjectEvent - MovedColumnsInProjectEvent -
RemovedFromProjectEvent - CrossReferencedEvent - ClosedEvent
**Bug fixes:**
* Fix missing geolocation in Meetup event (#826)\
This fix allows to process Meetup events for which geolocation
information isn't provided. For these events, the corresponding
attribute in the enriched index (`venue_geolocation`) is set to None.