Upcoming changes on datanomer/datagrepper

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hey folks,

One of the initiatives the CPE team has taken over this quarter is updating and improving the performances of datagrepper/datanomer.
That work is based upon the investigation done earlier in the year whose results can be found at: https://fedora-arc.readthedocs.io/en/latest/datanommer_datagrepper/index.html

One important item to note is that we will introduce a default value for the `delta` argument.
Currently, if you do not specify one, datagrepper will not limit its queries by time, which is very resource intensive and often so much so that you do not get any results back.
By setting a default `delta` argument we can ensure that just browsing the UI does not throw random time-out errors and increase the performance of some of the queries.

However, this is a **non-backward compatible change**!

If you have scripts relying on the fact that the messages returned can be of any date, they will break once the default delta is in place. You should thus adjust them to specify a delta (which will override the default one).

The default delta will likely be set to "one day" but that's not fixed yet. Once it has been fully confirmed we'll update again, so please treat this as an FYI, but also start looking at your scripts. Specifying the `delta` today won't break the current behavior and will ensure they keep working once the change has landed.

Secondly, the grouped feature [2] will be dropped as it's not supported in the new library. If you're using it, please reach out to us so we can figure out mitigation plans.

Enjoy Nest if you're attending and have a nice weekend!

Cheers,

Ant

[1] https://fedora-arc.readthedocs.io/en/latest/datanommer_datagrepper/index.html
[2] See the section "Formatting arguments" at: https://apps.fedoraproject.org/datagrepper/reference

--

Ant Carroll

Associate Manager, Software Engineering

Red Hat Waterford

Communications House

Cork Road, Waterford City

ancarrol@xxxxxxxxxx   
M: +353876213163    
 IM: ancarrol

_______________________________________________
infrastructure mailing list -- infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to infrastructure-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure

[Index of Archives]     [Fedora Development]     [Fedora Users]     [Fedora Desktop]     [Fedora SELinux]     [Yosemite News]     [KDE Users]

  Powered by Linux