Commit Graph

622 Commits

Author SHA1 Message Date
Jonathan Shook
aed2ee8d58 include updated functions in relevancy computations 2023-10-09 11:22:00 -05:00
Jonathan Shook
17fb1f54c3 build fixes 2023-10-05 18:23:27 -05:00
Jonathan Shook
469985de6e update recall relevant set 2023-10-05 18:23:27 -05:00
Jonathan Shook
d2c0ef9e52 simplify newRelevancyMeasures signature 2023-10-04 10:32:02 -05:00
Jonathan Shook
b3b361b30a quick fix for missing labels in measures 2023-09-11 18:39:26 -05:00
Jonathan Shook
112ad332cd fixups and package structure updates 2023-09-11 13:20:52 -05:00
Jonathan Shook
bf3e9636c0 remove confusing type and dimensions labeling methods 2023-09-09 20:31:04 -05:00
Jonathan Shook
1fdc2b3aa3 fix operator precedence bug in F1 computation 2023-09-09 16:03:43 -05:00
Jonathan Shook
340e5ac483 miscellaneous fixes for relevancy metrics 2023-09-08 17:13:56 -05:00
Jonathan Shook
ea847fed37 make using relevancy measures in verifiers easy and complete 2023-09-08 15:01:59 -05:00
Jonathan Shook
e17d581578 testing fixes 2023-09-08 11:25:07 -05:00
Jonathan Shook
aa460be622 remove commented code 2023-09-08 11:09:23 -05:00
Jonathan Shook
e515d3fe15 remove extraneous mask functions 2023-09-08 11:08:13 -05:00
Jonathan Shook
cf3082259d remove extraneous mask functions 2023-09-08 11:06:38 -05:00
Jonathan Shook
64b46ca054 improve functions for readability and safety 2023-09-08 10:59:08 -05:00
Jonathan Shook
8801207ebc separate long tests 2023-09-08 09:19:56 -05:00
Jonathan Shook
4484d22ff1 add (more) correct MAP implementation 2023-09-08 09:17:39 -05:00
Jonathan Shook
e7b6ee9164 Merge branch 'main' into nosqlbench-1522-moremath 2023-09-07 13:23:18 -05:00
Jonathan Shook
4fa99daf68 implement reciprocal rank 2023-09-07 11:25:29 -05:00
Jonathan Shook
31fb6eae7d minor optimization on ary ctors 2023-09-07 10:54:44 -05:00
Jonathan Shook
bc3ebfaa15 add F1 functions 2023-09-07 10:53:08 -05:00
Jonathan Shook
8eb3620caf support recall@K and precision@K within actual retrieved data 2023-09-07 10:04:42 -05:00
Jonathan Shook
f579fb638c fix bad naming refactoring 2023-08-31 16:42:45 -05:00
Jonathan Shook
a98ff2e465 modularize methods for verifiers 2023-08-31 16:10:53 -05:00
Jonathan Shook
497432137e recall computation 2023-08-17 18:07:04 -05:00
Jonathan Shook
745d203766 align test name to file 2023-08-16 15:44:29 -05:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook
1eead1add8 centralize jacoco template for reconfiguration 2023-01-26 23:32:15 -06:00
Jonathan Shook
f63c7aeadb replace CI+CD friendly revision 2023-01-19 16:54:06 -06:00
nb-droid
a49a9e9380 [maven-release-plugin] prepare for next development iteration 2023-01-13 19:51:57 +00:00
nb-droid
67aeba7a34 [maven-release-plugin] prepare release nosqlbench-5.17.0 2023-01-13 19:51:55 +00:00
Jonathan Shook
e04eef814c temporary work-around for release plugin incompatibility 2023-01-13 13:19:35 -06:00
Jonathan Shook
31478ae591
Nosqlbench 904 version5 (#908)
* Ignore .flattened-pom.xml files from the CI-friendly flattening

* Allow newer versions to squelch version warning

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unecesary indirection in poms which break version intellisense

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unnecessary indirection in poms which break version intellisense

* deleting commented code
* version dep updates
* streamline LUT trimming options
* use a more explicit regex substituion technique
* specify updated okhttp version
* update resources plugin to bugfixed version
* exclude filtering for problematic files
2023-01-12 12:48:50 -06:00
Jeff Banks
9c25ad9336
Code coverage integration (#897)
* Jacoco introduced for full reporting of test coverage.
* All modules included in scope.
* Ability to scope to module OR overall reporting.
* Ability to run in dev environment and bypass as needed w/out GHA.
2023-01-12 11:25:40 -06:00
nb-droid
6e93468632 [maven-release-plugin] prepare for next development iteration 2023-01-09 19:36:28 +00:00
nb-droid
d1b9c91e44 [maven-release-plugin] prepare release nosqlbench-4.17.32 2023-01-09 19:36:26 +00:00
Jonathan Shook
6731937c96 modify logger calls for computable messages via closures 2022-12-21 19:37:36 -06:00
Jonathan Shook
6c8782842d change tests System.out calls to use logger directly 2022-12-20 23:52:37 -06:00
Jonathan Shook
c076b1079c make http extension docs distinct from http adapter docs 2022-12-20 20:02:28 -06:00
nb-droid
02522a468e [maven-release-plugin] prepare for next development iteration 2022-12-07 23:30:05 +00:00
nb-droid
fb131e9b09 [maven-release-plugin] prepare release nosqlbench-4.17.31 2022-12-07 23:30:02 +00:00
nb-droid
d9acf85597 [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
nb-droid
098455410d [maven-release-plugin] prepare release nosqlbench-4.17.30 2022-09-30 15:58:43 +00:00
nb-droid
19faf3c0ae [maven-release-plugin] prepare for next development iteration 2022-09-29 17:29:14 +00:00
nb-droid
20a5ab4234 [maven-release-plugin] prepare release nosqlbench-4.17.29 2022-09-29 17:29:12 +00:00
nb-droid
5f72b6c0d8 [maven-release-plugin] prepare for next development iteration 2022-09-21 19:27:40 +00:00
nb-droid
b52e6a4774 [maven-release-plugin] prepare release nosqlbench-4.17.28 2022-09-21 19:27:38 +00:00
nb-droid
60b8ccc200 [maven-release-plugin] prepare for next development iteration 2022-08-25 21:55:33 +00:00
nb-droid
6e8ee26cf9 [maven-release-plugin] prepare release nosqlbench-4.17.27 2022-08-25 21:55:31 +00:00
nb-droid
32ca3657ca [maven-release-plugin] prepare for next development iteration 2022-08-24 22:04:47 +00:00