Commit Graph

637 Commits

Author SHA1 Message Date
Jonathan Shook
137ce31136 findmax 80% ready 2023-10-23 08:42:19 -05:00
Jonathan Shook
bff86b5525 bursty cycle rate test online 2023-10-23 08:42:19 -05:00
Jonathan Shook
9978d50d7e improving optimo sampler and rates 2023-10-23 08:42:19 -05:00
Jonathan Shook
9e91a6201d incremental progress 2023-10-23 08:42:19 -05:00
Jonathan Shook
f099fa0840 fixup license files 2023-10-23 08:42:19 -05:00
Mark Wolters
28c4446a13 shutdown hook plugin 2023-10-23 08:42:19 -05:00
Mark Wolters
6e496f8e7b Http and S3 plugns 2023-10-23 08:42:19 -05:00
Mark Wolters
2771ef60e9 fixing histolog classes 2023-10-23 08:42:19 -05:00
Mark Wolters
bfd15818f9 added hdr histo logging builder 2023-10-23 08:42:19 -05:00
Mark Wolters
dc06437d6e Added BobyqaOptimizer and CsvOutputWriter as builders and removed them from plugins 2023-10-23 08:42:19 -05:00
Mark Wolters
3bc5115b17 1st cut plugin adapters 2023-10-23 08:42:19 -05:00
Mark Wolters
2986412036 fixup of csv reporter, removed script context parameter 2023-10-23 08:42:19 -05:00
Mark Wolters
71103041f9 revamping plugin extensions 2023-10-23 08:42:19 -05:00
Jonathan Shook
9daf06cd62 rehome all metrics construction patterns, remove ActivityMetrics 2023-10-23 08:41:40 -05:00
Jonathan Shook
57db140a94 removed all ActivityMetrics constructions 2023-10-23 08:41:40 -05:00
Jonathan Shook
aed2ee8d58 include updated functions in relevancy computations 2023-10-09 11:22:00 -05:00
Jonathan Shook
17fb1f54c3 build fixes 2023-10-05 18:23:27 -05:00
Jonathan Shook
469985de6e update recall relevant set 2023-10-05 18:23:27 -05:00
Jonathan Shook
d2c0ef9e52 simplify newRelevancyMeasures signature 2023-10-04 10:32:02 -05:00
Jonathan Shook
b3b361b30a quick fix for missing labels in measures 2023-09-11 18:39:26 -05:00
Jonathan Shook
112ad332cd fixups and package structure updates 2023-09-11 13:20:52 -05:00
Jonathan Shook
bf3e9636c0 remove confusing type and dimensions labeling methods 2023-09-09 20:31:04 -05:00
Jonathan Shook
1fdc2b3aa3 fix operator precedence bug in F1 computation 2023-09-09 16:03:43 -05:00
Jonathan Shook
340e5ac483 miscellaneous fixes for relevancy metrics 2023-09-08 17:13:56 -05:00
Jonathan Shook
ea847fed37 make using relevancy measures in verifiers easy and complete 2023-09-08 15:01:59 -05:00
Jonathan Shook
e17d581578 testing fixes 2023-09-08 11:25:07 -05:00
Jonathan Shook
aa460be622 remove commented code 2023-09-08 11:09:23 -05:00
Jonathan Shook
e515d3fe15 remove extraneous mask functions 2023-09-08 11:08:13 -05:00
Jonathan Shook
cf3082259d remove extraneous mask functions 2023-09-08 11:06:38 -05:00
Jonathan Shook
64b46ca054 improve functions for readability and safety 2023-09-08 10:59:08 -05:00
Jonathan Shook
8801207ebc separate long tests 2023-09-08 09:19:56 -05:00
Jonathan Shook
4484d22ff1 add (more) correct MAP implementation 2023-09-08 09:17:39 -05:00
Jonathan Shook
e7b6ee9164 Merge branch 'main' into nosqlbench-1522-moremath 2023-09-07 13:23:18 -05:00
Jonathan Shook
4fa99daf68 implement reciprocal rank 2023-09-07 11:25:29 -05:00
Jonathan Shook
31fb6eae7d minor optimization on ary ctors 2023-09-07 10:54:44 -05:00
Jonathan Shook
bc3ebfaa15 add F1 functions 2023-09-07 10:53:08 -05:00
Jonathan Shook
8eb3620caf support recall@K and precision@K within actual retrieved data 2023-09-07 10:04:42 -05:00
Jonathan Shook
f579fb638c fix bad naming refactoring 2023-08-31 16:42:45 -05:00
Jonathan Shook
a98ff2e465 modularize methods for verifiers 2023-08-31 16:10:53 -05:00
Jonathan Shook
497432137e recall computation 2023-08-17 18:07:04 -05:00
Jonathan Shook
745d203766 align test name to file 2023-08-16 15:44:29 -05:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook
1eead1add8 centralize jacoco template for reconfiguration 2023-01-26 23:32:15 -06:00
Jonathan Shook
f63c7aeadb replace CI+CD friendly revision 2023-01-19 16:54:06 -06:00
nb-droid
a49a9e9380 [maven-release-plugin] prepare for next development iteration 2023-01-13 19:51:57 +00:00
nb-droid
67aeba7a34 [maven-release-plugin] prepare release nosqlbench-5.17.0 2023-01-13 19:51:55 +00:00
Jonathan Shook
e04eef814c temporary work-around for release plugin incompatibility 2023-01-13 13:19:35 -06:00
Jonathan Shook
31478ae591
Nosqlbench 904 version5 (#908)
* Ignore .flattened-pom.xml files from the CI-friendly flattening

* Allow newer versions to squelch version warning

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unecesary indirection in poms which break version intellisense

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unnecessary indirection in poms which break version intellisense

* deleting commented code
* version dep updates
* streamline LUT trimming options
* use a more explicit regex substituion technique
* specify updated okhttp version
* update resources plugin to bugfixed version
* exclude filtering for problematic files
2023-01-12 12:48:50 -06:00
Jeff Banks
9c25ad9336
Code coverage integration (#897)
* Jacoco introduced for full reporting of test coverage.
* All modules included in scope.
* Ability to scope to module OR overall reporting.
* Ability to run in dev environment and bypass as needed w/out GHA.
2023-01-12 11:25:40 -06:00
nb-droid
6e93468632 [maven-release-plugin] prepare for next development iteration 2023-01-09 19:36:28 +00:00