Commit Graph

1057 Commits

Author SHA1 Message Date
Jonathan Shook
36a233eaa1 removed doc name prepending on block tag names 2023-10-05 20:05:03 -05:00
yabinmeng
b7dd97cbfb Update the built-in cql-vector workload and fix an issue of not correctly setting the cycle count to the stride count if the cycle count is not specified explicitly. 2023-10-04 20:34:05 -05:00
Jonathan Shook
a57e967930 provide threads metric 2023-09-28 14:58:26 -05:00
Jonathan Shook
96269785e2 metric name fix 2023-09-28 14:58:26 -05:00
Jonathan Shook
39f2a55e06 add verifier timer 2023-09-28 14:58:26 -05:00
Jonathan Shook
e9cf289787 provide a fully constructed metric type which can be registered as-is 2023-09-28 14:58:26 -05:00
Jonathan Shook
be0fbf6d66 minor fixes 2023-09-22 12:56:00 -05:00
Jonathan Shook
112ad332cd fixups and package structure updates 2023-09-11 13:20:52 -05:00
Jonathan Shook
186e87ac1b enable label filtering and validation 2023-09-09 20:31:15 -05:00
Jonathan Shook
31a75cd2e9 hoist tristate filter base to nb-api 2023-09-09 20:31:10 -05:00
Jonathan Shook
bf3e9636c0 remove confusing type and dimensions labeling methods 2023-09-09 20:31:04 -05:00
Jonathan Shook
be396cceb2 make recycles semantics and format consistent with cycles 2023-09-09 16:03:40 -05:00
Jonathan Shook
c55213da7c enable direct cycle progress metrics 2023-09-09 00:13:33 -05:00
Jonathan Shook
13660d7123 provide completion metrics 2023-09-08 20:07:49 -05:00
Jonathan Shook
56c687380e provide cycle value metric 2023-09-08 20:07:47 -05:00
Jonathan Shook
a33800f252
Merge pull request #1519 from nosqlbench/nosqlbench-1517-namefixes
more metric name fixes for prom expo form
2023-09-07 11:26:38 -05:00
Jonathan Shook
55ef2cff4a remove result size from base op 2023-09-07 10:03:24 -05:00
Jonathan Shook
23cccdfbfe more metric name fixes for prom expo form 2023-09-07 09:59:06 -05:00
Jonathan Shook
f0d0f20898 more metrics sanitization 2023-08-30 00:57:46 -05:00
Jonathan Shook
7633a45ae6 nosqlbench-1478 sanitize all labels which are used according to the openmetrics exposition format... 2023-08-28 16:15:28 -05:00
Jonathan Shook
5ae230ebce allow labels to be provided at the activity level 2023-08-28 16:15:24 -05:00
Jonathan Shook
5207fc6b45 cleanups and formatting 2023-08-28 16:15:14 -05:00
Jonathan Shook
96873acca1 fix tries metrics off-by-one 2023-08-28 16:14:54 -05:00
Jonathan Shook
999aea64eb sanitize metric labels and metric family name values 2023-08-28 16:14:43 -05:00
Jonathan Shook
497432137e recall computation 2023-08-17 18:07:04 -05:00
Jonathan Shook
d1725da0cb merge fixups 2023-07-25 12:06:25 -05:00
Jonathan Shook
76b740f8ab add cqlvector examples 2023-07-25 11:50:51 -05:00
Jonathan Shook
bbc5844671 package refactoring 2023-07-25 11:50:39 -05:00
Jonathan Shook
ad58a7959a engine and nb api changes for vector branch 2023-07-25 11:50:22 -05:00
Jonathan Shook
49b5947895 copyright updates 2023-07-25 11:50:14 -05:00
Jonathan Shook
4fdd39fff9 adapters api changes for vector branch and other fixes 2023-07-25 11:32:30 -05:00
Jeff Banks
2ab97d9e5e
Snyk remediation 07.06.2023 (#1388)
Includes:
* docker-java-core upgrade
* engine-docker cve fixes
* removed engine-rest module
* updated deps for high and med. CVEs
* pgrade to commons-collections4
* migrate specific vers to mvn-defaults
2023-07-18 14:43:19 -05:00
Jeff Banks
27644273fd
Bypass SSL validation option (#1289)
* Bypass ssl validation option
* TrustManager inclusion
2023-07-06 11:32:22 -05:00
Jonathan Shook
b324c59c11 remove package element from log4j2 configs 2023-06-06 09:03:13 -05:00
Jonathan Shook
11ad67d75f remove phase and phase limiter 2023-05-18 14:56:56 -05:00
kijanowski
c48dcb1848 Do not pretty-print the result object in case of a verification error 2023-05-17 14:37:55 +02:00
kijanowski
63cfa5d85d Resolve merge conflicts 2023-05-17 12:22:58 +02:00
kijanowski
fb8f70bf9a Resolve merge conflicts 2023-05-17 11:51:18 +02:00
kijanowski
8f7ebbf0a3 Merge remote-tracking branch 'origin/main' into jk-test-eng-95-expected-result-verification
# Conflicts:
#	adapters-api/src/main/java/io/nosqlbench/engine/api/activityimpl/BaseOpDispenser.java
#	engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/errorhandling/modular/NBErrorHandlerTest.java
#	engine-cli/src/main/java/io/nosqlbench/engine/cli/NBCLIOptions.java
2023-05-17 11:21:11 +02:00
kijanowski
bda0790bd4 Code review adjustments 2023-05-17 09:47:07 +02:00
kijanowski
2e47715ce7 Code review adjustments 2023-05-12 16:51:38 +02:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook
a8ce71f9e7 Comments on branch. You can truncate this commit after reading. 2023-05-08 12:31:01 -05:00
kijanowski
be9b97e2cd Verify expected result with MVEL 2023-05-05 13:34:25 +02:00
Jeff Banks
388ece75f7
MongoDB Adapter fix and updates for scenarios (#1196)
* Updates for mongodb adapter; fix connection usage on cli

* Reduce the cycles for test w/ sporadic failures

* Removed redundant '-> string'

* Removed state tracking and cleanup

* Space cache capture and connection management

* Mongo client management w/ connection

* Remove unused getData()

* Removed debug entry no longer required
2023-04-04 16:09:00 -05:00
Jonathan Shook
d9e49d7292
allow spaces in named scenario templates (#1083) 2023-02-15 13:59:07 -06:00
Jonathan Shook
21e73984a9 implement better warning message for unused default driver 2023-02-14 17:49:06 -06:00
Jonathan Shook
46890232e2 verified via UAT; Test would be difficult without elaborate scaffolding; closes #994 2023-02-10 22:46:43 -06:00
Jonathan Shook
a0e8a56a6a properly filter log4j2-test 2023-02-10 22:45:50 -06:00
Jonathan Shook
70408621dd nosqlbench-1071 NBIO should favor finding exactly specified file path as a short circuit 2023-02-10 10:20:45 -06:00