Commit Graph

923 Commits

Author SHA1 Message Date
Jonathan Shook
bf3e9636c0 remove confusing type and dimensions labeling methods 2023-09-09 20:31:04 -05:00
Jonathan Shook
be396cceb2 make recycles semantics and format consistent with cycles 2023-09-09 16:03:40 -05:00
Jonathan Shook
56c687380e provide cycle value metric 2023-09-08 20:07:47 -05:00
Jonathan Shook
f579fb638c fix bad naming refactoring 2023-08-31 16:42:45 -05:00
Jonathan Shook
a98ff2e465 modularize methods for verifiers 2023-08-31 16:10:53 -05:00
Jonathan Shook
8062e5b3ac Merge branch 'main' into jshook/update-paging-fix 2023-08-30 01:11:53 -05:00
Jonathan Shook
6eb93419d8 impl direct activity shutdown hook for annotations closure 2023-08-30 00:57:41 -05:00
Jonathan Shook
9cf9b6e91c cleanup annotation details 2023-08-30 00:57:34 -05:00
Dave Fisher
e69224afb6 Add additional configuration options for PromPush 2023-08-29 15:22:18 -07:00
Jonathan Shook
0812f15ea2 add missing test logger config 2023-08-28 16:15:31 -05:00
Jonathan Shook
7633a45ae6 nosqlbench-1478 sanitize all labels which are used according to the openmetrics exposition format... 2023-08-28 16:15:28 -05:00
Jonathan Shook
5207fc6b45 cleanups and formatting 2023-08-28 16:15:14 -05:00
Jonathan Shook
6c4833d48d differentiate dimension and instance labels 2023-08-28 16:15:10 -05:00
Jonathan Shook
497432137e recall computation 2023-08-17 18:07:04 -05:00
Jonathan Shook
745d203766 align test name to file 2023-08-16 15:44:29 -05:00
Jonathan Shook
145b02ebd4 re-enable nashorn compat, which converts .property to .getProperty() where needed 2023-07-27 12:39:12 -05:00
Jonathan Shook
23aba88ee0 engine and runtime updates for vector branch 2023-07-25 11:50:28 -05:00
Jonathan Shook
b324c59c11 remove package element from log4j2 configs 2023-06-06 09:03:13 -05:00
Jonathan Shook
30992793ed clarify multiple scenario entry points 2023-05-18 14:58:08 -05:00
Jonathan Shook
694e7949de copyright 2023-05-18 14:57:58 -05:00
Jonathan Shook
dffdd70bed scaffold labels into components 2023-05-18 14:57:42 -05:00
Jonathan Shook
d2c7d1a32f improved error messages 2023-05-18 14:57:04 -05:00
kijanowski
fb8f70bf9a Resolve merge conflicts 2023-05-17 11:51:18 +02:00
kijanowski
8f7ebbf0a3 Merge remote-tracking branch 'origin/main' into jk-test-eng-95-expected-result-verification
# Conflicts:
#	adapters-api/src/main/java/io/nosqlbench/engine/api/activityimpl/BaseOpDispenser.java
#	engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/errorhandling/modular/NBErrorHandlerTest.java
#	engine-cli/src/main/java/io/nosqlbench/engine/cli/NBCLIOptions.java
2023-05-17 11:21:11 +02:00
kijanowski
bda0790bd4 Code review adjustments 2023-05-17 09:47:07 +02:00
kijanowski
2e47715ce7 Code review adjustments 2023-05-12 16:51:38 +02:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook
70408621dd nosqlbench-1071 NBIO should favor finding exactly specified file path as a short circuit 2023-02-10 10:20:45 -06:00
Jonathan Shook
c45e3ff964 deprecate yaml->workload and type->driver, and make loader more robust 2023-02-07 18:20:49 -06:00
Jonathan Shook
5626430de8 disable unused edge case test until it is well defined 2023-02-06 12:07:25 -06:00
Jonathan Shook
d3d7e36bbf removed extraneous test 2023-02-06 00:20:25 -06:00
Jonathan Shook
ce54eced7e logically isolate concurrent concurrency tests 2023-02-05 21:20:10 -06:00
Jonathan Shook
9fc0530c17 move threadpool init within Callable flow 2023-02-05 20:30:57 -06:00
Jonathan Shook
edd3de63de improve testing time 2023-02-05 20:30:37 -06:00
Jonathan Shook
4e70eb7680 allow dryrun to be multi-modal 2023-02-05 20:29:52 -06:00
Jonathan Shook
4f827c8031 allow startActivity to be re-entrant with blocking 2023-02-05 20:28:34 -06:00
Jonathan Shook
8995f5dfef improvements to motor state model and activity 2023-02-03 17:07:46 -06:00
Jonathan Shook
9d7f92edb4
Merge pull request #970 from nosqlbench/nosqlbench-968-unhookhook
unregister scenario shutdown hook correctly
2023-02-01 10:59:12 -06:00
Jonathan Shook
3d7eebc123 include Errored state into activity event handling logic 2023-01-31 23:12:18 -06:00
Jonathan Shook
5a648671d3 nosqlbench-968 Scenario shutdown hook not being unregistered correctly 2023-01-31 23:00:07 -06:00
Jonathan Shook
d96df192b3 tested fix for initializer race condition with multiple activities in sequence 2023-01-31 21:02:02 -06:00
Jonathan Shook
1eead1add8 centralize jacoco template for reconfiguration 2023-01-26 23:32:15 -06:00
Jonathan Shook
32486b3d64 unbreak the break signal 2023-01-25 18:58:55 -06:00
Jonathan Shook
f63c7aeadb replace CI+CD friendly revision 2023-01-19 16:54:06 -06:00
Jonathan Shook
4175e79549 improve logging levels for debugging 2023-01-19 16:52:33 -06:00
Jonathan Shook
5914549124 replace missing cancelation for shutdown hook 2023-01-18 14:28:17 -06:00
Jonathan Shook
18bfe6274f
Merge pull request #920 from nosqlbench/jeffb/test-fail-fix
Sporadic test failure - fix
2023-01-17 11:54:50 -06:00
jeffbanks
f708fc2621 Debugging and resource cleanup. 2023-01-17 09:47:41 -06:00
jeffbanks
c61fac2442 Reactivate coverage; thread timing for test 2023-01-13 14:56:16 -06:00
jeffbanks
28a3ac3ad1 Added waits for testing 2023-01-13 14:19:48 -06:00
nb-droid
a49a9e9380 [maven-release-plugin] prepare for next development iteration 2023-01-13 19:51:57 +00:00
nb-droid
67aeba7a34 [maven-release-plugin] prepare release nosqlbench-5.17.0 2023-01-13 19:51:55 +00:00
Jonathan Shook
e04eef814c temporary work-around for release plugin incompatibility 2023-01-13 13:19:35 -06:00
jeffbanks
35f1f44929 Remove sync; thread details 2023-01-13 10:55:40 -06:00
jeffbanks
fb0154871f Adjust cycle count 2023-01-13 10:38:40 -06:00
jeffbanks
9583c49542 Delayed start 2023-01-13 09:47:10 -06:00
Jonathan Shook
31478ae591
Nosqlbench 904 version5 (#908)
* Ignore .flattened-pom.xml files from the CI-friendly flattening

* Allow newer versions to squelch version warning

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unecesary indirection in poms which break version intellisense

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unnecessary indirection in poms which break version intellisense

* deleting commented code
* version dep updates
* streamline LUT trimming options
* use a more explicit regex substituion technique
* specify updated okhttp version
* update resources plugin to bugfixed version
* exclude filtering for problematic files
2023-01-12 12:48:50 -06:00
Jeff Banks
9c25ad9336
Code coverage integration (#897)
* Jacoco introduced for full reporting of test coverage.
* All modules included in scope.
* Ability to scope to module OR overall reporting.
* Ability to run in dev environment and bypass as needed w/out GHA.
2023-01-12 11:25:40 -06:00
yabinmeng
2aeeea125c Separate ActivityExecutor.forceStop() method out from the stop() method. Removing the "forcing" flag in the stop() method. 2023-01-11 17:34:48 -06:00
yabinmeng
c172a140eb Add 'forceStop' NB CLI option in NB5 (port over from similar functionally in NB4 - PR# 675) 2023-01-11 16:49:23 -06:00
nb-droid
6e93468632 [maven-release-plugin] prepare for next development iteration 2023-01-09 19:36:28 +00:00
nb-droid
d1b9c91e44 [maven-release-plugin] prepare release nosqlbench-4.17.32 2023-01-09 19:36:26 +00:00
Jonathan Shook
3e2802a6ef remove engine-clients from dependencies 2023-01-05 15:20:48 -06:00
Jonathan Shook
dd1fc35d35
Merge pull request #880 from nosqlbench/nosqlbench-797-callable
nosqlbench-797-callable
2022-12-22 18:02:45 -06:00
Jonathan Shook
6731937c96 modify logger calls for computable messages via closures 2022-12-21 19:37:36 -06:00
Jonathan Shook
10080720a5 PR fixes from comments 2022-12-21 16:47:37 -06:00
Jonathan Shook
4f4b4982c8 templatize test logging level for logger setup and root logger 2022-12-20 23:11:55 -06:00
Jonathan Shook
d6c9f5153d test cleanup 2022-12-20 23:11:26 -06:00
Jonathan Shook
b9365bff72 improve concurrency patterns for activity execution 2022-12-20 20:04:17 -06:00
Jonathan Shook
bf5a31b342 implement efficient concurrent thread state signaling 2022-12-20 20:04:12 -06:00
Jonathan Shook
0de80887b1 move log4j.xml to log4j2.xml 2022-12-20 20:03:33 -06:00
Jonathan Shook
077b41a3c6 misc naming, typo and formatting improvements 2022-12-20 20:03:22 -06:00
Jonathan Shook
1416c71d91 internalize activity start logic 2022-12-20 20:02:48 -06:00
Jonathan Shook
31dc3ce8f7 package housekeeping 2022-12-20 20:02:16 -06:00
Jonathan Shook
3f14fefcb1 delegate activity instancing to dedicated loader 2022-12-20 20:01:43 -06:00
Jonathan Shook
1321923229 remove unused code paths to simplify refactoring 2022-12-20 20:01:22 -06:00
Jonathan Shook
bd129c442e run activities within a dedicated executor 2022-12-20 20:00:34 -06:00
Jonathan Shook
2b39f3c350 Merge branch 'main' into nosqlbench-797-callable 2022-12-12 15:04:39 -06:00
nb-droid
02522a468e [maven-release-plugin] prepare for next development iteration 2022-12-07 23:30:05 +00:00
nb-droid
fb131e9b09 [maven-release-plugin] prepare release nosqlbench-4.17.31 2022-12-07 23:30:02 +00:00
Jonathan Shook
86c4dfd966 partial fixes for nosqlbench-797 Race condition between exceptional activity shutdown and normal scenario shutdown. 2022-11-30 11:17:10 -06:00
Jonathan Shook
69617042b1 minor fixes on PR 2022-11-22 18:11:43 -06:00
Jonathan Shook
28f561aedd direct work-around for flaky test, simple improvements to logging, some improvements to consistent view of status, misc cleanups 2022-11-22 10:49:12 -06:00
Jonathan Shook
16417f37b6 additional diagnostics for spurious test 2022-11-21 10:24:28 -06:00
Jonathan Shook
eb0013f164 logging updates for build sanity checking 2022-11-19 12:02:11 -06:00
jeffbanks
dcf7baf867 Dead code utest resurrection and timing w/ gh actions
Cyclerate=10 to test github actions part2
Debug and exception handling
Detailed error handler logging
System out diagnostics
Capture step included
Try-catch diagnostics.
sysout cleanup; general cleanup
2022-11-18 23:52:29 -06:00
nb-droid
d9acf85597 [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
nb-droid
098455410d [maven-release-plugin] prepare release nosqlbench-4.17.30 2022-09-30 15:58:43 +00:00
Jonathan Shook
d49a5087d4 improved build diagnostics 2022-09-30 10:47:43 -05:00
nb-droid
19faf3c0ae [maven-release-plugin] prepare for next development iteration 2022-09-29 17:29:14 +00:00
nb-droid
20a5ab4234 [maven-release-plugin] prepare release nosqlbench-4.17.29 2022-09-29 17:29:12 +00:00
nb-droid
5f72b6c0d8 [maven-release-plugin] prepare for next development iteration 2022-09-21 19:27:40 +00:00
nb-droid
b52e6a4774 [maven-release-plugin] prepare release nosqlbench-4.17.28 2022-09-21 19:27:38 +00:00
Jonathan Shook
0068467a60 robustify tests which share state 2022-09-21 14:19:09 -05:00
Jonathan Shook
5b830cfa26 more accurate var names 2022-09-09 11:08:47 -05:00
Jonathan Shook
69255d5e71 remove graaljs compat flag 2022-09-09 11:08:37 -05:00
nb-droid
60b8ccc200 [maven-release-plugin] prepare for next development iteration 2022-08-25 21:55:33 +00:00
nb-droid
6e8ee26cf9 [maven-release-plugin] prepare release nosqlbench-4.17.27 2022-08-25 21:55:31 +00:00
nb-droid
32ca3657ca [maven-release-plugin] prepare for next development iteration 2022-08-24 22:04:47 +00:00
nb-droid
27686ef5d2 [maven-release-plugin] prepare release nosqlbench-4.17.26 2022-08-24 22:04:44 +00:00
nb-droid
1397cd1b88 [maven-release-plugin] prepare for next development iteration 2022-08-18 21:28:25 +00:00
nb-droid
c9f6925e68 [maven-release-plugin] prepare release nosqlbench-4.17.25 2022-08-18 21:28:23 +00:00
nb-droid
372f604e15 [maven-release-plugin] prepare for next development iteration 2022-08-16 17:56:15 +00:00
nb-droid
3a403038f3 [maven-release-plugin] prepare release nosqlbench-4.17.24 2022-08-16 17:56:12 +00:00
nb-droid
1ea05a0f14 [maven-release-plugin] prepare for next development iteration 2022-08-16 16:58:58 +00:00
nb-droid
bb7fd4f7b6 [maven-release-plugin] prepare release nosqlbench-4.17.23 2022-08-16 16:58:56 +00:00
nb-droid
bfb0fc38d8 [maven-release-plugin] prepare for next development iteration 2022-08-16 14:51:38 +00:00
nb-droid
584a6c802c [maven-release-plugin] prepare release nosqlbench-4.17.22 2022-08-16 14:51:35 +00:00
nb-droid
6dd0723546 [maven-release-plugin] prepare for next development iteration 2022-08-10 03:16:40 +00:00
nb-droid
b56995d4cf [maven-release-plugin] prepare release nosqlbench-4.17.21 2022-08-10 03:16:37 +00:00
Jonathan Shook
21ca1d1b2f minor fixes 2022-07-26 01:15:11 -05:00
nb-droid
4a3845aafb [maven-release-plugin] prepare for next development iteration 2022-07-19 16:11:11 +00:00
nb-droid
b5d4e1e3c6 [maven-release-plugin] prepare release nosqlbench-4.17.20 2022-07-19 16:11:09 +00:00
Jonathan Shook
4e08b65f2d package refactoring 2022-07-14 20:40:06 -05:00
Jonathan Shook
789cc62430 package refactoring 2022-07-14 19:01:00 -05:00
nb-droid
28c62da74f [maven-release-plugin] prepare for next development iteration 2022-07-01 16:46:05 +00:00
nb-droid
3bdad2a877 [maven-release-plugin] prepare release nosqlbench-4.17.19 2022-07-01 16:46:03 +00:00
nb-droid
460ad79f6c [maven-release-plugin] prepare for next development iteration 2022-07-01 15:56:59 +00:00
nb-droid
0937ed9f6a [maven-release-plugin] prepare release nosqlbench-4.17.18 2022-07-01 15:56:57 +00:00
nb-droid
bfdf87a3ad [maven-release-plugin] prepare for next development iteration 2022-07-01 15:26:38 +00:00
nb-droid
45c1a7b7da [maven-release-plugin] prepare release nosqlbench-4.17.17 2022-07-01 15:26:36 +00:00
nb-droid
3155147bfa [maven-release-plugin] prepare for next development iteration 2022-07-01 07:04:04 +00:00
nb-droid
215b32bd6a [maven-release-plugin] prepare release nosqlbench-4.17.16 2022-07-01 07:04:02 +00:00
nb-droid
ca6f3a08c8 [maven-release-plugin] prepare for next development iteration 2022-07-01 06:40:47 +00:00
nb-droid
b9c8bdefb9 [maven-release-plugin] prepare release nosqlbench-4.17.15 2022-07-01 06:40:45 +00:00
Jonathan Shook
87aa9d1dec fix standard activity init with no driver param 2022-06-30 00:35:57 -05:00
Jonathan Shook
c55bbfc127 adapters ("drivers") can be specified per op template within a workload 2022-06-29 20:45:27 -05:00
Jonathan Shook
9a42b09b81 update progress meter for readability 2022-06-28 19:48:38 -05:00
Jonathan Shook
a05dbc834a improve error for driver adapter not found 2022-06-28 18:23:22 -05:00
Jonathan Shook
19164ef77f lose drivers-api module, keep adapaters-api module 2022-06-22 23:13:04 -05:00
Jonathan Shook
a07adc5680 improve clarity of driver loading error 2022-06-22 21:15:54 -05:00
Jonathan Shook
3a90c0512c improve error messages 2022-06-16 15:13:29 -05:00
Jonathan Shook
6dd1c43db3 move integrated testing to separate module 2022-06-09 15:01:02 -05:00
Jonathan Shook
fa2847a613 provide typed update interface for dynamic params 2022-06-09 15:00:58 -05:00
Jonathan Shook
b255d0d70f remove deprecated Nashorn logic 2022-06-09 15:00:54 -05:00
Jonathan Shook
7b1b41ec85 add modular metering API and refactor progress meter 2022-05-31 21:01:00 -05:00
nb-droid
124c92256f [maven-release-plugin] prepare for next development iteration 2022-05-18 19:49:25 +00:00
nb-droid
2aaef696f9 [maven-release-plugin] prepare release nosqlbench-4.17.14 2022-05-18 19:49:23 +00:00
nb-droid
dcd8e59308 [maven-release-plugin] prepare for next development iteration 2022-05-18 19:13:14 +00:00
nb-droid
556ab55d4c [maven-release-plugin] prepare release nosqlbench-4.17.13 2022-05-18 19:13:11 +00:00
Jonathan Shook
31384c7d11 updated version to 4.17.13-SNAPSHOT 2022-05-18 14:02:41 -05:00
Jonathan Shook
14bd72136b defer construction of optional log messages 2022-03-22 15:08:18 -05:00
Jonathan Shook
4a7e9f5ef7 artifact selection fixed for PR 2022-03-22 11:22:28 -05:00
nb-droid
81c7d47885 [maven-release-plugin] prepare for next development iteration 2022-03-10 04:05:16 +00:00
nb-droid
882b1edaf8 [maven-release-plugin] prepare release nosqlbench-4.17.11 2022-03-10 04:05:14 +00:00
nb-droid
384f430b92 [maven-release-plugin] prepare for next development iteration 2022-03-09 16:24:25 +00:00
nb-droid
66fae484e9 [maven-release-plugin] prepare release nosqlbench-4.17.10 2022-03-09 16:24:22 +00:00
Jonathan Shook
5ecd24b379 add aplv2 headers to engine-core 2022-03-08 14:14:43 -06:00
nb-droid
7b302b25c1 [maven-release-plugin] prepare for next development iteration 2022-02-17 17:26:15 +00:00
nb-droid
b2382ac99b [maven-release-plugin] prepare release nosqlbench-4.17.9 2022-02-17 17:26:12 +00:00