Commit Graph

923 Commits

Author SHA1 Message Date
Jonathan Shook
777c4aa3c7 post merge fixes 2023-10-23 23:54:31 -05:00
Jonathan Shook
b8c9af6e71 minor updates 2023-10-23 08:42:19 -05:00
Jonathan Shook
e44b5a21b7 refinements for csv logging 2023-10-23 08:42:19 -05:00
Jonathan Shook
fe1d3193a4 merge fixups and adapting client load sensors 2023-10-23 08:42:19 -05:00
Jonathan Shook
aaf58984d6 findmax in the house 2023-10-23 08:42:19 -05:00
Jonathan Shook
137ce31136 findmax 80% ready 2023-10-23 08:42:19 -05:00
Jonathan Shook
bff86b5525 bursty cycle rate test online 2023-10-23 08:42:19 -05:00
Mark Wolters
32b13c0134 adding ConsoleReporter,Log4jMetricsReporter 2023-10-23 08:42:19 -05:00
Jonathan Shook
e64de7476e partial working optimo, something is still broken in the search behavior 2023-10-23 08:42:19 -05:00
Jonathan Shook
30cdd280cc refactor and replace rate limiter implementation 2023-10-23 08:42:19 -05:00
Jonathan Shook
9e91a6201d incremental progress 2023-10-23 08:42:19 -05:00
Jonathan Shook
9fa711b7ab checkpoint 2023-10-23 08:42:19 -05:00
Jonathan Shook
0699b446a6 remove duplicitous call path 2023-10-23 08:42:19 -05:00
Jonathan Shook
945f48983c scenario tests stubbed, error handling in session fixed, mvn verify works now 2023-10-23 08:42:19 -05:00
Jonathan Shook
bed3070495 fixed empty runScenario method and made it final 2023-10-23 08:42:19 -05:00
Jonathan Shook
7be8fd0708 minor updates, notes collected into gh issues 2023-10-23 08:42:19 -05:00
Mark Wolters
2986412036 fixup of csv reporter, removed script context parameter 2023-10-23 08:42:19 -05:00
Mark Wolters
71103041f9 revamping plugin extensions 2023-10-23 08:42:19 -05:00
Jonathan Shook
92377b636c all adapters loading indirectly 2023-10-23 08:42:16 -05:00
Jonathan Shook
61b923cfed indirect loading on nbr working 2023-10-23 08:42:00 -05:00
Jonathan Shook
9daf06cd62 rehome all metrics construction patterns, remove ActivityMetrics 2023-10-23 08:41:40 -05:00
Jonathan Shook
57db140a94 removed all ActivityMetrics constructions 2023-10-23 08:41:40 -05:00
Jonathan Shook
4efd428de3 partial switchover of metrics from ActivityMetrics 2023-10-23 08:41:38 -05:00
Jonathan Shook
3ec511f61f partial progress to moving instrumentation 2023-10-23 08:41:17 -05:00
Jonathan Shook
835c74597a SCDryRunScenarioTest running like js analog now 2023-10-23 08:41:17 -05:00
Jonathan Shook
65db41b22a script env tests now working 2023-10-23 08:41:17 -05:00
Jonathan Shook
17052eaadf rework scenario invocation for better tests, unit test running only 2023-10-23 08:41:17 -05:00
Jonathan Shook
b0e984c55f basic component lifetimes working 2023-10-23 08:41:17 -05:00
Jonathan Shook
7f960778b4 fixes for passing basic tests 2023-10-23 08:41:17 -05:00
Jonathan Shook
2c90ec0e1c even more merge fixes 2023-10-23 08:41:17 -05:00
Jonathan Shook
c0a3ec2509 more merge fixes 2023-10-23 08:41:17 -05:00
Jonathan Shook
02f69d0038 merge fixes 2023-10-23 08:41:17 -05:00
Jonathan Shook
3681bb3a88 remove charting feature 2023-10-23 08:41:17 -05:00
Jonathan Shook
722ac6571a misc 2023-10-23 08:41:17 -05:00
Jonathan Shook
40019912d3 lay foundation for component hierarchy 2023-10-23 08:41:17 -05:00
Jonathan Shook
90519b9337 more fixes 2023-10-23 08:41:17 -05:00
ShaunakDas88
cd1ab9c540 address draft PR comments 2023-10-10 22:37:43 -07:00
Jonathan Shook
71b39fa95a modify historic format testing to accomodate design change 2023-10-05 20:38:15 -05:00
yabinmeng
47c87c64eb Fix a possible NPE situation caused by unregisterMetrics() if registerMetrics() fails to execute somehow (e.g. CLI input parameter problem such as cycle number < stride number) 2023-10-04 21:49:28 -05:00
Jonathan Shook
c9b1d78401 minor test fix 2023-09-28 19:46:12 -05:00
Jonathan Shook
6297420c42 consolidate calling method, remove old invocation path for activity executor 2023-09-28 14:58:26 -05:00
Jonathan Shook
a57e967930 provide threads metric 2023-09-28 14:58:26 -05:00
Jonathan Shook
bd57c26de1 implement threads metric on activity 2023-09-28 14:58:26 -05:00
Jonathan Shook
b9b33f1a9d base project on jdk21 toolchain and runtime 2023-09-28 10:48:16 -05:00
Jonathan Shook
e4a566cedd improve method names on annotations 2023-09-15 16:48:43 -05:00
Jonathan Shook
112ad332cd fixups and package structure updates 2023-09-11 13:20:52 -05:00
Jonathan Shook
0668d1db0c fix false positive on ungraceful shutdown warning 2023-09-10 19:17:47 -05:00
Jonathan Shook
7b9f4389b8 fix NPE when no filter or validator applied 2023-09-10 19:17:45 -05:00
Jonathan Shook
17fa8500ab enable label filtering and validation 2023-09-10 17:37:57 -05:00
Jonathan Shook
186e87ac1b enable label filtering and validation 2023-09-09 20:31:15 -05:00
Jonathan Shook
bf3e9636c0 remove confusing type and dimensions labeling methods 2023-09-09 20:31:04 -05:00
Jonathan Shook
be396cceb2 make recycles semantics and format consistent with cycles 2023-09-09 16:03:40 -05:00
Jonathan Shook
56c687380e provide cycle value metric 2023-09-08 20:07:47 -05:00
Jonathan Shook
f579fb638c fix bad naming refactoring 2023-08-31 16:42:45 -05:00
Jonathan Shook
a98ff2e465 modularize methods for verifiers 2023-08-31 16:10:53 -05:00
Jonathan Shook
8062e5b3ac Merge branch 'main' into jshook/update-paging-fix 2023-08-30 01:11:53 -05:00
Jonathan Shook
6eb93419d8 impl direct activity shutdown hook for annotations closure 2023-08-30 00:57:41 -05:00
Jonathan Shook
9cf9b6e91c cleanup annotation details 2023-08-30 00:57:34 -05:00
Dave Fisher
e69224afb6 Add additional configuration options for PromPush 2023-08-29 15:22:18 -07:00
Jonathan Shook
0812f15ea2 add missing test logger config 2023-08-28 16:15:31 -05:00
Jonathan Shook
7633a45ae6 nosqlbench-1478 sanitize all labels which are used according to the openmetrics exposition format... 2023-08-28 16:15:28 -05:00
Jonathan Shook
5207fc6b45 cleanups and formatting 2023-08-28 16:15:14 -05:00
Jonathan Shook
6c4833d48d differentiate dimension and instance labels 2023-08-28 16:15:10 -05:00
Jonathan Shook
497432137e recall computation 2023-08-17 18:07:04 -05:00
Jonathan Shook
745d203766 align test name to file 2023-08-16 15:44:29 -05:00
Jonathan Shook
145b02ebd4 re-enable nashorn compat, which converts .property to .getProperty() where needed 2023-07-27 12:39:12 -05:00
Jonathan Shook
23aba88ee0 engine and runtime updates for vector branch 2023-07-25 11:50:28 -05:00
Jonathan Shook
b324c59c11 remove package element from log4j2 configs 2023-06-06 09:03:13 -05:00
Jonathan Shook
30992793ed clarify multiple scenario entry points 2023-05-18 14:58:08 -05:00
Jonathan Shook
694e7949de copyright 2023-05-18 14:57:58 -05:00
Jonathan Shook
dffdd70bed scaffold labels into components 2023-05-18 14:57:42 -05:00
Jonathan Shook
d2c7d1a32f improved error messages 2023-05-18 14:57:04 -05:00
kijanowski
fb8f70bf9a Resolve merge conflicts 2023-05-17 11:51:18 +02:00
kijanowski
8f7ebbf0a3 Merge remote-tracking branch 'origin/main' into jk-test-eng-95-expected-result-verification
# Conflicts:
#	adapters-api/src/main/java/io/nosqlbench/engine/api/activityimpl/BaseOpDispenser.java
#	engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/errorhandling/modular/NBErrorHandlerTest.java
#	engine-cli/src/main/java/io/nosqlbench/engine/cli/NBCLIOptions.java
2023-05-17 11:21:11 +02:00
kijanowski
bda0790bd4 Code review adjustments 2023-05-17 09:47:07 +02:00
kijanowski
2e47715ce7 Code review adjustments 2023-05-12 16:51:38 +02:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook
70408621dd nosqlbench-1071 NBIO should favor finding exactly specified file path as a short circuit 2023-02-10 10:20:45 -06:00
Jonathan Shook
c45e3ff964 deprecate yaml->workload and type->driver, and make loader more robust 2023-02-07 18:20:49 -06:00
Jonathan Shook
5626430de8 disable unused edge case test until it is well defined 2023-02-06 12:07:25 -06:00
Jonathan Shook
d3d7e36bbf removed extraneous test 2023-02-06 00:20:25 -06:00
Jonathan Shook
ce54eced7e logically isolate concurrent concurrency tests 2023-02-05 21:20:10 -06:00
Jonathan Shook
9fc0530c17 move threadpool init within Callable flow 2023-02-05 20:30:57 -06:00
Jonathan Shook
edd3de63de improve testing time 2023-02-05 20:30:37 -06:00
Jonathan Shook
4e70eb7680 allow dryrun to be multi-modal 2023-02-05 20:29:52 -06:00
Jonathan Shook
4f827c8031 allow startActivity to be re-entrant with blocking 2023-02-05 20:28:34 -06:00
Jonathan Shook
8995f5dfef improvements to motor state model and activity 2023-02-03 17:07:46 -06:00
Jonathan Shook
9d7f92edb4
Merge pull request #970 from nosqlbench/nosqlbench-968-unhookhook
unregister scenario shutdown hook correctly
2023-02-01 10:59:12 -06:00
Jonathan Shook
3d7eebc123 include Errored state into activity event handling logic 2023-01-31 23:12:18 -06:00
Jonathan Shook
5a648671d3 nosqlbench-968 Scenario shutdown hook not being unregistered correctly 2023-01-31 23:00:07 -06:00
Jonathan Shook
d96df192b3 tested fix for initializer race condition with multiple activities in sequence 2023-01-31 21:02:02 -06:00
Jonathan Shook
1eead1add8 centralize jacoco template for reconfiguration 2023-01-26 23:32:15 -06:00
Jonathan Shook
32486b3d64 unbreak the break signal 2023-01-25 18:58:55 -06:00
Jonathan Shook
f63c7aeadb replace CI+CD friendly revision 2023-01-19 16:54:06 -06:00
Jonathan Shook
4175e79549 improve logging levels for debugging 2023-01-19 16:52:33 -06:00
Jonathan Shook
5914549124 replace missing cancelation for shutdown hook 2023-01-18 14:28:17 -06:00
Jonathan Shook
18bfe6274f
Merge pull request #920 from nosqlbench/jeffb/test-fail-fix
Sporadic test failure - fix
2023-01-17 11:54:50 -06:00
jeffbanks
f708fc2621 Debugging and resource cleanup. 2023-01-17 09:47:41 -06:00
jeffbanks
c61fac2442 Reactivate coverage; thread timing for test 2023-01-13 14:56:16 -06:00
jeffbanks
28a3ac3ad1 Added waits for testing 2023-01-13 14:19:48 -06:00