Commit Graph

897 Commits

Author SHA1 Message Date
ShaunakDas88
cd1ab9c540 address draft PR comments 2023-10-10 22:37:43 -07:00
ShaunakDas88
4502a5ec61 register client system metrics in NBCLI 2023-10-10 13:29:08 -07:00
yabinmeng
3ddac6298d Add clarification in docker-metrics.md. 2023-09-28 15:21:28 -05:00
yabinmeng
9a61a1f2af Remove "--docker-metrics" functionality. Update documents and scripts accordingly. 2023-09-28 14:30:18 -05:00
Jonathan Shook
e4a566cedd improve method names on annotations 2023-09-15 16:48:43 -05:00
Jonathan Shook
112ad332cd fixups and package structure updates 2023-09-11 13:20:52 -05:00
Jonathan Shook
3b1022b1eb allow argsfile to retain comments, provide safe warnings 2023-09-10 19:17:50 -05:00
Jonathan Shook
17fa8500ab enable label filtering and validation 2023-09-10 17:37:57 -05:00
Jonathan Shook
186e87ac1b enable label filtering and validation 2023-09-09 20:31:15 -05:00
Jonathan Shook
bf3e9636c0 remove confusing type and dimensions labeling methods 2023-09-09 20:31:04 -05:00
Jonathan Shook
2a9507bcc1 allow to disable metrics logger 2023-09-09 00:12:28 -05:00
Jonathan Shook
6bfd9e3171 integration test fixes 2023-08-30 01:24:47 -05:00
Jonathan Shook
8062e5b3ac Merge branch 'main' into jshook/update-paging-fix 2023-08-30 01:11:53 -05:00
Jonathan Shook
cf112e5024 simplify annotation tags 2023-08-30 00:57:52 -05:00
Dave Fisher
e69224afb6 Add additional configuration options for PromPush 2023-08-29 15:22:18 -07:00
Jonathan Shook
aec7301e99 provide a more condensed session identifier for metrics 2023-08-28 16:15:34 -05:00
Jonathan Shook
7633a45ae6 nosqlbench-1478 sanitize all labels which are used according to the openmetrics exposition format... 2023-08-28 16:15:28 -05:00
Jonathan Shook
5207fc6b45 cleanups and formatting 2023-08-28 16:15:14 -05:00
Jonathan Shook
999aea64eb sanitize metric labels and metric family name values 2023-08-28 16:14:43 -05:00
Jonathan Shook
23aba88ee0 engine and runtime updates for vector branch 2023-07-25 11:50:28 -05:00
Jonathan Shook
b324c59c11 remove package element from log4j2 configs 2023-06-06 09:03:13 -05:00
Sean McCarthy
ef667e356c introduce filterScriptParams to remove params meant to control scenario script from the activity context 2023-05-24 12:02:35 -07:00
Enrico Olivelli
88457aa9d9 [venice] Introduce the Writer operation and clean up the metrics
- introduce a new WriteOp to write directly to Venice
- support AVRO keys for reads and for writes
- remove useless metrics
2023-05-22 15:40:58 +02:00
Jonathan Shook
5bd1aebffa add --set-labels and --add-labels 2023-05-18 14:58:13 -05:00
Jonathan Shook
dffdd70bed scaffold labels into components 2023-05-18 14:57:42 -05:00
kijanowski
863172d7cb Code review fixes 2023-05-18 15:28:21 +02:00
kijanowski
2268dc9c06 Resolve merge conflicts 2023-05-17 11:24:53 +02:00
kijanowski
8f7ebbf0a3 Merge remote-tracking branch 'origin/main' into jk-test-eng-95-expected-result-verification
# Conflicts:
#	adapters-api/src/main/java/io/nosqlbench/engine/api/activityimpl/BaseOpDispenser.java
#	engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/errorhandling/modular/NBErrorHandlerTest.java
#	engine-cli/src/main/java/io/nosqlbench/engine/cli/NBCLIOptions.java
2023-05-17 11:21:11 +02:00
kijanowski
bda0790bd4 Code review adjustments 2023-05-17 09:47:07 +02:00
kijanowski
2e47715ce7 Code review adjustments 2023-05-12 16:51:38 +02:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook
d9e49d7292
allow spaces in named scenario templates (#1083) 2023-02-15 13:59:07 -06:00
Jonathan Shook
70408621dd nosqlbench-1071 NBIO should favor finding exactly specified file path as a short circuit 2023-02-10 10:20:45 -06:00
Jeff Banks
1711c5c02c
Phase 2 scenario upgrades #1019 (#1031) 2023-02-07 18:28:05 -06:00
Jonathan Shook
1b82ad9478
Merge pull request #1000 from nosqlbench/add-tags-script
Add tags script
2023-02-06 15:23:38 -06:00
jeffbanks
cc989c8a72 nb5 revamp for scenarios 2023-02-06 14:58:04 -06:00
Jonathan Shook
ef7f35bcf4 auto substitute PROG in docs with nb5 2023-02-05 20:30:22 -06:00
Jonathan Shook
95b146aa67 make sure logging config is visible on stderr for INFO level 2023-02-01 00:43:19 -06:00
Jonathan Shook
ba2944ce77 code cleanup and naming updates from "statements" to "ops" 2023-01-29 01:26:19 -06:00
Jonathan Shook
ec60692375 Merge branch 'nosqlbench-955-jacoco2' into nosqlbench-944-jsonnet 2023-01-27 16:37:28 -06:00
Jonathan Shook
1eead1add8 centralize jacoco template for reconfiguration 2023-01-26 23:32:15 -06:00
Jonathan Shook
dc9684dd98 rename stmt based types to op based types 2023-01-24 18:14:41 -06:00
Jonathan Shook
9b745dce31 simplify methods further with fewer logger parameters 2023-01-24 18:09:15 -06:00
Jonathan Shook
69be6a1062 make tests use workload instead of yaml 2023-01-23 12:17:13 -06:00
Jonathan Shook
f63c7aeadb replace CI+CD friendly revision 2023-01-19 16:54:06 -06:00
nb-droid
a49a9e9380 [maven-release-plugin] prepare for next development iteration 2023-01-13 19:51:57 +00:00
nb-droid
67aeba7a34 [maven-release-plugin] prepare release nosqlbench-5.17.0 2023-01-13 19:51:55 +00:00
Jonathan Shook
e04eef814c temporary work-around for release plugin incompatibility 2023-01-13 13:19:35 -06:00
Jonathan Shook
ff188d4860
actions-for-docs (#919)
* updated docs action with version state

* script updates

* misc doc system updates

* Update build.yml

remove versions logic, since zip contains version info now.

* Update build.yml

corrected git add command

* update version format

* updated docs site url
2023-01-13 11:57:08 -06:00
Jonathan Shook
31478ae591
Nosqlbench 904 version5 (#908)
* Ignore .flattened-pom.xml files from the CI-friendly flattening

* Allow newer versions to squelch version warning

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unecesary indirection in poms which break version intellisense

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unnecessary indirection in poms which break version intellisense

* deleting commented code
* version dep updates
* streamline LUT trimming options
* use a more explicit regex substituion technique
* specify updated okhttp version
* update resources plugin to bugfixed version
* exclude filtering for problematic files
2023-01-12 12:48:50 -06:00