ShaunakDas88
cd1ab9c540
address draft PR comments
2023-10-10 22:37:43 -07:00
ShaunakDas88
4502a5ec61
register client system metrics in NBCLI
2023-10-10 13:29:08 -07:00
yabinmeng
3ddac6298d
Add clarification in docker-metrics.md.
2023-09-28 15:21:28 -05:00
yabinmeng
9a61a1f2af
Remove "--docker-metrics" functionality. Update documents and scripts accordingly.
2023-09-28 14:30:18 -05:00
Jonathan Shook
e4a566cedd
improve method names on annotations
2023-09-15 16:48:43 -05:00
Jonathan Shook
112ad332cd
fixups and package structure updates
2023-09-11 13:20:52 -05:00
Jonathan Shook
3b1022b1eb
allow argsfile to retain comments, provide safe warnings
2023-09-10 19:17:50 -05:00
Jonathan Shook
17fa8500ab
enable label filtering and validation
2023-09-10 17:37:57 -05:00
Jonathan Shook
186e87ac1b
enable label filtering and validation
2023-09-09 20:31:15 -05:00
Jonathan Shook
bf3e9636c0
remove confusing type and dimensions labeling methods
2023-09-09 20:31:04 -05:00
Jonathan Shook
2a9507bcc1
allow to disable metrics logger
2023-09-09 00:12:28 -05:00
Jonathan Shook
6bfd9e3171
integration test fixes
2023-08-30 01:24:47 -05:00
Jonathan Shook
8062e5b3ac
Merge branch 'main' into jshook/update-paging-fix
2023-08-30 01:11:53 -05:00
Jonathan Shook
cf112e5024
simplify annotation tags
2023-08-30 00:57:52 -05:00
Dave Fisher
e69224afb6
Add additional configuration options for PromPush
2023-08-29 15:22:18 -07:00
Jonathan Shook
aec7301e99
provide a more condensed session identifier for metrics
2023-08-28 16:15:34 -05:00
Jonathan Shook
7633a45ae6
nosqlbench-1478 sanitize all labels which are used according to the openmetrics exposition format...
2023-08-28 16:15:28 -05:00
Jonathan Shook
5207fc6b45
cleanups and formatting
2023-08-28 16:15:14 -05:00
Jonathan Shook
999aea64eb
sanitize metric labels and metric family name values
2023-08-28 16:14:43 -05:00
Jonathan Shook
23aba88ee0
engine and runtime updates for vector branch
2023-07-25 11:50:28 -05:00
Jonathan Shook
b324c59c11
remove package element from log4j2 configs
2023-06-06 09:03:13 -05:00
Sean McCarthy
ef667e356c
introduce filterScriptParams to remove params meant to control scenario script from the activity context
2023-05-24 12:02:35 -07:00
Enrico Olivelli
88457aa9d9
[venice] Introduce the Writer operation and clean up the metrics
...
- introduce a new WriteOp to write directly to Venice
- support AVRO keys for reads and for writes
- remove useless metrics
2023-05-22 15:40:58 +02:00
Jonathan Shook
5bd1aebffa
add --set-labels and --add-labels
2023-05-18 14:58:13 -05:00
Jonathan Shook
dffdd70bed
scaffold labels into components
2023-05-18 14:57:42 -05:00
kijanowski
863172d7cb
Code review fixes
2023-05-18 15:28:21 +02:00
kijanowski
2268dc9c06
Resolve merge conflicts
2023-05-17 11:24:53 +02:00
kijanowski
8f7ebbf0a3
Merge remote-tracking branch 'origin/main' into jk-test-eng-95-expected-result-verification
...
# Conflicts:
# adapters-api/src/main/java/io/nosqlbench/engine/api/activityimpl/BaseOpDispenser.java
# engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/errorhandling/modular/NBErrorHandlerTest.java
# engine-cli/src/main/java/io/nosqlbench/engine/cli/NBCLIOptions.java
2023-05-17 11:21:11 +02:00
kijanowski
bda0790bd4
Code review adjustments
2023-05-17 09:47:07 +02:00
kijanowski
2e47715ce7
Code review adjustments
2023-05-12 16:51:38 +02:00
Jeff Banks
02ff160b3c
Metrics Publishing ( #1234 )
...
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts
---------
Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook
d9e49d7292
allow spaces in named scenario templates ( #1083 )
2023-02-15 13:59:07 -06:00
Jonathan Shook
70408621dd
nosqlbench-1071 NBIO should favor finding exactly specified file path as a short circuit
2023-02-10 10:20:45 -06:00
Jeff Banks
1711c5c02c
Phase 2 scenario upgrades #1019 ( #1031 )
2023-02-07 18:28:05 -06:00
Jonathan Shook
1b82ad9478
Merge pull request #1000 from nosqlbench/add-tags-script
...
Add tags script
2023-02-06 15:23:38 -06:00
jeffbanks
cc989c8a72
nb5 revamp for scenarios
2023-02-06 14:58:04 -06:00
Jonathan Shook
ef7f35bcf4
auto substitute PROG in docs with nb5
2023-02-05 20:30:22 -06:00
Jonathan Shook
95b146aa67
make sure logging config is visible on stderr for INFO level
2023-02-01 00:43:19 -06:00
Jonathan Shook
ba2944ce77
code cleanup and naming updates from "statements" to "ops"
2023-01-29 01:26:19 -06:00
Jonathan Shook
ec60692375
Merge branch 'nosqlbench-955-jacoco2' into nosqlbench-944-jsonnet
2023-01-27 16:37:28 -06:00
Jonathan Shook
1eead1add8
centralize jacoco template for reconfiguration
2023-01-26 23:32:15 -06:00
Jonathan Shook
dc9684dd98
rename stmt based types to op based types
2023-01-24 18:14:41 -06:00
Jonathan Shook
9b745dce31
simplify methods further with fewer logger parameters
2023-01-24 18:09:15 -06:00
Jonathan Shook
69be6a1062
make tests use workload instead of yaml
2023-01-23 12:17:13 -06:00
Jonathan Shook
f63c7aeadb
replace CI+CD friendly revision
2023-01-19 16:54:06 -06:00
nb-droid
a49a9e9380
[maven-release-plugin] prepare for next development iteration
2023-01-13 19:51:57 +00:00
nb-droid
67aeba7a34
[maven-release-plugin] prepare release nosqlbench-5.17.0
2023-01-13 19:51:55 +00:00
Jonathan Shook
e04eef814c
temporary work-around for release plugin incompatibility
2023-01-13 13:19:35 -06:00
Jonathan Shook
ff188d4860
actions-for-docs ( #919 )
...
* updated docs action with version state
* script updates
* misc doc system updates
* Update build.yml
remove versions logic, since zip contains version info now.
* Update build.yml
corrected git add command
* update version format
* updated docs site url
2023-01-13 11:57:08 -06:00
Jonathan Shook
31478ae591
Nosqlbench 904 version5 ( #908 )
...
* Ignore .flattened-pom.xml files from the CI-friendly flattening
* Allow newer versions to squelch version warning
* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unecesary indirection in poms which break version intellisense
* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unnecessary indirection in poms which break version intellisense
* deleting commented code
* version dep updates
* streamline LUT trimming options
* use a more explicit regex substituion technique
* specify updated okhttp version
* update resources plugin to bugfixed version
* exclude filtering for problematic files
2023-01-12 12:48:50 -06:00
Jeff Banks
9c25ad9336
Code coverage integration ( #897 )
...
* Jacoco introduced for full reporting of test coverage.
* All modules included in scope.
* Ability to scope to module OR overall reporting.
* Ability to run in dev environment and bypass as needed w/out GHA.
2023-01-12 11:25:40 -06:00
yabinmeng
c172a140eb
Add 'forceStop' NB CLI option in NB5 (port over from similar functionally in NB4 - PR# 675)
2023-01-11 16:49:23 -06:00
nb-droid
6e93468632
[maven-release-plugin] prepare for next development iteration
2023-01-09 19:36:28 +00:00
nb-droid
d1b9c91e44
[maven-release-plugin] prepare release nosqlbench-4.17.32
2023-01-09 19:36:26 +00:00
Jonathan Shook
dd1fc35d35
Merge pull request #880 from nosqlbench/nosqlbench-797-callable
...
nosqlbench-797-callable
2022-12-22 18:02:45 -06:00
Jonathan Shook
6731937c96
modify logger calls for computable messages via closures
2022-12-21 19:37:36 -06:00
Jonathan Shook
10080720a5
PR fixes from comments
2022-12-21 16:47:37 -06:00
Jonathan Shook
4f4b4982c8
templatize test logging level for logger setup and root logger
2022-12-20 23:11:55 -06:00
Jonathan Shook
0de80887b1
move log4j.xml to log4j2.xml
2022-12-20 20:03:33 -06:00
Jonathan Shook
31dc3ce8f7
package housekeeping
2022-12-20 20:02:16 -06:00
Jonathan Shook
2b39f3c350
Merge branch 'main' into nosqlbench-797-callable
2022-12-12 15:04:39 -06:00
Jonathan Shook
9d1e5c14d7
nosqlbench-836 expand default data retention in promql from 6 mo to 10 years
2022-12-09 14:26:09 -06:00
nb-droid
02522a468e
[maven-release-plugin] prepare for next development iteration
2022-12-07 23:30:05 +00:00
nb-droid
fb131e9b09
[maven-release-plugin] prepare release nosqlbench-4.17.31
2022-12-07 23:30:02 +00:00
Jonathan Shook
86c4dfd966
partial fixes for nosqlbench-797 Race condition between exceptional activity shutdown and normal scenario shutdown.
2022-11-30 11:17:10 -06:00
Jonathan Shook
28f561aedd
direct work-around for flaky test, simple improvements to logging, some improvements to consistent view of status, misc cleanups
2022-11-22 10:49:12 -06:00
Jonathan Shook
16417f37b6
additional diagnostics for spurious test
2022-11-21 10:24:28 -06:00
jeffbanks
dcf7baf867
Dead code utest resurrection and timing w/ gh actions
...
Cyclerate=10 to test github actions part2
Debug and exception handling
Detailed error handler logging
System out diagnostics
Capture step included
Try-catch diagnostics.
sysout cleanup; general cleanup
2022-11-18 23:52:29 -06:00
jeffbanks
9bc3a2fd14
Notify user when using error=count vs. counter.
2022-10-07 18:35:35 -05:00
nb-droid
d9acf85597
[maven-release-plugin] prepare for next development iteration
2022-09-30 15:58:45 +00:00
nb-droid
098455410d
[maven-release-plugin] prepare release nosqlbench-4.17.30
2022-09-30 15:58:43 +00:00
nb-droid
19faf3c0ae
[maven-release-plugin] prepare for next development iteration
2022-09-29 17:29:14 +00:00
nb-droid
20a5ab4234
[maven-release-plugin] prepare release nosqlbench-4.17.29
2022-09-29 17:29:12 +00:00
nb-droid
5f72b6c0d8
[maven-release-plugin] prepare for next development iteration
2022-09-21 19:27:40 +00:00
nb-droid
b52e6a4774
[maven-release-plugin] prepare release nosqlbench-4.17.28
2022-09-21 19:27:38 +00:00
Jonathan Shook
69255d5e71
remove graaljs compat flag
2022-09-09 11:08:37 -05:00
nb-droid
60b8ccc200
[maven-release-plugin] prepare for next development iteration
2022-08-25 21:55:33 +00:00
nb-droid
6e8ee26cf9
[maven-release-plugin] prepare release nosqlbench-4.17.27
2022-08-25 21:55:31 +00:00
nb-droid
32ca3657ca
[maven-release-plugin] prepare for next development iteration
2022-08-24 22:04:47 +00:00
nb-droid
27686ef5d2
[maven-release-plugin] prepare release nosqlbench-4.17.26
2022-08-24 22:04:44 +00:00
nb-droid
1397cd1b88
[maven-release-plugin] prepare for next development iteration
2022-08-18 21:28:25 +00:00
nb-droid
c9f6925e68
[maven-release-plugin] prepare release nosqlbench-4.17.25
2022-08-18 21:28:23 +00:00
nb-droid
372f604e15
[maven-release-plugin] prepare for next development iteration
2022-08-16 17:56:15 +00:00
nb-droid
3a403038f3
[maven-release-plugin] prepare release nosqlbench-4.17.24
2022-08-16 17:56:12 +00:00
nb-droid
1ea05a0f14
[maven-release-plugin] prepare for next development iteration
2022-08-16 16:58:58 +00:00
nb-droid
bb7fd4f7b6
[maven-release-plugin] prepare release nosqlbench-4.17.23
2022-08-16 16:58:56 +00:00
nb-droid
bfb0fc38d8
[maven-release-plugin] prepare for next development iteration
2022-08-16 14:51:38 +00:00
nb-droid
584a6c802c
[maven-release-plugin] prepare release nosqlbench-4.17.22
2022-08-16 14:51:35 +00:00
Jonathan Shook
a0344d65c9
make BundledApps implement primitive interface
2022-08-16 00:42:58 -05:00
nb-droid
6dd0723546
[maven-release-plugin] prepare for next development iteration
2022-08-10 03:16:40 +00:00
nb-droid
b56995d4cf
[maven-release-plugin] prepare release nosqlbench-4.17.21
2022-08-10 03:16:37 +00:00
Jonathan Shook
f3c0d001aa
cqlgen fixes
2022-07-26 02:12:07 -05:00
Jonathan Shook
bc63a28426
improve unrecognized command error
2022-07-26 01:15:06 -05:00
Jonathan Shook
89b7cce900
update docs for error-handlers with new .ALL metric and consistent naming
2022-07-21 12:17:32 -05:00
nb-droid
4a3845aafb
[maven-release-plugin] prepare for next development iteration
2022-07-19 16:11:11 +00:00
nb-droid
b5d4e1e3c6
[maven-release-plugin] prepare release nosqlbench-4.17.20
2022-07-19 16:11:09 +00:00
Jonathan Shook
1d1c96f9bf
checkpoint: paths and packages cleanup, tri-state filtering on keyspaces, more efficient init, LOCAL_QUORUM
2022-07-19 01:41:23 -05:00
Jonathan Shook
fb200e0b58
checkpoint: exporter.yaml config and many transformers added (see the file)
2022-07-15 19:44:58 -05:00
Jonathan Shook
789cc62430
package refactoring
2022-07-14 19:01:00 -05:00
Jonathan Shook
ebd3b775a5
checkpoint update
2022-07-11 10:59:18 -05:00
