Commit Graph

4852 Commits

Author SHA1 Message Date
Jonathan Shook
26ee5c1747 more temporal functions 2023-05-18 14:58:35 -05:00
Jonathan Shook
e817875313 more periodic functions 2023-05-18 14:58:31 -05:00
Jonathan Shook
e936e35f0d more higher order functions 2023-05-18 14:58:28 -05:00
Jonathan Shook
963c481b26 update tests for stmt form 2023-05-18 14:58:23 -05:00
Jonathan Shook
b6fbcbded9 add diag gauge 2023-05-18 14:58:17 -05:00
Jonathan Shook
5bd1aebffa add --set-labels and --add-labels 2023-05-18 14:58:13 -05:00
Jonathan Shook
30992793ed clarify multiple scenario entry points 2023-05-18 14:58:08 -05:00
Jonathan Shook
694e7949de copyright 2023-05-18 14:57:58 -05:00
Jonathan Shook
8955296580 allow command maps in diag op templates 2023-05-18 14:57:55 -05:00
Jonathan Shook
ba78d80fd6 allow service loader to expose providers 2023-05-18 14:57:52 -05:00
Jonathan Shook
6883aed6c1 backfill missing Mul type 2023-05-18 14:57:49 -05:00
Jonathan Shook
dffdd70bed scaffold labels into components 2023-05-18 14:57:42 -05:00
Jonathan Shook
50b7416c18 refactor diag tasks to better support labels 2023-05-18 14:57:36 -05:00
Jonathan Shook
74decafbf5 fixup prom push format after labels changes 2023-05-18 14:57:26 -05:00
Jonathan Shook
66d373a719 improve MapLabels toString 2023-05-18 14:57:07 -05:00
Jonathan Shook
d2c7d1a32f improved error messages 2023-05-18 14:57:04 -05:00
Jonathan Shook
cc0a8751e1 range bug fix 2023-05-18 14:57:00 -05:00
Jonathan Shook
11ad67d75f remove phase and phase limiter 2023-05-18 14:56:56 -05:00
Jonathan Shook
4e6ad6db61 remove unused code 2023-05-18 14:56:52 -05:00
Jonathan Shook
97cd593b3c
Merge pull request #1251 from nosqlbench/jk-test-eng-95-expected-result-verification
Verify expected result with MVEL
2023-05-18 11:11:32 -05:00
kijanowski
863172d7cb Code review fixes 2023-05-18 15:28:21 +02:00
Snyk bot
d829bbe06b
fix: upgrade io.netty:netty-handler from 4.1.91.Final to 4.1.92.Final (#1275)
Snyk has created this PR to upgrade io.netty:netty-handler from 4.1.91.Final to 4.1.92.Final.

See this package in Maven Repository:
https://mvnrepository.com/artifact/io.netty/netty-handler/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/3e4c0e79-b7a9-4806-b967-55079b66e71e?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-05-17 20:23:27 -05:00
Jeff Banks
0a54e5d783
fix: upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.454 to 1.12.456 (#1274)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.454 to 1.12.456.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-05-17 20:23:13 -05:00
Jonathan Shook
66ab412394
Merge pull request #1271
Multiple enhancements and minor fixes for NB Pulsar, NB Kafka (S4K), and NB S4J adapters
2023-05-17 10:27:19 -05:00
kijanowski
c48dcb1848 Do not pretty-print the result object in case of a verification error 2023-05-17 14:37:55 +02:00
kijanowski
63cfa5d85d Resolve merge conflicts 2023-05-17 12:22:58 +02:00
kijanowski
fb8f70bf9a Resolve merge conflicts 2023-05-17 11:51:18 +02:00
kijanowski
1101df95c4 Resolve merge conflicts 2023-05-17 11:29:04 +02:00
kijanowski
2268dc9c06 Resolve merge conflicts 2023-05-17 11:24:53 +02:00
kijanowski
8f7ebbf0a3 Merge remote-tracking branch 'origin/main' into jk-test-eng-95-expected-result-verification
# Conflicts:
#	adapters-api/src/main/java/io/nosqlbench/engine/api/activityimpl/BaseOpDispenser.java
#	engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/errorhandling/modular/NBErrorHandlerTest.java
#	engine-cli/src/main/java/io/nosqlbench/engine/cli/NBCLIOptions.java
2023-05-17 11:21:11 +02:00
kijanowski
bda0790bd4 Code review adjustments 2023-05-17 09:47:07 +02:00
yabinmeng
7a5831b4ff 1) NB Kafka and NB S4J adaptor code efficiency improvement (following PR 10115 by Lari on Pulsar adaptor)
2) Downgrade NB Pulsar version from 2.11.1 to 2.10.4 to avoid NB S4J execution failure (runtime version conflict)
3) Fix S4J Adaptor metrics labeling conflict
4) Change the space shutdown logic for NB Pulsar, Kafka, and S4J such that to simply log an error message instead of throwing out a run-time exception (NB is shutting down anyway).
5) Minor update of NB Kafka and NB S4J properties file and add settings for connecting to Astra Streaming
2023-05-16 19:59:39 -05:00
Jeff Banks
69927c5350
fix: upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.453 to 1.12.454 (#1269)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.453 to 1.12.454.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-05-16 08:22:50 -05:00
Snyk bot
bec8f2f5a8
fix: upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.453 to 1.12.454 (#1268)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.453 to 1.12.454.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-dynamodb/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/db3dfb82-467b-4263-94f8-28f933540a6d?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-05-16 08:22:27 -05:00
Snyk bot
5319f6188e
fix: upgrade com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider from 2.14.2 to 2.15.0 (#1270)
Snyk has created this PR to upgrade com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider from 2.14.2 to 2.15.0.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.fasterxml.jackson.jaxrs/jackson-jaxrs-json-provider/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/99d5f5ce-a2bd-4e05-9eff-86de84bd0b9e?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-05-16 08:22:01 -05:00
Jonathan Shook
7ba6536dfb
fix: upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.452 to 1.12.453 (#1267)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.452 to 1.12.453.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-dynamodb/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/db3dfb82-467b-4263-94f8-28f933540a6d?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-05-14 11:51:25 -05:00
Snyk bot
10c7197181
fix: upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.451 to 1.12.453 (#1266)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.451 to 1.12.453.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-05-14 11:51:02 -05:00
kijanowski
2e47715ce7 Code review adjustments 2023-05-12 16:51:38 +02:00
Jonathan Shook
d1e6453359
fix: upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.451 to 1.12.452 (#1265)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.451 to 1.12.452.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-dynamodb/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/db3dfb82-467b-4263-94f8-28f933540a6d?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-05-12 09:17:58 -05:00
Snyk bot
3abf3c65a0
fix: upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.450 to 1.12.451 (#1261)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.450 to 1.12.451.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-dynamodb/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/db3dfb82-467b-4263-94f8-28f933540a6d?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-05-10 09:49:22 -05:00
Snyk bot
9e4e09ba1d
fix: upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.450 to 1.12.451 (#1262)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.450 to 1.12.451.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-05-10 09:48:56 -05:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Snyk bot
bca2d8a2ee
fix: upgrade org.graalvm.tools:profiler from 22.3.1 to 22.3.2 (#1259)
Snyk has created this PR to upgrade org.graalvm.tools:profiler from 22.3.1 to 22.3.2.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.graalvm.tools/profiler/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/6a966a50-08ee-405a-ae9a-1cfab95ff2c5?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-05-09 09:07:00 -05:00
Jonathan Shook
d77ceb6336
fix: upgrade info.picocli:picocli from 4.7.2 to 4.7.3 (#1258)
Snyk has created this PR to upgrade info.picocli:picocli from 4.7.2 to 4.7.3.

See this package in Maven Repository:
https://mvnrepository.com/artifact/info.picocli/picocli/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-05-09 09:06:24 -05:00
Jonathan Shook
a8ce71f9e7 Comments on branch. You can truncate this commit after reading. 2023-05-08 12:31:01 -05:00
Snyk bot
b562b762fd
fix: upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.449 to 1.12.450 (#1257)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.449 to 1.12.450.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-dynamodb/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/db3dfb82-467b-4263-94f8-28f933540a6d?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-05-08 08:39:33 -05:00
Jonathan Shook
6c611ce114
fix: adapter-cqld4/pom.xml to reduce vulnerabilities (#1256)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGYAML-3152153

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-05-08 08:39:17 -05:00
Snyk bot
5843f22405
fix: upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.448 to 1.12.450 (#1255)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.448 to 1.12.450.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-05-08 08:38:45 -05:00
Jeff Banks
6162d1ba58
fix: upgrade com.databricks:sjsonnet_2.13 from 0.4.3 to 0.4.4 (#1253)
Snyk has created this PR to upgrade com.databricks:sjsonnet_2.13 from 0.4.3 to 0.4.4.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.databricks/sjsonnet_2.13/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/79ea2278-c4a8-4336-ba93-333db70b8c13?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-05-06 10:01:05 -05:00
Jonathan Shook
7818945270
fix: upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.447 to 1.12.449 (#1254)
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.447 to 1.12.449.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-dynamodb/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/db3dfb82-467b-4263-94f8-28f933540a6d?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-05-06 10:00:37 -05:00