Commit Graph

271 Commits

Author SHA1 Message Date
Jonathan Shook
a64aa58fc6 remove more invalid metric labels 2023-09-09 00:12:04 -05:00
Jonathan Shook
55ef2cff4a remove result size from base op 2023-09-07 10:03:24 -05:00
Jonathan Shook
f579fb638c fix bad naming refactoring 2023-08-31 16:42:45 -05:00
Jonathan Shook
a98ff2e465 modularize methods for verifiers 2023-08-31 16:10:53 -05:00
Jonathan Shook
f0d0f20898 more metrics sanitization 2023-08-30 00:57:46 -05:00
Jonathan Shook
aec7301e99 provide a more condensed session identifier for metrics 2023-08-28 16:15:34 -05:00
Jonathan Shook
5ae230ebce allow labels to be provided at the activity level 2023-08-28 16:15:24 -05:00
Jonathan Shook
def7e99ed8 allow ops to layer labels within activity labels 2023-08-28 16:15:21 -05:00
Jonathan Shook
36761a0ae3 fix for breaking change in Jsonnet 2023-08-28 16:15:03 -05:00
snyk-bot
14706d57e1
fix: upgrade com.databricks:sjsonnet_2.13 from 0.4.4 to 0.4.5
Snyk has created this PR to upgrade com.databricks:sjsonnet_2.13 from 0.4.4 to 0.4.5.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.databricks/sjsonnet_2.13/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/79ea2278-c4a8-4336-ba93-333db70b8c13?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-08-21 04:47:50 +00:00
Jonathan Shook
497432137e recall computation 2023-08-17 18:07:04 -05:00
Jonathan Shook
4fdd39fff9 adapters api changes for vector branch and other fixes 2023-07-25 11:32:30 -05:00
Jeff Banks
704a505c67
fix: upgrade org.scala-lang:scala-library from 2.13.10 to 2.13.11 (#1354)
Snyk has created this PR to upgrade org.scala-lang:scala-library from 2.13.10 to 2.13.11.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.scala-lang/scala-library/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/79ea2278-c4a8-4336-ba93-333db70b8c13?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-06-26 08:16:17 -05:00
Jonathan Shook
fa0afdd388 DO-NOT-MERGE: this needs some repairs first 2023-06-06 09:03:13 -05:00
Jonathan Shook
45b9a2deb4
Merge pull request #1279 from nosqlbench/labels_trueup
Labels trueup
2023-05-18 16:40:30 -05:00
Jonathan Shook
97e1bb032d
Merge pull request #1276 from nosqlbench/nosqlbench-1273-poplist
make list template work for all types, and go faster
2023-05-18 15:17:20 -05:00
Jonathan Shook
8955296580 allow command maps in diag op templates 2023-05-18 14:57:55 -05:00
Jonathan Shook
11ad67d75f remove phase and phase limiter 2023-05-18 14:56:56 -05:00
Jonathan Shook
14c38e1f30 implement missing list template logic and optimize generator function 2023-05-17 20:18:43 -05:00
kijanowski
fb8f70bf9a Resolve merge conflicts 2023-05-17 11:51:18 +02:00
kijanowski
8f7ebbf0a3 Merge remote-tracking branch 'origin/main' into jk-test-eng-95-expected-result-verification
# Conflicts:
#	adapters-api/src/main/java/io/nosqlbench/engine/api/activityimpl/BaseOpDispenser.java
#	engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/errorhandling/modular/NBErrorHandlerTest.java
#	engine-cli/src/main/java/io/nosqlbench/engine/cli/NBCLIOptions.java
2023-05-17 11:21:11 +02:00
kijanowski
bda0790bd4 Code review adjustments 2023-05-17 09:47:07 +02:00
kijanowski
2e47715ce7 Code review adjustments 2023-05-12 16:51:38 +02:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook
a8ce71f9e7 Comments on branch. You can truncate this commit after reading. 2023-05-08 12:31:01 -05:00
Jeff Banks
6162d1ba58
fix: upgrade com.databricks:sjsonnet_2.13 from 0.4.3 to 0.4.4 (#1253)
Snyk has created this PR to upgrade com.databricks:sjsonnet_2.13 from 0.4.3 to 0.4.4.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.databricks/sjsonnet_2.13/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/79ea2278-c4a8-4336-ba93-333db70b8c13?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-05-06 10:01:05 -05:00
kijanowski
be9b97e2cd Verify expected result with MVEL 2023-05-05 13:34:25 +02:00
Jonathan Shook
9295adf03f
Merge pull request #1143 from MMirelli/mm-ls797-continue-add-e2e-error-metrics-to-kafka-adapter
[kafka-adapter] Add e2e error metrics -- to be continued
2023-04-25 09:10:32 -05:00
Jeff Banks
388ece75f7
MongoDB Adapter fix and updates for scenarios (#1196)
* Updates for mongodb adapter; fix connection usage on cli

* Reduce the cycles for test w/ sporadic failures

* Removed redundant '-> string'

* Removed state tracking and cleanup

* Space cache capture and connection management

* Mongo client management w/ connection

* Remove unused getData()

* Removed debug entry no longer required
2023-04-04 16:09:00 -05:00
Massimiliano Mirelli
fff2f42306 Add Copyright notice to EndToEndMetricsAdapterUtil.java 2023-03-07 16:23:18 +02:00
Massimiliano Mirelli
b333898249 Decouple e2e error metrics from adapter modules
Add classes implementing e2e error metrics to adapters-api module in `import io.nosqlbench.engine.api.metrics.ReceivedMessageSequenceTracker`
2023-03-07 14:06:15 +02:00
Jonathan Shook
a2ec4c3afc typo fix 2023-02-24 12:53:59 -06:00
Jonathan Shook
6b98269a94 remove unused classes 2023-02-22 15:59:24 -06:00
Jonathan Shook
fe094d0011 expose capture points on ParsedOp 2023-02-22 15:59:15 -06:00
Jonathan Shook
100194cd97 remove unused classes 2023-02-22 15:58:47 -06:00
jeffbanks
d63ba45281 adatper formatting; ops loader fix 2023-02-15 16:59:53 -06:00
Jonathan Shook
a8a285a3f9 clarify optional enhancement func 2023-02-14 17:49:13 -06:00
Jonathan Shook
715c63717f enable recycles parameter for BaseDriverAdapter closes #974 2023-02-14 17:48:48 -06:00
Jonathan Shook
466fa1c13a fixed mutability in test args 2023-02-10 13:19:01 -06:00
Jonathan Shook
70408621dd nosqlbench-1071 NBIO should favor finding exactly specified file path as a short circuit 2023-02-10 10:20:45 -06:00
Jeff Banks
1711c5c02c
Phase 2 scenario upgrades #1019 (#1031) 2023-02-07 18:28:05 -06:00
Jonathan Shook
1b82ad9478
Merge pull request #1000 from nosqlbench/add-tags-script
Add tags script
2023-02-06 15:23:38 -06:00
jeffbanks
cc989c8a72 nb5 revamp for scenarios 2023-02-06 14:58:04 -06:00
Jonathan Shook
4e70eb7680 allow dryrun to be multi-modal 2023-02-05 20:29:52 -06:00
Jonathan Shook
8fc5115a0c doc updates for docsite testing 2023-01-30 22:17:40 -06:00
Jonathan Shook
47c39a8ae3 Merge branch 'main' of github.com:nosqlbench/nosqlbench 2023-01-30 18:42:04 -06:00
Jonathan Shook
b9796d304c updated name 2023-01-30 12:04:25 -06:00
Jonathan Shook
ba2944ce77 code cleanup and naming updates from "statements" to "ops" 2023-01-29 01:26:19 -06:00
Jonathan Shook
8515f548e4 upgrade scala lang lib 2023-01-27 18:58:57 -06:00
Jonathan Shook
6abd7968bd improve jsonnet diagnostics 2023-01-27 18:54:31 -06:00