IntenseFinance/nosqlbench
3
0
Fork 0
mirror of https://github.com/nosqlbench/nosqlbench.git synced 2025-01-11 08:22:04 -06:00
Code Issues Packages Projects Releases Wiki Activity
5,610 Commits 43 Branches 34 Tags 78 MiB
137ce31136
Commit Graph

836 Commits

Author SHA1 Message Date
Jonathan Shook
e4a566cedd improve method names on annotations 2023-09-15 16:48:43 -05:00
Jonathan Shook
5e52ff2031 calculate session duration automatically for annotations 2023-09-15 16:48:38 -05:00
Jonathan Shook
b3b361b30a quick fix for missing labels in measures 2023-09-11 18:39:26 -05:00
Jonathan Shook
112ad332cd fixups and package structure updates 2023-09-11 13:20:52 -05:00
Jonathan Shook
7b9f4389b8 fix NPE when no filter or validator applied 2023-09-10 19:17:45 -05:00
Jonathan Shook
17fa8500ab enable label filtering and validation 2023-09-10 17:37:57 -05:00
Jonathan Shook
186e87ac1b enable label filtering and validation 2023-09-09 20:31:15 -05:00
Jonathan Shook
bf3e9636c0 remove confusing type and dimensions labeling methods 2023-09-09 20:31:04 -05:00
Jonathan Shook
3aab634522 organize and improve cycles and recycles logic 2023-09-09 16:03:37 -05:00
Jonathan Shook
c55213da7c enable direct cycle progress metrics 2023-09-09 00:13:33 -05:00
Jonathan Shook
a64aa58fc6 remove more invalid metric labels 2023-09-09 00:12:04 -05:00
Jonathan Shook
aa4d760119 restore K distinction in metrics labels 2023-09-09 00:11:50 -05:00
Jonathan Shook
a8e74e5b86 fix recursion trap 2023-09-09 00:11:22 -05:00
Jonathan Shook
5cf0fbcaec label fix for relevance metrics 2023-09-08 17:53:44 -05:00
Jonathan Shook
340e5ac483 miscellaneous fixes for relevancy metrics 2023-09-08 17:13:56 -05:00
Jonathan Shook
ea847fed37 make using relevancy measures in verifiers easy and complete 2023-09-08 15:01:59 -05:00
Jonathan Shook
64b46ca054 improve functions for readability and safety 2023-09-08 10:59:08 -05:00
Dave Fisher
cb35f2ddd8 SystemID fix orElse 2023-09-06 10:54:29 -07:00
Jonathan Shook
d01af097f4
Merge pull request #1505 from nosqlbench/jshook/modularization 
modularize methods for verifiers
 2023-09-05 18:08:09 -05:00
Dave Fisher
5c758d2066 Review comment 2023-09-05 12:57:51 -07:00
Dave Fisher
35ebd4d3ed Make sure to return an IPv4 SystemID 2023-09-05 12:44:58 -07:00
Jonathan Shook
f579fb638c fix bad naming refactoring 2023-08-31 16:42:45 -05:00
Jonathan Shook
a98ff2e465 modularize methods for verifiers 2023-08-31 16:10:53 -05:00
Jonathan Shook
5032779ad7 allow one character label names 2023-08-30 17:16:03 -05:00
Jonathan Shook
acd8c7a3ed remove overzealous labels check 2023-08-30 16:25:11 -05:00
Jonathan Shook
6bfd9e3171 integration test fixes 2023-08-30 01:24:47 -05:00
Jonathan Shook
8062e5b3ac Merge branch 'main' into jshook/update-paging-fix 2023-08-30 01:11:53 -05:00
Jonathan Shook
0e7d90f9b7 reduce session id to only session id, node stands separately 2023-08-30 00:57:49 -05:00
Jonathan Shook
b1e95ab330 migrate histograms from summary form to histogram form in prom exposition 2023-08-30 00:57:44 -05:00
Jonathan Shook
2949075b20 add double summary gauge to track statistics directly 2023-08-30 00:57:32 -05:00
Dave Fisher
4488624f6b Tested default configuration 2023-08-29 16:57:58 -07:00
Dave Fisher
df8646ef08 Add Bearer Token support to PromPushReporter 2023-08-29 15:23:10 -07:00
Jonathan Shook
5a53d535d8 fix for byte packing in system id 2023-08-28 20:29:33 -05:00
Jonathan Shook
aec7301e99 provide a more condensed session identifier for metrics 2023-08-28 16:15:34 -05:00
Jonathan Shook
0812f15ea2 add missing test logger config 2023-08-28 16:15:31 -05:00
Jonathan Shook
7633a45ae6 nosqlbench-1478 sanitize all labels which are used according to the openmetrics exposition format... 2023-08-28 16:15:28 -05:00
Jonathan Shook
df5076e8e9 centralize state path initialization 2023-08-28 16:15:18 -05:00
Jonathan Shook
5207fc6b45 cleanups and formatting 2023-08-28 16:15:14 -05:00
Jonathan Shook
6c4833d48d differentiate dimension and instance labels 2023-08-28 16:15:10 -05:00
Jonathan Shook
999aea64eb sanitize metric labels and metric family name values 2023-08-28 16:14:43 -05:00
Jonathan Shook
a5c3da2cf9 standardize label parsing 2023-08-28 16:14:37 -05:00
Jonathan Shook
497432137e recall computation 2023-08-17 18:07:04 -05:00
Jonathan Shook
745d203766 align test name to file 2023-08-16 15:44:29 -05:00
Jonathan Shook
d1725da0cb merge fixups 2023-07-25 12:06:25 -05:00
Jonathan Shook
ad58a7959a engine and nb api changes for vector branch 2023-07-25 11:50:22 -05:00
Jonathan Shook
4fdd39fff9 adapters api changes for vector branch and other fixes 2023-07-25 11:32:30 -05:00
Jeff Banks
27644273fd
Bypass SSL validation option (#1289) 
* Bypass ssl validation option
* TrustManager inclusion
 2023-07-06 11:32:22 -05:00
Jeff Banks
1d203b2c6a
fix: upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.6 to 0.64.8 (#1348) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.6 to 0.64.8.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-ext-yaml-front-matter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-21 14:15:55 -05:00
Jeff Banks
2154fa0f18
fix: upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.6 to 0.64.8 (#1345) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.6 to 0.64.8.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-html2md-converter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-20 08:15:53 -05:00
Jonathan Shook
db0f846fbb
fix: upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.4 to 0.64.6 (#1331) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.4 to 0.64.6.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-html2md-converter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-12 12:03:34 -05:00
Jonathan Shook
599fff1097
fix: upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.4 to 0.64.6 (#1330) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.4 to 0.64.6.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-ext-yaml-front-matter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-12 12:03:19 -05:00
Jonathan Shook
6bac3fba98
Merge pull request #1301 from nosqlbench/snyk-upgrade-dfb052ab54d84bab60fdbee30c67752b 
[Snyk] Upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.2 to 0.64.4
 2023-05-25 22:52:06 -05:00
snyk-bot
37b86f12ab
fix: upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.2 to 0.64.4 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.2 to 0.64.4.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-ext-yaml-front-matter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
 2023-05-26 01:54:54 +00:00
snyk-bot
8719064751
fix: upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.2 to 0.64.4 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.2 to 0.64.4.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-html2md-converter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
 2023-05-26 01:54:52 +00:00
Snyk bot
208296f68f
fix: upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.0 to 0.64.2 (#1288) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.0 to 0.64.2.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-ext-yaml-front-matter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
 2023-05-23 14:54:49 -05:00
Jonathan Shook
45b9a2deb4
Merge pull request #1279 from nosqlbench/labels_trueup 
Labels trueup
 2023-05-18 16:40:30 -05:00
Jonathan Shook
b8de62a0e8
Merge pull request #1272 from eolivelli/impl/venice-adapter 
[adapter-venice] Introduce new VeniceDB adapter
 2023-05-18 15:17:53 -05:00
Jonathan Shook
74decafbf5 fixup prom push format after labels changes 2023-05-18 14:57:26 -05:00
Jonathan Shook
66d373a719 improve MapLabels toString 2023-05-18 14:57:07 -05:00
Jonathan Shook
d2c7d1a32f improved error messages 2023-05-18 14:57:04 -05:00
Enrico Olivelli
298eaa8945 [adapter-venice] Introduce new VeniceDB adapter 2023-05-17 16:45:51 +02:00
kijanowski
c48dcb1848 Do not pretty-print the result object in case of a verification error 2023-05-17 14:37:55 +02:00
kijanowski
8f7ebbf0a3 Merge remote-tracking branch 'origin/main' into jk-test-eng-95-expected-result-verification 
# Conflicts:
#	adapters-api/src/main/java/io/nosqlbench/engine/api/activityimpl/BaseOpDispenser.java
#	engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/errorhandling/modular/NBErrorHandlerTest.java
#	engine-cli/src/main/java/io/nosqlbench/engine/cli/NBCLIOptions.java
 2023-05-17 11:21:11 +02:00
kijanowski
bda0790bd4 Code review adjustments 2023-05-17 09:47:07 +02:00
kijanowski
2e47715ce7 Code review adjustments 2023-05-12 16:51:38 +02:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234) 
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
 2023-05-09 09:52:42 -05:00
Snyk bot
1c933b3a75
fix: nb-api/pom.xml to reduce vulnerabilities (#1237) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-2989728
 2023-05-01 09:00:15 -05:00
Jeff Banks
388ece75f7
MongoDB Adapter fix and updates for scenarios (#1196) 
* Updates for mongodb adapter; fix connection usage on cli

* Reduce the cycles for test w/ sporadic failures

* Removed redundant '-> string'

* Removed state tracking and cleanup

* Space cache capture and connection management

* Mongo client management w/ connection

* Remove unused getData()

* Removed debug entry no longer required
 2023-04-04 16:09:00 -05:00
Jonathan Shook
99bd45d83a add unit test for specific boxing, closes #1074 2023-02-10 22:44:58 -06:00
Jonathan Shook
167de5670d removed unused code 2023-02-10 11:48:44 -06:00
Jonathan Shook
70408621dd nosqlbench-1071 NBIO should favor finding exactly specified file path as a short circuit 2023-02-10 10:20:45 -06:00
Jonathan Shook
b739330303 allow inline deprecation of activity params 2023-02-07 19:15:56 -06:00
Jonathan Shook
8ba0684b8d allow inline deprecation of activity params 2023-02-07 18:18:39 -06:00
jeffbanks
6b2a368d79 TextOfFile binding; stargate support; scenario updates 2023-02-04 19:35:56 -06:00
Jonathan Shook
ba2944ce77 code cleanup and naming updates from "statements" to "ops" 2023-01-29 01:26:19 -06:00
Jonathan Shook
1eead1add8 centralize jacoco template for reconfiguration 2023-01-26 23:32:15 -06:00
Jonathan Shook
0c9091714c merge fixups 2023-01-20 11:00:44 -06:00
Jonathan Shook
afaa6f5b93 remove duplicitous synonym logic 2023-01-19 23:54:53 -06:00
Jonathan Shook
71f2207c9b remove unused method 2023-01-19 23:54:47 -06:00
Jonathan Shook
f63c7aeadb replace CI+CD friendly revision 2023-01-19 16:54:06 -06:00
Jonathan Shook
7e5d7f188e disable incomplete apps 2023-01-17 19:42:20 -06:00
Jonathan Shook
fe4c25898f cleanup and document virtdata bundled app 2023-01-17 19:29:57 -06:00
Jonathan Shook
18bfe6274f
Merge pull request #920 from nosqlbench/jeffb/test-fail-fix 
Sporadic test failure - fix
 2023-01-17 11:54:50 -06:00
jeffbanks
28a3ac3ad1 Added waits for testing 2023-01-13 14:19:48 -06:00
nb-droid
a49a9e9380 [maven-release-plugin] prepare for next development iteration 2023-01-13 19:51:57 +00:00
nb-droid
67aeba7a34 [maven-release-plugin] prepare release nosqlbench-5.17.0 2023-01-13 19:51:55 +00:00
Jonathan Shook
e04eef814c temporary work-around for release plugin incompatibility 2023-01-13 13:19:35 -06:00
Jonathan Shook
ff188d4860
actions-for-docs (#919) 
* updated docs action with version state

* script updates

* misc doc system updates

* Update build.yml

remove versions logic, since zip contains version info now.

* Update build.yml

corrected git add command

* update version format

* updated docs site url
 2023-01-13 11:57:08 -06:00
Jonathan Shook
97e992bce8
version updates and pom structure improvements (#918) 2023-01-13 08:19:16 -06:00
Jonathan Shook
4f6bea91de switch over to snakeyaml-engine 2023-01-12 18:27:36 -06:00
Jonathan Shook
31478ae591
Nosqlbench 904 version5 (#908) 
* Ignore .flattened-pom.xml files from the CI-friendly flattening

* Allow newer versions to squelch version warning

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unecesary indirection in poms which break version intellisense

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unnecessary indirection in poms which break version intellisense

* deleting commented code
* version dep updates
* streamline LUT trimming options
* use a more explicit regex substituion technique
* specify updated okhttp version
* update resources plugin to bugfixed version
* exclude filtering for problematic files
 2023-01-12 12:48:50 -06:00
Jeff Banks
9c25ad9336
Code coverage integration (#897) 
* Jacoco introduced for full reporting of test coverage.
* All modules included in scope.
* Ability to scope to module OR overall reporting.
* Ability to run in dev environment and bypass as needed w/out GHA.
 2023-01-12 11:25:40 -06:00
Mike Yaacoub
b6ab7293e2 newline fix 2023-01-12 11:08:05 -05:00
MikeYaacoubStax
7f446145b4 Provided limited number of newlines in SSL KEY and CERT Patterns in Regex, Named the flag for more clarity 2023-01-12 08:43:50 -05:00
snyk-bot
80aed220a3
fix: upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.364 to 1.12.368 
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.364 to 1.12.368.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/fc9e1bd9-1d9a-474f-bde4-efb614c52ffe?utm_source=github&utm_medium=referral&page=upgrade-pr
 2023-01-10 22:59:59 +00:00
nb-droid
6e93468632 [maven-release-plugin] prepare for next development iteration 2023-01-09 19:36:28 +00:00
nb-droid
d1b9c91e44 [maven-release-plugin] prepare release nosqlbench-4.17.32 2023-01-09 19:36:26 +00:00
Jeff Banks
2d16ff3b57 Revert "NB5 address high priority code scans" (#895) 2023-01-05 17:26:01 -05:00
jeffbanks
ecfe3d633f Narrowing fixes 2023-01-05 17:26:01 -05:00
Mike Yaacoub
bdf61845fd nosqlbench-440 convert tcpclient driver from ActivityType to DriverAdapter e:1d 2023-01-04 15:26:08 -05:00