IntenseFinance/nosqlbench
3
0
Fork 0
mirror of https://github.com/nosqlbench/nosqlbench.git synced 2024-12-26 00:31:07 -06:00
Code Issues Packages Projects Releases Wiki Activity
5,956 Commits 42 Branches 33 Tags 93 MiB
2166331e83
Commit Graph

865 Commits

Author SHA1 Message Date
Mark Wolters
71103041f9 revamping plugin extensions 2023-10-23 08:42:19 -05:00
Jonathan Shook
83da24a8ef fix backing store bug on activity def cycles, remove too-early log init 2023-10-23 08:42:19 -05:00
Jonathan Shook
61b923cfed indirect loading on nbr working 2023-10-23 08:42:00 -05:00
Jonathan Shook
9daf06cd62 rehome all metrics construction patterns, remove ActivityMetrics 2023-10-23 08:41:40 -05:00
Jonathan Shook
57db140a94 removed all ActivityMetrics constructions 2023-10-23 08:41:40 -05:00
Jonathan Shook
4efd428de3 partial switchover of metrics from ActivityMetrics 2023-10-23 08:41:38 -05:00
Jonathan Shook
3ec511f61f partial progress to moving instrumentation 2023-10-23 08:41:17 -05:00
Jonathan Shook
835c74597a SCDryRunScenarioTest running like js analog now 2023-10-23 08:41:17 -05:00
Jonathan Shook
65db41b22a script env tests now working 2023-10-23 08:41:17 -05:00
Jonathan Shook
17052eaadf rework scenario invocation for better tests, unit test running only 2023-10-23 08:41:17 -05:00
Jonathan Shook
280c270d8f fix reporter 2023-10-23 08:41:17 -05:00
Jonathan Shook
b130caf154 incremental progress 2023-10-23 08:41:17 -05:00
Jonathan Shook
b0e984c55f basic component lifetimes working 2023-10-23 08:41:17 -05:00
Jonathan Shook
7f960778b4 fixes for passing basic tests 2023-10-23 08:41:17 -05:00
Jonathan Shook
7e2ddc745a improve build, components should not do non-component things 2023-10-23 08:41:17 -05:00
Jonathan Shook
9b39e2abc3 yet even more merge fixes 2023-10-23 08:41:17 -05:00
Jonathan Shook
a9fe6fb07e test updates 2023-10-23 08:41:17 -05:00
Jonathan Shook
9de6bad6ff support openmetrics symbolic views 2023-10-23 08:41:17 -05:00
Jonathan Shook
cf510ddf1a component scaffolding 2023-10-23 08:41:17 -05:00
Jonathan Shook
2c90ec0e1c even more merge fixes 2023-10-23 08:41:17 -05:00
Jonathan Shook
c0a3ec2509 more merge fixes 2023-10-23 08:41:17 -05:00
Jonathan Shook
3681bb3a88 remove charting feature 2023-10-23 08:41:17 -05:00
Jonathan Shook
722ac6571a misc 2023-10-23 08:41:17 -05:00
Jonathan Shook
40019912d3 lay foundation for component hierarchy 2023-10-23 08:41:17 -05:00
Jonathan Shook
0a3b827372 doc improvements 2023-10-23 08:41:17 -05:00
Jonathan Shook
a6695e486a add meaning toString on relevancy measures 2023-10-17 14:05:35 -05:00
yabinmeng
f014923ffd Fix the Prometheus Push metrics reporter authentication configuration issue: 
- The bearer token authentication will end up with "Bearer: null" for a non-auth enabled situation.
 2023-09-29 16:46:38 -05:00
Jonathan Shook
a57e967930 provide threads metric 2023-09-28 14:58:26 -05:00
Jonathan Shook
e9cf289787 provide a fully constructed metric type which can be registered as-is 2023-09-28 14:58:26 -05:00
Jonathan Shook
e4a566cedd improve method names on annotations 2023-09-15 16:48:43 -05:00
Jonathan Shook
5e52ff2031 calculate session duration automatically for annotations 2023-09-15 16:48:38 -05:00
Jonathan Shook
b3b361b30a quick fix for missing labels in measures 2023-09-11 18:39:26 -05:00
Jonathan Shook
112ad332cd fixups and package structure updates 2023-09-11 13:20:52 -05:00
Jonathan Shook
7b9f4389b8 fix NPE when no filter or validator applied 2023-09-10 19:17:45 -05:00
Jonathan Shook
17fa8500ab enable label filtering and validation 2023-09-10 17:37:57 -05:00
Jonathan Shook
186e87ac1b enable label filtering and validation 2023-09-09 20:31:15 -05:00
Jonathan Shook
bf3e9636c0 remove confusing type and dimensions labeling methods 2023-09-09 20:31:04 -05:00
Jonathan Shook
3aab634522 organize and improve cycles and recycles logic 2023-09-09 16:03:37 -05:00
Jonathan Shook
c55213da7c enable direct cycle progress metrics 2023-09-09 00:13:33 -05:00
Jonathan Shook
a64aa58fc6 remove more invalid metric labels 2023-09-09 00:12:04 -05:00
Jonathan Shook
aa4d760119 restore K distinction in metrics labels 2023-09-09 00:11:50 -05:00
Jonathan Shook
a8e74e5b86 fix recursion trap 2023-09-09 00:11:22 -05:00
Jonathan Shook
5cf0fbcaec label fix for relevance metrics 2023-09-08 17:53:44 -05:00
Jonathan Shook
340e5ac483 miscellaneous fixes for relevancy metrics 2023-09-08 17:13:56 -05:00
Jonathan Shook
ea847fed37 make using relevancy measures in verifiers easy and complete 2023-09-08 15:01:59 -05:00
Jonathan Shook
64b46ca054 improve functions for readability and safety 2023-09-08 10:59:08 -05:00
Dave Fisher
cb35f2ddd8 SystemID fix orElse 2023-09-06 10:54:29 -07:00
Jonathan Shook
d01af097f4
Merge pull request #1505 from nosqlbench/jshook/modularization 
modularize methods for verifiers
 2023-09-05 18:08:09 -05:00
Dave Fisher
5c758d2066 Review comment 2023-09-05 12:57:51 -07:00
Dave Fisher
35ebd4d3ed Make sure to return an IPv4 SystemID 2023-09-05 12:44:58 -07:00
Jonathan Shook
f579fb638c fix bad naming refactoring 2023-08-31 16:42:45 -05:00
Jonathan Shook
a98ff2e465 modularize methods for verifiers 2023-08-31 16:10:53 -05:00
Jonathan Shook
5032779ad7 allow one character label names 2023-08-30 17:16:03 -05:00
Jonathan Shook
acd8c7a3ed remove overzealous labels check 2023-08-30 16:25:11 -05:00
Jonathan Shook
6bfd9e3171 integration test fixes 2023-08-30 01:24:47 -05:00
Jonathan Shook
8062e5b3ac Merge branch 'main' into jshook/update-paging-fix 2023-08-30 01:11:53 -05:00
Jonathan Shook
0e7d90f9b7 reduce session id to only session id, node stands separately 2023-08-30 00:57:49 -05:00
Jonathan Shook
b1e95ab330 migrate histograms from summary form to histogram form in prom exposition 2023-08-30 00:57:44 -05:00
Jonathan Shook
2949075b20 add double summary gauge to track statistics directly 2023-08-30 00:57:32 -05:00
Dave Fisher
4488624f6b Tested default configuration 2023-08-29 16:57:58 -07:00
Dave Fisher
df8646ef08 Add Bearer Token support to PromPushReporter 2023-08-29 15:23:10 -07:00
Jonathan Shook
5a53d535d8 fix for byte packing in system id 2023-08-28 20:29:33 -05:00
Jonathan Shook
aec7301e99 provide a more condensed session identifier for metrics 2023-08-28 16:15:34 -05:00
Jonathan Shook
0812f15ea2 add missing test logger config 2023-08-28 16:15:31 -05:00
Jonathan Shook
7633a45ae6 nosqlbench-1478 sanitize all labels which are used according to the openmetrics exposition format... 2023-08-28 16:15:28 -05:00
Jonathan Shook
df5076e8e9 centralize state path initialization 2023-08-28 16:15:18 -05:00
Jonathan Shook
5207fc6b45 cleanups and formatting 2023-08-28 16:15:14 -05:00
Jonathan Shook
6c4833d48d differentiate dimension and instance labels 2023-08-28 16:15:10 -05:00
Jonathan Shook
999aea64eb sanitize metric labels and metric family name values 2023-08-28 16:14:43 -05:00
Jonathan Shook
a5c3da2cf9 standardize label parsing 2023-08-28 16:14:37 -05:00
Jonathan Shook
497432137e recall computation 2023-08-17 18:07:04 -05:00
Jonathan Shook
745d203766 align test name to file 2023-08-16 15:44:29 -05:00
Jonathan Shook
d1725da0cb merge fixups 2023-07-25 12:06:25 -05:00
Jonathan Shook
ad58a7959a engine and nb api changes for vector branch 2023-07-25 11:50:22 -05:00
Jonathan Shook
4fdd39fff9 adapters api changes for vector branch and other fixes 2023-07-25 11:32:30 -05:00
Jeff Banks
27644273fd
Bypass SSL validation option (#1289) 
* Bypass ssl validation option
* TrustManager inclusion
 2023-07-06 11:32:22 -05:00
Jeff Banks
1d203b2c6a
fix: upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.6 to 0.64.8 (#1348) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.6 to 0.64.8.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-ext-yaml-front-matter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-21 14:15:55 -05:00
Jeff Banks
2154fa0f18
fix: upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.6 to 0.64.8 (#1345) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.6 to 0.64.8.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-html2md-converter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-20 08:15:53 -05:00
Jonathan Shook
db0f846fbb
fix: upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.4 to 0.64.6 (#1331) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.4 to 0.64.6.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-html2md-converter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-12 12:03:34 -05:00
Jonathan Shook
599fff1097
fix: upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.4 to 0.64.6 (#1330) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.4 to 0.64.6.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-ext-yaml-front-matter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
 2023-06-12 12:03:19 -05:00
Jonathan Shook
6bac3fba98
Merge pull request #1301 from nosqlbench/snyk-upgrade-dfb052ab54d84bab60fdbee30c67752b 
[Snyk] Upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.2 to 0.64.4
 2023-05-25 22:52:06 -05:00
snyk-bot
37b86f12ab
fix: upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.2 to 0.64.4 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.2 to 0.64.4.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-ext-yaml-front-matter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
 2023-05-26 01:54:54 +00:00
snyk-bot
8719064751
fix: upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.2 to 0.64.4 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-html2md-converter from 0.64.2 to 0.64.4.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-html2md-converter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
 2023-05-26 01:54:52 +00:00
Snyk bot
208296f68f
fix: upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.0 to 0.64.2 (#1288) 
Snyk has created this PR to upgrade com.vladsch.flexmark:flexmark-ext-yaml-front-matter from 0.64.0 to 0.64.2.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.vladsch.flexmark/flexmark-ext-yaml-front-matter/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
 2023-05-23 14:54:49 -05:00
Jonathan Shook
45b9a2deb4
Merge pull request #1279 from nosqlbench/labels_trueup 
Labels trueup
 2023-05-18 16:40:30 -05:00
Jonathan Shook
b8de62a0e8
Merge pull request #1272 from eolivelli/impl/venice-adapter 
[adapter-venice] Introduce new VeniceDB adapter
 2023-05-18 15:17:53 -05:00
Jonathan Shook
74decafbf5 fixup prom push format after labels changes 2023-05-18 14:57:26 -05:00
Jonathan Shook
66d373a719 improve MapLabels toString 2023-05-18 14:57:07 -05:00
Jonathan Shook
d2c7d1a32f improved error messages 2023-05-18 14:57:04 -05:00
Enrico Olivelli
298eaa8945 [adapter-venice] Introduce new VeniceDB adapter 2023-05-17 16:45:51 +02:00
kijanowski
c48dcb1848 Do not pretty-print the result object in case of a verification error 2023-05-17 14:37:55 +02:00
kijanowski
8f7ebbf0a3 Merge remote-tracking branch 'origin/main' into jk-test-eng-95-expected-result-verification 
# Conflicts:
#	adapters-api/src/main/java/io/nosqlbench/engine/api/activityimpl/BaseOpDispenser.java
#	engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/errorhandling/modular/NBErrorHandlerTest.java
#	engine-cli/src/main/java/io/nosqlbench/engine/cli/NBCLIOptions.java
 2023-05-17 11:21:11 +02:00
kijanowski
bda0790bd4 Code review adjustments 2023-05-17 09:47:07 +02:00
kijanowski
2e47715ce7 Code review adjustments 2023-05-12 16:51:38 +02:00
Jeff Banks
02ff160b3c
Metrics Publishing (#1234) 
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
 2023-05-09 09:52:42 -05:00
Snyk bot
1c933b3a75
fix: nb-api/pom.xml to reduce vulnerabilities (#1237) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJSOUP-2989728
 2023-05-01 09:00:15 -05:00
Jeff Banks
388ece75f7
MongoDB Adapter fix and updates for scenarios (#1196) 
* Updates for mongodb adapter; fix connection usage on cli

* Reduce the cycles for test w/ sporadic failures

* Removed redundant '-> string'

* Removed state tracking and cleanup

* Space cache capture and connection management

* Mongo client management w/ connection

* Remove unused getData()

* Removed debug entry no longer required
 2023-04-04 16:09:00 -05:00
Jonathan Shook
99bd45d83a add unit test for specific boxing, closes #1074 2023-02-10 22:44:58 -06:00
Jonathan Shook
167de5670d removed unused code 2023-02-10 11:48:44 -06:00
Jonathan Shook
70408621dd nosqlbench-1071 NBIO should favor finding exactly specified file path as a short circuit 2023-02-10 10:20:45 -06:00