Commit Graph

3837 Commits

Author SHA1 Message Date
Jonathan Shook
875e2d8f99 temporarily disable test for close exception handler 2022-11-22 23:04:49 -06:00
Jonathan Shook
901034875a fix for second noisy shutdown test 2022-11-22 22:50:53 -06:00
Jonathan Shook
2db6c6cf63
Update codeql-analysis.yml
changing environment to support normal build
2022-11-22 22:35:33 -06:00
Jonathan Shook
18ba2fdaf9
Merge branch 'main' into shutdown_hooks 2022-11-22 22:24:03 -06:00
Jonathan Shook
8602d5b532
Merge pull request #793 from yabinmeng/main
Add README file and adjust sample yaml files
2022-11-22 22:23:19 -06:00
Jonathan Shook
eaefd9a1b2
Merge pull request #781 from nosqlbench/780-sporadic-buildtest-failures-gh-actions
Sporadic test failures w/ gh actions
2022-11-22 18:14:30 -06:00
Jonathan Shook
69617042b1 minor fixes on PR 2022-11-22 18:11:43 -06:00
Jonathan Shook
28f561aedd direct work-around for flaky test, simple improvements to logging, some improvements to consistent view of status, misc cleanups 2022-11-22 10:49:12 -06:00
yabinmeng
c077218e8a Fix example yaml file producer and consumer parameter names 2022-11-21 21:05:26 -06:00
Jonathan Shook
16417f37b6 additional diagnostics for spurious test 2022-11-21 10:24:28 -06:00
yabinmeng
f7c9e50f35 Add README file and adjust sample yaml files 2022-11-19 18:53:58 -06:00
Jonathan Shook
eb0013f164 logging updates for build sanity checking 2022-11-19 12:02:11 -06:00
Jonathan Shook
bc4773269f build workflow should upload logfiles for success() or failure() of previous jobs, but not when canceled 2022-11-19 00:55:58 -06:00
Jonathan Shook
40c9682340 Merge branch '780-sporadic-buildtest-failures-gh-actions' of github.com:nosqlbench/nosqlbench into 780-sporadic-buildtest-failures-gh-actions 2022-11-18 23:52:55 -06:00
jeffbanks
dcf7baf867 Dead code utest resurrection and timing w/ gh actions
Cyclerate=10 to test github actions part2
Debug and exception handling
Detailed error handler logging
System out diagnostics
Capture step included
Try-catch diagnostics.
sysout cleanup; general cleanup
2022-11-18 23:52:29 -06:00
Jonathan Shook
20ed4950d4 removing broken actions plugin on main 2022-11-18 23:32:41 -06:00
Jonathan Shook
2831d8c3fc Merge branch 'main' of github.com:nosqlbench/nosqlbench 2022-11-18 23:29:08 -06:00
Jonathan Shook
3e8153dd87
Merge pull request #792 from yabinmeng/main
New consumer subscription feature; fix consumer DLT loading issue; code cleanup and reorg
2022-11-18 23:27:23 -06:00
Jonathan Shook
b8684107bb memoize retries in hot code path 2022-11-18 23:20:09 -06:00
Jonathan Shook
ebb6f2c58d include space usage in diag for testing 2022-11-18 23:18:48 -06:00
Jonathan Shook
48192cbdef close native driver connections on on activity+space shutdown 2022-11-18 23:18:44 -06:00
Jonathan Shook
4471d90ccb implement closeable spaces via decorator interface 2022-11-18 23:18:32 -06:00
yabinmeng
bd8aff9081 Added support for 1) subscription initial position and 2) regex subscription mode
Also fixed a consumer configuration loading issue with dlq/negAck/ackTimeout policy using Pulsar client's loadConf() API.

Addressed the review comments in PR #791; reverted the changes in ActivityMetrics and BasedOpDispenser
2022-11-18 18:22:04 -06:00
jeffbanks
35eec4d81f Dead code utest resurrection and timing w/ gh actions
Cyclerate=10 to test github actions part2
Debug and exception handling
Detailed error handler logging
System out diagnostics
Capture step included
Try-catch diagnostics.
sysout cleanup; general cleanup
2022-11-18 18:02:04 -06:00
Jonathan Shook
e80e9926cc
Merge pull request #791 from yabinmeng/main
Apache Pulsar native client API adapter for NB5
2022-11-17 19:11:22 -06:00
yabinmeng
0de7102884 Add support for
1) producer message compression
2) consumer DLT/negAck/ackTimeout policy

Add sample NB scenario yaml files
2022-11-17 18:47:37 -06:00
yabinmeng
12f8697e0e Complete the first draft of NB5 Pulsar adapter code, except the per-thread rate limiter. 2022-11-17 10:39:37 -06:00
yabinmeng
e128d2867a
Merge branch 'nosqlbench:main' into main 2022-11-17 10:27:28 -06:00
yabinmeng
0c71696b15 Completed NB4 Pulsar driver code migration to NB5. But there are still a few lingering issues due to the difference of how NB4 vs NB5 driver/adapter interacts with the NB engine. 2022-11-16 15:37:26 -06:00
Jonathan Shook
33e330dc35
[Snyk] Security upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.325 to 1.12.330 (#768)
* fix: nb-api/pom.xml to reduce vulnerabilities

The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424

* Timing change for github actions; warnings cleanup/refactor

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: jeffbanks <jeff.banks@datastax.com>
2022-11-14 18:32:52 -06:00
Jonathan Shook
2158dfa339
fix: upgrade io.netty:netty-handler from 4.1.81.Final to 4.1.82.Final (#767)
Snyk has created this PR to upgrade io.netty:netty-handler from 4.1.81.Final to 4.1.82.Final.

See this package in Maven Repository:
https://mvnrepository.com/artifact/io.netty/netty-handler/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/faf9c31c-14e2-456a-9f66-9dda91c923d9?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2022-11-14 17:16:39 -06:00
Jonathan Shook
5fc22bbaa5
fix: upgrade com.google.code.gson:gson from 2.9.0 to 2.9.1 (#766)
Snyk has created this PR to upgrade com.google.code.gson:gson from 2.9.0 to 2.9.1.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.google.code.gson/gson/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/fc9e1bd9-1d9a-474f-bde4-efb614c52ffe?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2022-11-14 17:16:14 -06:00
Jonathan Shook
6999a675f7
[Snyk] Upgrade io.dropwizard.metrics:metrics-core from 4.2.10 to 4.2.12 (#765)
* fix: upgrade io.dropwizard.metrics:metrics-core from 4.2.10 to 4.2.12

Snyk has created this PR to upgrade io.dropwizard.metrics:metrics-core from 4.2.10 to 4.2.12.

See this package in Maven Repository:
https://mvnrepository.com/artifact/io.dropwizard.metrics/metrics-core/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/fc9e1bd9-1d9a-474f-bde4-efb614c52ffe?utm_source=github&utm_medium=referral&page=upgrade-pr

* Timing change for github actions

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: jeffbanks <jeff.banks@datastax.com>
2022-11-14 17:03:11 -06:00
yabinmeng
ca6f2b052b Add PulsarAdapter specific metrics 2022-11-14 15:27:57 -06:00
Jonathan Shook
8b76d1fcf7 add shutdown hooks for adapters and spaces 2022-11-14 15:26:29 -06:00
Jonathan Shook
8c3d744a03
Merge pull request #764 from nosqlbench/snyk-upgrade-6693c12bca4fafc634662d8962afcb9a
[Snyk] Upgrade io.swagger.core.v3:swagger-models from 2.2.2 to 2.2.3
2022-11-14 14:13:42 -06:00
jeffbanks
eb1de8f1d5 Timing changes for github actions to properly perform build/test step. 2022-11-14 10:39:10 -06:00
Jonathan Shook
a05c511de7
fix: upgrade org.eclipse.jetty:jetty-server from 11.0.11 to 11.0.12 (#763)
Snyk has created this PR to upgrade org.eclipse.jetty:jetty-server from 11.0.11 to 11.0.12.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.eclipse.jetty/jetty-server/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/03cbee46-d5d2-41d3-89cc-a2ad77ab807a?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2022-11-14 09:50:20 -06:00
yabinmeng
c309d200ac - Delete unsed code "driver-jms"
- NB5 Pulsar driver Admin functionality in place - create/delete tenant, namespace, and topic
2022-11-11 18:36:06 -06:00
Jonathan Shook
2b9452fde4
Buildfixes, trying to unblock current builds (#777)
* make example/test script more robust for meager github actions environment
* improve wording around op template resolution
* remove blocking issues github actions plugin, since it is broken
2022-11-11 16:17:36 -06:00
Jonathan Shook
d47462929b remove blocking issues github actions plugin, since it is broken 2022-11-11 11:40:57 -06:00
Jonathan Shook
4dc830aa10 improve wording around op template resolution 2022-11-11 11:32:50 -06:00
Jonathan Shook
b2f74d3292 make example/test script more robust for meager github actions environment 2022-11-11 11:32:00 -06:00
Jonathan Shook
7c1fb19632
Merge pull request #770 from nosqlbench/ms-mongodb-keyvalue-schema-fix
Updated MongoDB key-value collection to have a 'value' field
2022-11-03 13:03:47 -05:00
Jonathan Shook
98c7b1a978
Merge pull request #769 from nosqlbench/base64
base64
2022-11-03 13:03:23 -05:00
Madhavan Sridharan
45ee75fef0 bump min_version 2022-11-02 09:36:49 -04:00
Madhavan Sridharan
8f32c9496c Updated MongoDB key-value collection to have a 'value' field 2022-11-02 09:27:19 -04:00
phact
9a92129a83 base64 2022-11-01 10:42:00 -04:00
snyk-bot
bb27a6f7fb
fix: upgrade io.swagger.core.v3:swagger-models from 2.2.2 to 2.2.3
Snyk has created this PR to upgrade io.swagger.core.v3:swagger-models from 2.2.2 to 2.2.3.

See this package in Maven Repository:
https://mvnrepository.com/artifact/io.swagger.core.v3/swagger-models/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/b808ba5a-fa96-49c2-9cae-4c2c2f8a1384?utm_source=github&utm_medium=referral&page=upgrade-pr
2022-10-27 18:58:07 +00:00
Jonathan Shook
0e3893190f
Merge pull request #757 from nosqlbench/snyk-upgrade-de963ecc07996edad35bfd93b9db28c2
[Snyk] Upgrade joda-time:joda-time from 2.11.1 to 2.11.2
2022-10-26 12:48:35 -05:00