Commit Graph

3903 Commits

Author SHA1 Message Date
Jonathan Shook
e39954ccc9
Merge branch 'main' into snyk-fix-6ba0467ba1a5842fab939a7c4f8b6a14 2022-11-22 23:27:33 -06:00
Jonathan Shook
56470956ba
Merge pull request #778 from nosqlbench/snyk-fix-62d2529ba6efa1321216d8e295c48e5d
[Snyk] Security upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.325 to 1.12.340
2022-11-22 23:27:05 -06:00
Jonathan Shook
59b430b12f
Merge branch 'main' into snyk-fix-62d2529ba6efa1321216d8e295c48e5d 2022-11-22 23:26:56 -06:00
Jonathan Shook
4c764250d6
Merge pull request #794 from nosqlbench/snyk-fix-2ac9869bf1d47aa3f30a82f3655c5432
[Snyk] Security upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.325 to 1.12.347
2022-11-22 23:26:28 -06:00
Jonathan Shook
7491370ba5
Merge branch 'main' into snyk-fix-2ac9869bf1d47aa3f30a82f3655c5432 2022-11-22 23:26:17 -06:00
Jonathan Shook
47db96c06c
Merge pull request #795 from nosqlbench/snyk-fix-3f81768022b768b87ace72058200f7ac
[Snyk] Security upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.325 to 1.12.348
2022-11-22 23:25:52 -06:00
Jonathan Shook
fa528eebed
Merge pull request #779 from nosqlbench/shutdown_hooks
Shutdown hooks
2022-11-22 23:25:02 -06:00
Jonathan Shook
875e2d8f99 temporarily disable test for close exception handler 2022-11-22 23:04:49 -06:00
Jonathan Shook
901034875a fix for second noisy shutdown test 2022-11-22 22:50:53 -06:00
Jonathan Shook
2db6c6cf63
Update codeql-analysis.yml
changing environment to support normal build
2022-11-22 22:35:33 -06:00
Jonathan Shook
18ba2fdaf9
Merge branch 'main' into shutdown_hooks 2022-11-22 22:24:03 -06:00
Jonathan Shook
8602d5b532
Merge pull request #793 from yabinmeng/main
Add README file and adjust sample yaml files
2022-11-22 22:23:19 -06:00
snyk-bot
3b616d7d29
fix: adapter-dynamodb/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424
2022-11-23 03:43:06 +00:00
Jonathan Shook
eaefd9a1b2
Merge pull request #781 from nosqlbench/780-sporadic-buildtest-failures-gh-actions
Sporadic test failures w/ gh actions
2022-11-22 18:14:30 -06:00
Jonathan Shook
69617042b1 minor fixes on PR 2022-11-22 18:11:43 -06:00
Jonathan Shook
28f561aedd direct work-around for flaky test, simple improvements to logging, some improvements to consistent view of status, misc cleanups 2022-11-22 10:49:12 -06:00
snyk-bot
0193ed3556
fix: adapter-dynamodb/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424
2022-11-22 03:27:55 +00:00
yabinmeng
c077218e8a Fix example yaml file producer and consumer parameter names 2022-11-21 21:05:26 -06:00
Jonathan Shook
16417f37b6 additional diagnostics for spurious test 2022-11-21 10:24:28 -06:00
yabinmeng
f7c9e50f35 Add README file and adjust sample yaml files 2022-11-19 18:53:58 -06:00
Jonathan Shook
eb0013f164 logging updates for build sanity checking 2022-11-19 12:02:11 -06:00
Jonathan Shook
bc4773269f build workflow should upload logfiles for success() or failure() of previous jobs, but not when canceled 2022-11-19 00:55:58 -06:00
Jonathan Shook
40c9682340 Merge branch '780-sporadic-buildtest-failures-gh-actions' of github.com:nosqlbench/nosqlbench into 780-sporadic-buildtest-failures-gh-actions 2022-11-18 23:52:55 -06:00
jeffbanks
dcf7baf867 Dead code utest resurrection and timing w/ gh actions
Cyclerate=10 to test github actions part2
Debug and exception handling
Detailed error handler logging
System out diagnostics
Capture step included
Try-catch diagnostics.
sysout cleanup; general cleanup
2022-11-18 23:52:29 -06:00
Jonathan Shook
20ed4950d4 removing broken actions plugin on main 2022-11-18 23:32:41 -06:00
Jonathan Shook
2831d8c3fc Merge branch 'main' of github.com:nosqlbench/nosqlbench 2022-11-18 23:29:08 -06:00
Jonathan Shook
3e8153dd87
Merge pull request #792 from yabinmeng/main
New consumer subscription feature; fix consumer DLT loading issue; code cleanup and reorg
2022-11-18 23:27:23 -06:00
Jonathan Shook
b8684107bb memoize retries in hot code path 2022-11-18 23:20:09 -06:00
Jonathan Shook
ebb6f2c58d include space usage in diag for testing 2022-11-18 23:18:48 -06:00
Jonathan Shook
48192cbdef close native driver connections on on activity+space shutdown 2022-11-18 23:18:44 -06:00
Jonathan Shook
4471d90ccb implement closeable spaces via decorator interface 2022-11-18 23:18:32 -06:00
yabinmeng
bd8aff9081 Added support for 1) subscription initial position and 2) regex subscription mode
Also fixed a consumer configuration loading issue with dlq/negAck/ackTimeout policy using Pulsar client's loadConf() API.

Addressed the review comments in PR #791; reverted the changes in ActivityMetrics and BasedOpDispenser
2022-11-18 18:22:04 -06:00
jeffbanks
35eec4d81f Dead code utest resurrection and timing w/ gh actions
Cyclerate=10 to test github actions part2
Debug and exception handling
Detailed error handler logging
System out diagnostics
Capture step included
Try-catch diagnostics.
sysout cleanup; general cleanup
2022-11-18 18:02:04 -06:00
Jonathan Shook
e80e9926cc
Merge pull request #791 from yabinmeng/main
Apache Pulsar native client API adapter for NB5
2022-11-17 19:11:22 -06:00
yabinmeng
0de7102884 Add support for
1) producer message compression
2) consumer DLT/negAck/ackTimeout policy

Add sample NB scenario yaml files
2022-11-17 18:47:37 -06:00
yabinmeng
12f8697e0e Complete the first draft of NB5 Pulsar adapter code, except the per-thread rate limiter. 2022-11-17 10:39:37 -06:00
yabinmeng
e128d2867a
Merge branch 'nosqlbench:main' into main 2022-11-17 10:27:28 -06:00
yabinmeng
0c71696b15 Completed NB4 Pulsar driver code migration to NB5. But there are still a few lingering issues due to the difference of how NB4 vs NB5 driver/adapter interacts with the NB engine. 2022-11-16 15:37:26 -06:00
Jonathan Shook
33e330dc35
[Snyk] Security upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.325 to 1.12.330 (#768)
* fix: nb-api/pom.xml to reduce vulnerabilities

The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424

* Timing change for github actions; warnings cleanup/refactor

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: jeffbanks <jeff.banks@datastax.com>
2022-11-14 18:32:52 -06:00
Jonathan Shook
2158dfa339
fix: upgrade io.netty:netty-handler from 4.1.81.Final to 4.1.82.Final (#767)
Snyk has created this PR to upgrade io.netty:netty-handler from 4.1.81.Final to 4.1.82.Final.

See this package in Maven Repository:
https://mvnrepository.com/artifact/io.netty/netty-handler/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/faf9c31c-14e2-456a-9f66-9dda91c923d9?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2022-11-14 17:16:39 -06:00
Jonathan Shook
5fc22bbaa5
fix: upgrade com.google.code.gson:gson from 2.9.0 to 2.9.1 (#766)
Snyk has created this PR to upgrade com.google.code.gson:gson from 2.9.0 to 2.9.1.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.google.code.gson/gson/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/fc9e1bd9-1d9a-474f-bde4-efb614c52ffe?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2022-11-14 17:16:14 -06:00
Jonathan Shook
6999a675f7
[Snyk] Upgrade io.dropwizard.metrics:metrics-core from 4.2.10 to 4.2.12 (#765)
* fix: upgrade io.dropwizard.metrics:metrics-core from 4.2.10 to 4.2.12

Snyk has created this PR to upgrade io.dropwizard.metrics:metrics-core from 4.2.10 to 4.2.12.

See this package in Maven Repository:
https://mvnrepository.com/artifact/io.dropwizard.metrics/metrics-core/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/fc9e1bd9-1d9a-474f-bde4-efb614c52ffe?utm_source=github&utm_medium=referral&page=upgrade-pr

* Timing change for github actions

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: jeffbanks <jeff.banks@datastax.com>
2022-11-14 17:03:11 -06:00
yabinmeng
ca6f2b052b Add PulsarAdapter specific metrics 2022-11-14 15:27:57 -06:00
Jonathan Shook
8b76d1fcf7 add shutdown hooks for adapters and spaces 2022-11-14 15:26:29 -06:00
Jonathan Shook
8c3d744a03
Merge pull request #764 from nosqlbench/snyk-upgrade-6693c12bca4fafc634662d8962afcb9a
[Snyk] Upgrade io.swagger.core.v3:swagger-models from 2.2.2 to 2.2.3
2022-11-14 14:13:42 -06:00
jeffbanks
eb1de8f1d5 Timing changes for github actions to properly perform build/test step. 2022-11-14 10:39:10 -06:00
Jonathan Shook
a05c511de7
fix: upgrade org.eclipse.jetty:jetty-server from 11.0.11 to 11.0.12 (#763)
Snyk has created this PR to upgrade org.eclipse.jetty:jetty-server from 11.0.11 to 11.0.12.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.eclipse.jetty/jetty-server/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/03cbee46-d5d2-41d3-89cc-a2ad77ab807a?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2022-11-14 09:50:20 -06:00
yabinmeng
c309d200ac - Delete unsed code "driver-jms"
- NB5 Pulsar driver Admin functionality in place - create/delete tenant, namespace, and topic
2022-11-11 18:36:06 -06:00
Jonathan Shook
2b9452fde4
Buildfixes, trying to unblock current builds (#777)
* make example/test script more robust for meager github actions environment
* improve wording around op template resolution
* remove blocking issues github actions plugin, since it is broken
2022-11-11 16:17:36 -06:00
snyk-bot
fe268d7f85
fix: nb-api/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-3038424
2022-11-11 22:00:38 +00:00