Commit Graph

356 Commits

Author SHA1 Message Date
nb-droid
3449740ed6 [maven-release-plugin] prepare for next development iteration 2021-12-23 03:05:06 +00:00
nb-droid
deeed3a523 [maven-release-plugin] prepare release nosqlbench-4.15.74 2021-12-23 03:05:03 +00:00
nb-droid
d31d7c5dc0 [maven-release-plugin] prepare for next development iteration 2021-12-23 02:53:13 +00:00
nb-droid
71309b0909 [maven-release-plugin] prepare release nosqlbench-4.15.73 2021-12-23 02:53:11 +00:00
Jonathan Shook
1c490cfbe0 merge fixups 2021-12-22 20:33:17 -06:00
Jonathan Shook
7deb11b9ef add base Op behaviors 2021-12-21 13:08:27 -06:00
Jonathan Shook
9c765f29a8 make ThreadLocals transient for gson compat in Java 17 2021-12-21 13:08:03 -06:00
nb-droid
4b03bd7bd4 [maven-release-plugin] prepare for next development iteration 2021-12-20 22:06:21 +00:00
nb-droid
3c838c17a1 [maven-release-plugin] prepare release nosqlbench-4.15.72 2021-12-20 22:06:19 +00:00
nb-droid
653815884c [maven-release-plugin] prepare for next development iteration 2021-12-13 20:59:35 +00:00
nb-droid
d82f3c803c [maven-release-plugin] prepare release nosqlbench-4.15.71 2021-12-13 20:59:33 +00:00
nb-droid
253eca7f76 [maven-release-plugin] prepare for next development iteration 2021-12-09 22:49:09 +00:00
nb-droid
49f7d4a6c2 [maven-release-plugin] prepare release nosqlbench-4.15.70 2021-12-09 22:49:07 +00:00
nb-droid
17a34b1078 [maven-release-plugin] prepare for next development iteration 2021-12-09 20:37:45 +00:00
nb-droid
ac8168c95e [maven-release-plugin] prepare release nosqlbench-4.15.69 2021-12-09 20:37:42 +00:00
nb-droid
a901c0688c [maven-release-plugin] prepare for next development iteration 2021-12-09 19:12:17 +00:00
nb-droid
c20a631335 [maven-release-plugin] prepare release nosqlbench-4.15.68 2021-12-09 19:12:14 +00:00
nb-droid
6e9efabc1c [maven-release-plugin] prepare for next development iteration 2021-12-09 16:18:04 +00:00
nb-droid
6770578bae [maven-release-plugin] prepare release nosqlbench-4.15.67 2021-12-09 16:18:00 +00:00
Lari Hotari
b0b79f6bee Add docs 2021-12-09 08:32:56 +02:00
Lari Hotari
caceaed638 Add way to calculate end-to-end latency from event time 2021-12-09 07:20:34 +02:00
Lari Hotari
fb30deb1ff Reduce code duplication in PulsarConsumerOp 2021-12-09 07:20:34 +02:00
Lari Hotari
72e32acd49 Cleanup parameter parsing in ReadyPulsarOp
- reduce duplication
2021-12-08 10:28:50 +02:00
nb-droid
89eebcda58 [maven-release-plugin] prepare for next development iteration 2021-11-20 00:10:18 +00:00
nb-droid
ba8a1c7069 [maven-release-plugin] prepare release nosqlbench-4.15.66 2021-11-20 00:10:16 +00:00
nb-droid
de3b0816cf [maven-release-plugin] prepare for next development iteration 2021-11-19 00:05:06 +00:00
nb-droid
a6de092ff8 [maven-release-plugin] prepare release nosqlbench-4.15.65 2021-11-19 00:05:03 +00:00
Yabin Meng
4076f79b63 README update 2021-11-13 21:28:54 -06:00
Lari Hotari
b42f354dbd Pulsar: Workaround an ordering bug in the Pulsar client
- see https://github.com/apache/pulsar/pull/12456 for details.
  - the bug applies to the use of receiveAsync and the workaround
    is to avoid the use of receiveAsync until the fix is included in the client
- receiveAsync was introduced previously to workaround the bug https://github.com/apache/pulsar/issues/9921
  - that issue isn't critical
2021-11-11 14:24:24 +02:00
Jonathan Shook
e6f1707d36 post-merge fixups 2021-11-10 14:37:55 -06:00
nb-droid
1b812bcf29 [maven-release-plugin] prepare for next development iteration 2021-11-10 17:29:51 +00:00
nb-droid
1ca659dd3f [maven-release-plugin] prepare release nosqlbench-4.15.64 2021-11-10 17:29:49 +00:00
Jonathan Shook
d9ce624355
Merge pull request #374 from nosqlbench/pulsar-payload-rtt
add instrumentation scaffold for payloadRtt
2021-11-10 10:29:18 -06:00
Matt Fleming
8353a9d842 Extract payload rtt field from Avro record if it exists 2021-11-10 13:56:18 +00:00
Matt Fleming
c15bd97c97 Avoid NullPointerException if pulsarCache hasn't been initialized. 2021-11-10 13:56:18 +00:00
Jonathan Shook
2fbf0b4ad3 add instrumentation scaffold for payloadRtt 2021-11-10 13:56:18 +00:00
Jonathan Shook
1c98935d1a post-merge fixups 2021-11-09 22:37:56 -06:00
Jonathan Shook
574e297e15 add exception message to some errors 2021-11-09 22:35:37 -06:00
Jonathan Shook
e5715e17a8 init pulsar cache early to avoid NPE on initialization error 2021-11-09 22:29:54 -06:00
Jonathan Shook
6f29b9005d update missing field 2021-11-09 22:27:27 -06:00
Yabin Meng
591f21b35a README and code cleanup 2021-11-05 15:48:17 -05:00
Jonathan Shook
3688dc9f3d pulsar.md readability formatting for console views 2021-11-04 16:37:05 -05:00
Jonathan Shook
53ab5832e2 post-merge fixups 2021-11-03 13:58:51 -05:00
nb-droid
231956001c [maven-release-plugin] prepare for next development iteration 2021-10-26 16:21:49 +00:00
nb-droid
2fadac5f80 [maven-release-plugin] prepare release nosqlbench-4.15.63 2021-10-26 16:21:47 +00:00
Jonathan Shook
fa78ca547c
Merge pull request #372 from lhotari/lh-detect-duplicates-after-gap
Pulsar driver: Improve message sequence tracking
2021-10-26 09:28:47 -05:00
Lari Hotari
71c3b190ed Detect delayed out-of-order delivery 2021-10-22 17:27:21 +03:00
Lari Hotari
85e1f8a649 Upgrade Pulsar client to 2.8.1 version 2021-10-21 15:27:53 +03:00
Lari Hotari
6b50060a9a Detect duplicates after a gap
- rename earliest -> lowest to clarify the real intention
- polish code
- add unit test
- increase duplicate counter if pending messages already contains the sequence number
2021-10-21 00:35:11 +03:00
nb-droid
956c3b698e [maven-release-plugin] prepare for next development iteration 2021-10-20 20:19:52 +00:00
nb-droid
dae9cc78f2 [maven-release-plugin] prepare release nosqlbench-4.15.62 2021-10-20 20:19:50 +00:00
nb-droid
53199e72bb [maven-release-plugin] prepare for next development iteration 2021-10-19 20:08:58 +00:00
nb-droid
d110c4bf7f [maven-release-plugin] prepare release nosqlbench-4.15.61 2021-10-19 20:08:56 +00:00
Jonathan Shook
bdb577f25d
Merge pull request #368 from lhotari/lh-threadlocal-sequence-tracking
Pulsar driver: Use thread local and topic based sequence number tracking
2021-10-19 14:40:13 -05:00
Lari Hotari
7a6ec96544 Pulsar: Use thread local and topic based sequence tracking 2021-10-18 17:03:28 +03:00
Lari Hotari
e660823473 Make ratelimiter instance thread specific for PulsarActivity
when cyclerate_per_thread is set to true
2021-10-18 14:25:49 +03:00
nb-droid
3cfda97413 [maven-release-plugin] prepare for next development iteration 2021-10-15 21:10:34 +00:00
nb-droid
e04f0fb85c [maven-release-plugin] prepare release nosqlbench-4.15.60 2021-10-15 21:10:32 +00:00
Jonathan Shook
cb47799652 merge fixups 2021-10-14 12:57:52 -05:00
Jonathan Shook
e77bfea043
Merge pull request #367 from yabinmeng/main
Convert message error runtime exception to counter metrics
2021-10-14 12:54:13 -05:00
Jonathan Shook
6569fa52ea reformat all pom.xml files 2021-10-14 12:50:11 -05:00
nb-droid
1d34c256f8 [maven-release-plugin] prepare for next development iteration 2021-10-13 18:03:38 +00:00
nb-droid
bfd7e2513b [maven-release-plugin] prepare release nosqlbench-4.15.59 2021-10-13 18:03:35 +00:00
Yabin Meng
ed4ba2725e Convert message error runtime exception to counter metrics 2021-10-13 11:27:54 -05:00
Yabin Meng
ac2fdf2a2e Convert message error runtime exception to counter metrics 2021-10-13 10:11:20 -05:00
Yabin Meng
686af3d9ca Convert message error runtime exception to counter metrics 2021-10-13 10:10:48 -05:00
nb-droid
7c2e26d80d [maven-release-plugin] prepare for next development iteration 2021-10-11 22:43:07 +00:00
nb-droid
28df8b297a [maven-release-plugin] prepare release nosqlbench-4.15.58 2021-10-11 22:43:05 +00:00
Yabin Meng
2876e102a6 Remove namespace and topic level dedup setting check for each run, which is too much overhead. 2021-10-09 12:29:22 -05:00
Yabin Meng
11073cf0aa Address Shooky's comment in PR#364. 2021-10-07 14:56:51 -05:00
Yabin Meng
265760d184 Address Lari's comment in PR#364. 2021-10-06 11:41:50 -05:00
Yabin Meng
eb5f42f46d Fix NullPointerException of checking namespace and topic deduplication status. 2021-10-06 10:55:32 -05:00
Jonathan Shook
666279decd Merge branch 'main' into driver-api
# Conflicts:
#	RELEASENOTES.md
#	driver-cql-shaded/pom.xml
#	driver-cqld3-shaded/pom.xml
#	driver-diag/pom.xml
#	driver-dsegraph-shaded/pom.xml
#	driver-http/pom.xml
#	driver-jdbc/pom.xml
#	driver-jms/pom.xml
#	driver-jmx/pom.xml
#	driver-kafka/pom.xml
#	driver-mongodb/pom.xml
#	driver-pulsar/pom.xml
#	driver-stdout/pom.xml
#	driver-tcp/pom.xml
#	driver-web/pom.xml
#	engine-api/src/test/java/io/nosqlbench/engine/api/activityapi/ratelimits/TestRateLimiterPerf1E8.java
#	mvn-defaults/pom.xml
#	nb-api/pom.xml
#	nb/pom.xml
2021-10-05 13:31:23 -05:00
nb-droid
5550c4550a [maven-release-plugin] prepare for next development iteration 2021-10-05 15:47:15 +00:00
nb-droid
4cd39c2d9b [maven-release-plugin] prepare release nosqlbench-4.15.57 2021-10-05 15:47:12 +00:00
yabinmeng
bf98d6440f
Merge branch 'nosqlbench:main' into main 2021-10-02 16:23:29 -05:00
Yabin Meng
793af965af Ignore abnormal message processing error for Shared and Key_Shared subscription type. 2021-10-02 16:23:12 -05:00
nb-droid
35779298a4 [maven-release-plugin] prepare for next development iteration 2021-09-29 21:13:43 +00:00
nb-droid
dfefdd91f0 [maven-release-plugin] prepare release nosqlbench-4.15.56 2021-09-29 21:13:41 +00:00
Yabin Meng
d781e1ac22 README update about customized Pular driver exception 2021-09-29 11:37:07 -05:00
Yabin Meng
949790b797 Add customized Pulsar driver exceptions 2021-09-29 11:27:24 -05:00
Yabin Meng
f72bdb6b95 Readme TOC update 2021-09-28 23:19:49 -05:00
Yabin Meng
e9e7e95113 Add support for message duplication check (if message de-duplication is enabled, either at broker-level, namespace-level, or topic-level) 2021-09-28 23:04:46 -05:00
nb-droid
fd7a6176dd [maven-release-plugin] prepare for next development iteration 2021-09-24 21:03:24 +00:00
nb-droid
8a46ff132a [maven-release-plugin] prepare release nosqlbench-4.15.55 2021-09-24 21:03:22 +00:00
Yabin Meng
d8bc8ce4fd README update 2021-09-24 09:46:45 -05:00
Yabin Meng
da7fd8948e Merge remote-tracking branch 'upstream/main' 2021-09-24 09:28:25 -05:00
Yabin Meng
6903a23049 README update 2021-09-24 09:27:43 -05:00
nb-droid
d9de9cb83a [maven-release-plugin] prepare for next development iteration 2021-09-24 10:18:39 +00:00
nb-droid
55bf54402b [maven-release-plugin] prepare release nosqlbench-4.15.54 2021-09-24 10:18:37 +00:00
Yabin Meng
3ef807172b NB Pulsar driver enhancement (milestone 11: https://github.com/nosqlbench/nosqlbench/milestone/11)
- add support for message properties
- add support for end-to-end latency measurement (latency histogram)
- add support for message out-of-order and loss detect
- add async api for consumer
- split single-topic consumer and multi-topic consumer
- SSL/TLS bug fix
- Code cleanup
2021-09-22 17:17:53 -05:00
nb-droid
cbaa1f823f [maven-release-plugin] prepare for next development iteration 2021-09-15 17:18:35 +00:00
nb-droid
8928d49328 [maven-release-plugin] prepare release nosqlbench-4.15.53 2021-09-15 17:18:33 +00:00
nb-droid
871dab0dc7 [maven-release-plugin] prepare for next development iteration 2021-09-13 17:58:14 +00:00
nb-droid
3dc51f7581 [maven-release-plugin] prepare release nosqlbench-4.15.52 2021-09-13 17:58:12 +00:00
Jonathan Shook
720d731594 add missing files from previous commit 2021-09-13 09:51:13 -05:00
Jonathan Shook
15eedea561 merge fixups 2021-07-20 20:08:03 -05:00
Jonathan Shook
a12efd0db6 merge fixups - partial 2021-07-20 18:26:13 -05:00
Yabin Meng
c175411cdb Update Pulsar API to 2.8.0 2021-07-20 13:31:40 -05:00
nb-droid
98ec7718b0 [maven-release-plugin] prepare for next development iteration 2021-07-13 21:32:35 +00:00
nb-droid
6acebb1746 [maven-release-plugin] prepare release nosqlbench-4.15.51 2021-07-13 21:32:29 +00:00
Jonathan Shook
ed91ec7d41 fully generify OpSequence 2021-07-06 11:11:36 -05:00
Jonathan Shook
d0371ecc16 naming updates for clarity 2021-06-24 11:18:47 -05:00
Jonathan Shook
a80e6d599b post-merge fix-ups 2021-06-22 11:10:42 -05:00
nb-droid
6403fcaf7f [maven-release-plugin] prepare for next development iteration 2021-06-21 22:04:06 +00:00
nb-droid
eed77ddf35 [maven-release-plugin] prepare release nosqlbench-4.15.50 2021-06-21 22:04:00 +00:00
nb-droid
7c37b4d278 [maven-release-plugin] prepare for next development iteration 2021-06-21 20:29:27 +00:00
nb-droid
8ede4d8ada [maven-release-plugin] prepare release nosqlbench-4.15.49 2021-06-21 20:29:21 +00:00
Christopher Lambert
950b31fbae fix errors found by errorprone 2021-06-17 15:03:16 +02:00
nb-droid
2ac5c1add2 [maven-release-plugin] prepare for next development iteration 2021-06-10 20:45:03 +00:00
nb-droid
4120afc161 [maven-release-plugin] prepare release nosqlbench-4.15.48 2021-06-10 20:44:57 +00:00
Christopher Lambert
94f93fe4af simplify cache key creation in pulsar + jms driver 2021-06-10 12:20:13 +02:00
Jonathan Shook
adc60e66a2 post-merge fixups 2021-06-02 18:11:47 -05:00
nb-droid
11eabce923 [maven-release-plugin] prepare for next development iteration 2021-06-01 22:57:35 +00:00
nb-droid
590c273b13 [maven-release-plugin] prepare release nosqlbench-4.15.47 2021-06-01 22:57:30 +00:00
Jonathan Shook
7f6097135b update mvn-default relative pom path 2021-05-13 16:11:37 -05:00
Jonathan Shook
4422f45c67 merging main into driver-api 2021-05-13 13:02:33 -05:00
Jonathan Shook
31873af0fd grpc partial work 2021-05-13 12:57:09 -05:00
nb-droid
421ce3ac73 [maven-release-plugin] prepare for next development iteration 2021-05-13 16:34:24 +00:00
nb-droid
e3be6ccf19 [maven-release-plugin] prepare release nosqlbench-4.15.46 2021-05-13 16:34:20 +00:00
nb-droid
44b5a033fa [maven-release-plugin] prepare for next development iteration 2021-05-11 04:37:18 +00:00
nb-droid
7e56516c7f [maven-release-plugin] prepare release nosqlbench-4.15.45 2021-05-11 04:37:14 +00:00
yabinmeng-gitee
e6491433ae Add Pulsar client, producer, and consumer configuration support 2021-05-05 20:18:26 -05:00
nb-droid
71939a17f1 [maven-release-plugin] prepare for next development iteration 2021-04-27 20:38:48 +00:00
nb-droid
d122f338db [maven-release-plugin] prepare release nosqlbench-4.15.44 2021-04-27 20:38:44 +00:00
nb-droid
635abb93a5 [maven-release-plugin] prepare for next development iteration 2021-04-27 00:44:02 +00:00
nb-droid
53d1db26dc [maven-release-plugin] prepare release nosqlbench-4.15.43 2021-04-27 00:43:57 +00:00
nb-droid
a926bb3343 [maven-release-plugin] prepare for next development iteration 2021-04-26 20:52:06 +00:00
nb-droid
1c665ff859 [maven-release-plugin] prepare release nosqlbench-4.15.42 2021-04-26 20:52:02 +00:00
nb-droid
871350d42a [maven-release-plugin] prepare for next development iteration 2021-04-22 00:32:13 +00:00
nb-droid
f14b2c6bac [maven-release-plugin] prepare release nosqlbench-4.15.41 2021-04-22 00:32:07 +00:00
nb-droid
1b152406b2 [maven-release-plugin] prepare for next development iteration 2021-04-21 17:09:28 +00:00
nb-droid
514901859d [maven-release-plugin] prepare release nosqlbench-4.15.40 2021-04-21 17:09:24 +00:00
Enrico Olivelli
30e4942341 Pulsar: first prototype of transaction support 2021-04-21 12:48:46 +02:00
nb-droid
2e5701a146 [maven-release-plugin] prepare for next development iteration 2021-04-19 15:48:30 +00:00
nb-droid
b148216ea5 [maven-release-plugin] prepare release nosqlbench-4.15.39 2021-04-19 15:48:25 +00:00
nb-droid
089b8ca857 [maven-release-plugin] prepare for next development iteration 2021-04-18 00:24:20 +00:00
nb-droid
53bc9b80f5 [maven-release-plugin] prepare release nosqlbench-4.15.38 2021-04-18 00:24:15 +00:00
nb-droid
dd9e411786 [maven-release-plugin] prepare for next development iteration 2021-04-16 20:57:26 +00:00
nb-droid
b78b788b98 [maven-release-plugin] prepare release nosqlbench-4.15.37 2021-04-16 20:57:21 +00:00
nb-droid
7b3f9f87d2 [maven-release-plugin] prepare for next development iteration 2021-04-15 22:17:52 +00:00
nb-droid
0356580d29 [maven-release-plugin] prepare release nosqlbench-4.15.36 2021-04-15 22:17:48 +00:00
nb-droid
a19e34b9fc [maven-release-plugin] prepare for next development iteration 2021-04-14 16:42:12 +00:00
nb-droid
12438b00d5 [maven-release-plugin] prepare release nosqlbench-4.15.35 2021-04-14 16:42:07 +00:00
nb-droid
918490ec56 [maven-release-plugin] prepare for next development iteration 2021-04-14 00:59:46 +00:00
nb-droid
8c037655b3 [maven-release-plugin] prepare release nosqlbench-4.15.34 2021-04-14 00:59:42 +00:00
yabinmeng-gitee
657d5b80b6 Add Producer config parameters in config.properties:
- blockIfQueueFull
- maxPendingMessages
- batchingMaxMessages
2021-04-09 19:14:21 -05:00
yabinmeng-gitee
7fdd6af284 Bug fix of Pulsar Async API 2021-04-09 18:10:14 -05:00
nb-droid
33184e1182 [maven-release-plugin] prepare for next development iteration 2021-04-08 20:14:34 +00:00
nb-droid
6483a5bb0b [maven-release-plugin] prepare release nosqlbench-4.15.33 2021-04-08 20:14:30 +00:00