Commit Graph

231 Commits

Author SHA1 Message Date
Jonathan Shook
c98d5ffc66 cqlgen improvements and improved structure 2022-07-26 01:14:58 -05:00
Jonathan Shook
30f67d9002 Merge branch 'main' of github.com:nosqlbench/nosqlbench 2022-07-19 12:30:26 -05:00
Jonathan Shook
080b40b08f minor formatting fixes 2022-07-19 12:19:30 -05:00
Jonathan Shook
1df11fa776 add main scenarios for main sections separately 2022-07-19 12:19:21 -05:00
Jonathan Shook
279bb2242f fix for cardinality estimates: rebind all patition keys with the same modulo 2022-07-19 12:18:38 -05:00
nb-droid
4a3845aafb [maven-release-plugin] prepare for next development iteration 2022-07-19 16:11:11 +00:00
nb-droid
b5d4e1e3c6 [maven-release-plugin] prepare release nosqlbench-4.17.20 2022-07-19 16:11:09 +00:00
Jonathan Shook
1d1c96f9bf checkpoint: paths and packages cleanup, tri-state filtering on keyspaces, more efficient init, LOCAL_QUORUM 2022-07-19 01:41:23 -05:00
Jonathan Shook
e79b09ace7 Skip inserts on counter tables, simplify multi-block tag predicates 2022-07-17 17:18:07 -05:00
Jonathan Shook
fbd8947e7a checkpoint:
* fixed binding null issue with warning for none found
* configurable naming support in obfuscator
* partial implementation of text transformer
2022-07-17 17:06:10 -05:00
Jonathan Shook
562978c9cc fix quotes in scenarios 2022-07-17 13:10:37 -05:00
Jonathan Shook
1d19164390 fixed syntax error in scan and select predicates 2022-07-17 03:58:55 -05:00
Jonathan Shook
c0cb4c0226 checkpoint; many fixes and enhancements:
* use config file with modular elements
* eliminated opaque DDL hacks, generating everything from AST data now
* (thus) obfuscation supported
* weighting based on partition counts
* (from weighting) Modulo bindings with quantized cardinalities
* binding re-use for identical definitions
* custom timeouts supported by op type
* extended CQL driver properties
* name-based workload phases
2022-07-17 03:39:19 -05:00
Jonathan Shook
fb200e0b58 checkpoint: exporter.yaml config and many transformers added (see the file) 2022-07-15 19:44:58 -05:00
Jonathan Shook
2af5f2c39a first cut of obfuscator 2022-07-15 11:26:33 -05:00
Jonathan Shook
4e08b65f2d package refactoring 2022-07-14 20:40:06 -05:00
Jonathan Shook
789cc62430 package refactoring 2022-07-14 19:01:00 -05:00
Jonathan Shook
09fd16a632 preprocessor fix for ratio calculations 2022-07-14 19:00:35 -05:00
Jonathan Shook
481fb5855b test fix 2022-07-14 00:07:20 -05:00
Jonathan Shook
080d9005e0 checkpoint:
various fixes to enable rampup and main phases
 inclusion of Mark Wolters stats parsing; ratio injection based on nodetool stats
 allow bind point names to include angle brackets
 disable raw format processing
2022-07-13 20:42:10 -05:00
Jonathan Shook
71fd51225c fix bug in udt elision 2022-07-13 16:49:50 -05:00
Jonathan Shook
fd3461fd29 checkpoint: simplify binding names, swap blob in for udts, naming styles, literal formats 2022-07-13 14:54:12 -05:00
Jonathan Shook
652d9928c0 fix broken test because of UDT work-around 2022-07-13 11:22:24 -05:00
Jonathan Shook
0dc7a2f157 test classpath and loader fixes 2022-07-13 10:30:32 -05:00
Jonathan Shook
50e617233f test classpath and loader fixes 2022-07-13 02:16:52 -05:00
Jonathan Shook
540abeee00 test classpath and loader fixes 2022-07-13 02:14:28 -05:00
Jonathan Shook
a2077e8a98 checkpoint on progress, naming indirection, primary key models, where predicates 2022-07-13 01:48:05 -05:00
Jonathan Shook
3db4b88289 typo fix in pom for cqld4 2022-07-13 01:48:01 -05:00
Jonathan Shook
ad5fa2c51f support both hosts and host params for cqld4 2022-07-13 01:47:58 -05:00
Jonathan Shook
2fa96ec56c improve CQL diagnostics handling and messaging 2022-07-13 01:47:55 -05:00
Jonathan Shook
0ff3e38a25 add missing binding functions for new types 2022-07-13 01:47:40 -05:00
Jonathan Shook
1df8421231 externalize default cql bindings to included yaml for quick turnarounds 2022-07-13 01:47:37 -05:00
Jonathan Shook
c683652acb checkpoint on progress, naming indirection, primary key models, where predicates 2022-07-12 21:20:51 -05:00
Jonathan Shook
2df9e6b044 fully parsing the example file now 2022-07-11 18:44:38 -05:00
Jonathan Shook
454412aa8f checkpoint 2022-07-11 15:25:54 -05:00
Jonathan Shook
4ff4e18178 clean antlr4 generated packages too 2022-07-11 12:41:15 -05:00
Jonathan Shook
ebd3b775a5 checkpoint update 2022-07-11 10:59:18 -05:00
Jonathan Shook
e4f7e7e771 updates to cql workload generator 2022-07-08 10:20:33 -05:00
Jonathan Shook
ce070d2c19 checkpoint 2022-07-07 11:20:12 -07:00
Jonathan Shook
1ea3391e76 checkpoint 2022-07-07 12:03:34 -05:00
nb-droid
28c62da74f [maven-release-plugin] prepare for next development iteration 2022-07-01 16:46:05 +00:00
nb-droid
3bdad2a877 [maven-release-plugin] prepare release nosqlbench-4.17.19 2022-07-01 16:46:03 +00:00
nb-droid
460ad79f6c [maven-release-plugin] prepare for next development iteration 2022-07-01 15:56:59 +00:00
nb-droid
0937ed9f6a [maven-release-plugin] prepare release nosqlbench-4.17.18 2022-07-01 15:56:57 +00:00
nb-droid
bfdf87a3ad [maven-release-plugin] prepare for next development iteration 2022-07-01 15:26:38 +00:00
nb-droid
45c1a7b7da [maven-release-plugin] prepare release nosqlbench-4.17.17 2022-07-01 15:26:36 +00:00
nb-droid
3155147bfa [maven-release-plugin] prepare for next development iteration 2022-07-01 07:04:04 +00:00
nb-droid
215b32bd6a [maven-release-plugin] prepare release nosqlbench-4.17.16 2022-07-01 07:04:02 +00:00
Jonathan Shook
60d09de4c1
Merge pull request #617 from nosqlbench/snyk-upgrade-0b4895ccde47fb2ef46dc64c2800aa3f
[Snyk] Upgrade org.codehaus.groovy:groovy from 3.0.10 to 3.0.11
2022-07-01 01:47:38 -05:00
nb-droid
ca6f3a08c8 [maven-release-plugin] prepare for next development iteration 2022-07-01 06:40:47 +00:00
nb-droid
b9c8bdefb9 [maven-release-plugin] prepare release nosqlbench-4.17.15 2022-07-01 06:40:45 +00:00
Stefano Lottini
e9e648efc6 Fix indentation in baselines2/cql-keyvalue2.yaml for schema-astra block 2022-07-01 01:12:02 +02:00
Jonathan Shook
4c34c1b2be fix parser issues with empty template vars, make matching more relaxed 2022-06-30 17:25:34 -05:00
Jonathan Shook
2e4776f893 improve parser error messages to include op template name 2022-06-30 16:11:17 -05:00
snyk-bot
3bac2fe3d3
fix: upgrade org.codehaus.groovy:groovy from 3.0.10 to 3.0.11
Snyk has created this PR to upgrade org.codehaus.groovy:groovy from 3.0.10 to 3.0.11.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.codehaus.groovy/groovy/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/f2d62bab-282e-4a32-8fb9-1a067980e81a?utm_source=github&utm_medium=referral&page=upgrade-pr
2022-06-30 20:20:45 +00:00
Jonathan Shook
1371bee288 fixup workloads for cql 2022-06-30 00:57:43 -05:00
Jonathan Shook
066615ec81 updated cql-timeseries2 to nb5 format and cql driver 4 types 2022-06-29 22:37:01 -05:00
Jonathan Shook
8d3d92987d baselinesv2 format updates for nb5, no substance change only structure 2022-06-29 20:45:21 -05:00
Jonathan Shook
a7c29b2825 op dispensers remember their parent adapter 2022-06-29 20:45:16 -05:00
Jonathan Shook
9a42b09b81 update progress meter for readability 2022-06-28 19:48:38 -05:00
Jonathan Shook
a6df79c322 include ESRI codecs to squelch verbose logging error 2022-06-28 18:23:16 -05:00
Jonathan Shook
6ba0cbc319 allow cqld4 to run for driver=cql with no verbose warnings 2022-06-28 18:19:44 -05:00
Jonathan Shook
007d90218d modularize result size and disregard n/a scenarios 2022-06-27 23:44:38 -05:00
Jonathan Shook
50f81078bd make api type more obvious 2022-06-27 23:44:19 -05:00
Jonathan Shook
586bb4c566 updates to string template naming 2022-06-24 00:59:34 -05:00
Jonathan Shook
80fe4f1f48 Merge branch 'diag-conversion' 2022-06-23 00:20:49 -05:00
Jonathan Shook
d65bdca471 merge fixups 2022-06-23 00:20:33 -05:00
Jonathan Shook
19164ef77f lose drivers-api module, keep adapaters-api module 2022-06-22 23:13:04 -05:00
Jonathan Shook
2546af1520 remove old cql driver stubs 2022-06-16 15:13:38 -05:00
Jonathan Shook
64da6df3e8 improve error details to help users fix issues faster 2022-06-16 15:13:25 -05:00
Jonathan Shook
6bb1800c3b
Merge pull request #593 from nosqlbench/snyk-upgrade-134d3120f61472b51715c96134712fbd
[Snyk] Upgrade com.datastax.oss:java-driver-query-builder from 4.13.0 to 4.14.0
2022-06-06 10:06:35 -05:00
Jonathan Shook
26f53f855d merge fixes 2022-06-02 17:15:13 -05:00
Jonathan Shook
1437029eb3 remove pattern matching in switch syntax and remove --enable-preview completely. It is too onerous for users at runtime. 2022-06-02 17:12:36 -05:00
Jonathan Shook
5aaae15592 add cqld4 prepared statement binding diagnostics for errors 2022-06-02 16:41:43 -05:00
Jonathan Shook
e4be17a268 synchronize driver artifacts for cqld4 2022-06-02 16:40:37 -05:00
Jonathan Shook
755ea768d5 minor docs update 2022-05-31 21:01:46 -05:00
snyk-bot
2fecd26e2d
fix: upgrade org.codehaus.groovy:groovy from 3.0.9 to 3.0.10
Snyk has created this PR to upgrade org.codehaus.groovy:groovy from 3.0.9 to 3.0.10.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.codehaus.groovy/groovy/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/f2d62bab-282e-4a32-8fb9-1a067980e81a?utm_source=github&utm_medium=referral&page=upgrade-pr
2022-05-25 22:37:51 +00:00
snyk-bot
a64655147a
fix: upgrade com.datastax.oss:java-driver-query-builder from 4.13.0 to 4.14.0
Snyk has created this PR to upgrade com.datastax.oss:java-driver-query-builder from 4.13.0 to 4.14.0.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.datastax.oss/java-driver-query-builder/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/f2d62bab-282e-4a32-8fb9-1a067980e81a?utm_source=github&utm_medium=referral&page=upgrade-pr
2022-05-25 22:37:48 +00:00
Jonathan Shook
102cc3f559 make TypeAndTarget concept more obvious 2022-05-24 13:39:45 -05:00
nb-droid
124c92256f [maven-release-plugin] prepare for next development iteration 2022-05-18 19:49:25 +00:00
nb-droid
2aaef696f9 [maven-release-plugin] prepare release nosqlbench-4.17.14 2022-05-18 19:49:23 +00:00
nb-droid
dcd8e59308 [maven-release-plugin] prepare for next development iteration 2022-05-18 19:13:14 +00:00
nb-droid
556ab55d4c [maven-release-plugin] prepare release nosqlbench-4.17.13 2022-05-18 19:13:11 +00:00
Jonathan Shook
31384c7d11 updated version to 4.17.13-SNAPSHOT 2022-05-18 14:02:41 -05:00
snyk-bot
fe5508dc9b
fix: adapter-cqld4/pom.xml to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2326698
- https://snyk.io/vuln/SNYK-JAVA-COMFASTERXMLJACKSONCORE-2421244
- https://snyk.io/vuln/SNYK-JAVA-COMGITHUBJNR-1570422
2022-04-29 19:29:47 +00:00
snyk-bot
f8ea416082
fix: upgrade com.datastax.oss:java-driver-core from 4.13.0 to 4.14.0
Snyk has created this PR to upgrade com.datastax.oss:java-driver-core from 4.13.0 to 4.14.0.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.datastax.oss/java-driver-core/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/f2d62bab-282e-4a32-8fb9-1a067980e81a?utm_source=github&utm_medium=referral&page=upgrade-pr
2022-03-23 14:53:40 +00:00
Jonathan Shook
82879387fc
Merge pull request #533 from nosqlbench/snyk-upgrade-8195ab761e488f5526cd7562048aec40
[Snyk] Upgrade org.apache.tinkerpop:gremlin-core from 3.4.12 to 3.5.2
2022-03-22 11:59:13 -05:00
Jonathan Shook
980996969f adjusted snyk PR to use co-compatible gremlin and tinkerpop versions wiht CQL driver 2022-03-22 11:54:06 -05:00
snyk-bot
c4590bcffc
fix: upgrade org.apache.tinkerpop:gremlin-core from 3.4.12 to 3.5.2
Snyk has created this PR to upgrade org.apache.tinkerpop:gremlin-core from 3.4.12 to 3.5.2.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.apache.tinkerpop/gremlin-core/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/f2d62bab-282e-4a32-8fb9-1a067980e81a?utm_source=github&utm_medium=referral&page=upgrade-pr
2022-03-15 11:17:58 +00:00
snyk-bot
a920b9304c
fix: upgrade org.xerial.snappy:snappy-java from 1.1.7.3 to 1.1.8.4
Snyk has created this PR to upgrade org.xerial.snappy:snappy-java from 1.1.7.3 to 1.1.8.4.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.xerial.snappy/snappy-java/

See this project in Snyk:
https://app.snyk.io/org/jshook/project/f2d62bab-282e-4a32-8fb9-1a067980e81a?utm_source=github&utm_medium=referral&page=upgrade-pr
2022-03-15 11:17:53 +00:00
nb-droid
81c7d47885 [maven-release-plugin] prepare for next development iteration 2022-03-10 04:05:16 +00:00
nb-droid
882b1edaf8 [maven-release-plugin] prepare release nosqlbench-4.17.11 2022-03-10 04:05:14 +00:00
Jonathan Shook
65542f9b7d fix null values and dangling parameters in bundled workloads 2022-03-09 21:54:26 -06:00
nb-droid
384f430b92 [maven-release-plugin] prepare for next development iteration 2022-03-09 16:24:25 +00:00
nb-droid
66fae484e9 [maven-release-plugin] prepare release nosqlbench-4.17.10 2022-03-09 16:24:22 +00:00
Jonathan Shook
231d38f7ad add aplv2 headers to adapter-cqld4 2022-03-08 14:06:09 -06:00
Jonathan Shook
4ffc05254e merge of nb5-preview onto main, main is now the feed for nb5-preview work 2022-03-07 16:41:25 -06:00
Jonathan Shook
aba8973ad4 merge fixups to main (nb4) 2022-03-03 15:07:18 -06:00
nb-droid
7b302b25c1 [maven-release-plugin] prepare for next development iteration 2022-02-17 17:26:15 +00:00
nb-droid
b2382ac99b [maven-release-plugin] prepare release nosqlbench-4.17.9 2022-02-17 17:26:12 +00:00