Commit Graph

7020 Commits

Author SHA1 Message Date
Jonathan Shook
6b43b10509 this commit renames StandardActivity to Activity, as the one and only 2024-12-20 01:53:26 -06:00
Jonathan Shook
ced01b132b this commit fully replaces Activity with StandardActivity 2024-12-20 01:53:26 -06:00
Jonathan Shook
862ea8fd3b this commit fully replaces SimpleActivity with StandardActivity 2024-12-20 01:53:26 -06:00
Jonathan Shook
8c62576ff1 temp checkpoint 2024-12-20 01:53:26 -06:00
Jonathan Shook
7153ef6ee1 docs updates 2024-12-20 01:52:44 -06:00
Jonathan Shook
2750a9e6c4 typos 2024-12-20 01:52:44 -06:00
Jonathan Shook
532f8b8007 docs update 2024-12-20 01:52:44 -06:00
Jonathan Shook
9ea0266c9a
Update to Java 23 (#2120)
* docs update

* typos

* docs updates

* remove extra code and dependencies

* use Java 23

* update Graal for java 23

* update build chain to J23

* update to correct version

* bump build action to use java 23
2024-12-20 01:52:26 -06:00
Dave Fisher
1784f5dcd0
Add Property File Support plus Related Workload Improvements (#2115)
* Use Property Files for Environment Vars and as AtFiles

* Keep a private property overlay over system properties

* Add properties from file and use in workload templates

* Allow access to properties and env vars is enabled

* Reorder to ease reading the code

* Insert property, yaml, and json files

* Make exceptions meaningful

* Catch all errors on error insert file type

* Some RawOpsLoader Refactoring and other Small Fixes
2024-12-18 12:01:25 -08:00
Dave Fisher
79e2a4bf6e
Update build.yml to run builddocs on pull_request events (#2117) 2024-12-18 11:44:22 -08:00
Dave Fisher
d42245a4c7
More Advisor Parameter and Configuration Tests (#2114)
* More Advisor Parameter and Configuration Tests

* Check for workload parameters not in adapter
2024-12-13 14:49:51 -08:00
Jonathan Shook
e0881d86b5
fix: upgrade org.apache.logging.log4j:log4j-api from 2.24.1 to 2.24.2 (#2109)
Snyk has created this PR to upgrade org.apache.logging.log4j:log4j-api from 2.24.1 to 2.24.2.

See this package in maven:
org.apache.logging.log4j:log4j-api

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/06396ccf-ad82-4096-aa22-0a423b9edf2b?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-12-13 13:10:58 -08:00
Jonathan Shook
7dbff794e3
fix: upgrade org.apache.logging.log4j:log4j-core from 2.24.1 to 2.24.2 (#2110)
Snyk has created this PR to upgrade org.apache.logging.log4j:log4j-core from 2.24.1 to 2.24.2.

See this package in maven:
org.apache.logging.log4j:log4j-core

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/06396ccf-ad82-4096-aa22-0a423b9edf2b?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-12-13 13:10:27 -08:00
Jonathan Shook
0749e4e023
fix: upgrade org.apache.logging.log4j:log4j-jcl from 2.24.1 to 2.24.2 (#2111)
Snyk has created this PR to upgrade org.apache.logging.log4j:log4j-jcl from 2.24.1 to 2.24.2.

See this package in maven:
org.apache.logging.log4j:log4j-jcl

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/06396ccf-ad82-4096-aa22-0a423b9edf2b?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-12-13 13:09:44 -08:00
Jonathan Shook
51297e0d7e
fix: upgrade org.apache.logging.log4j:log4j-slf4j-impl from 2.24.1 to 2.24.2 (#2112)
Snyk has created this PR to upgrade org.apache.logging.log4j:log4j-slf4j-impl from 2.24.1 to 2.24.2.

See this package in maven:
org.apache.logging.log4j:log4j-slf4j-impl

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/06396ccf-ad82-4096-aa22-0a423b9edf2b?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-12-13 13:09:16 -08:00
Jonathan Shook
762de98c0b
fix: upgrade org.apache.logging.log4j:log4j-slf4j2-impl from 2.24.1 to 2.24.2 (#2113)
Snyk has created this PR to upgrade org.apache.logging.log4j:log4j-slf4j2-impl from 2.24.1 to 2.24.2.

See this package in maven:
org.apache.logging.log4j:log4j-slf4j2-impl

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/06396ccf-ad82-4096-aa22-0a423b9edf2b?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-12-13 13:08:44 -08:00
Dave Fisher
b6d437dcf0
Refactor ConfigModel Construction in StandardActivity (#2104)
* Refactor ConfigModel Construction in StandardActivity

* Tracking ConfigModel Param Classes

* ActivityDef ConfigMap and default ActivityDriver

* More complete config model for ActivityDef plus other small improvements

* Add NBAdvisor to StandardActivity

* NBAdvisor for Workload Params, Tags, and Bindings

* OF: Formatting

* Improve ActivityDef ConfigModel

* Refactor NBAdvisor output adding Debug level

* NBAdvisor output using fluent method

* Slight refactor and always fail condition

* SrInterpolator uses NBAdvisorPoint and NBAdvisorOutput improvements

* Check Cmd with NBAdvisor

* Add Advisor Name and Description to Logs

* Fix review comments
2024-12-13 10:31:22 -05:00
Jonathan Shook
4f88f832a8 fixed broken mvn coordinate 2024-12-11 13:53:30 -06:00
Jonathan Shook
de7152c65b disable maven caching in preview for diagnostics 2024-12-11 13:39:46 -06:00
Jonathan Shook
762f2e71c3 enable preview to update maven snapshots 2024-12-11 13:28:52 -06:00
Jonathan Shook
83065001ed force change for build troubleshooting 2024-12-11 13:02:14 -06:00
Jonathan Shook
ca38a710c3
Jshook/verification (#2107)
* docs update

* typos

* disable noisy prom exposition dump

* fix refkey bug

* move specs into non-test namespace

* remove unimplemented rainbow ops

* docs updates

* give credit to maintainers

* update milvus module to build clean on new APIs

* remove var keyword

* API remapping

* enable new op behaviors
2024-12-10 15:41:05 -06:00
dependabot[bot]
5fcc3b27fd
Bump softprops/action-gh-release from 2.0.9 to 2.1.0 (#2103)
Bumps [softprops/action-gh-release](https://github.com/softprops/action-gh-release) from 2.0.9 to 2.1.0.
- [Release notes](https://github.com/softprops/action-gh-release/releases)
- [Changelog](https://github.com/softprops/action-gh-release/blob/master/CHANGELOG.md)
- [Commits](https://github.com/softprops/action-gh-release/compare/v2.0.9...v2.1.0)

---
updated-dependencies:
- dependency-name: softprops/action-gh-release
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-10 09:24:27 -08:00
Madhavan Sridharan
b005b2e8e6 ninjafix: removed two errors config in the scenarios 2024-12-04 17:37:50 -05:00
Dave Fisher
0684798f4c
StandardActivityType absorbs legacy dispenser logic (#2101) 2024-11-25 14:53:40 -06:00
Dave Fisher
59d930a054
Add Protocol Resolver Chain Selection to NBIO (#2098)
* Add Protocol Selection to NBIO

* Workloads can use a protocol

* protocol errors and defaults

* Test new protocol methods

* Refactor to ResolverChain with enums

* Rename the enum to ResolverChain.Link

* OF - typo
2024-11-25 11:56:38 -06:00
Dave Fisher
86b2495aed
TagFilter Error Advisor (#2097)
* TagFilter Error Advisor

* Fix comment detection bug

* Fix the pattern
2024-11-22 09:03:15 -08:00
Dave Fisher
6e83655b57
Add bash style variable substitution types (#2096) 2024-11-21 14:36:07 -06:00
Dave Fisher
da609d76da
Refactor StrInterpolator including Skipping Comments and Adding Support for Bash Variable Substitution (#2092)
* Commented TEMPLATEs in yamls are ignored

* Templates only processed in StrInterpolator

* Improve ends with new line test

* Adjust deprecated template advisor message

* Recursively process template key-values

* Adds bash style simple templates

---------

Co-authored-by: Jonathan Shook <jshook@users.noreply.github.com>
2024-11-21 11:59:23 -06:00
Jonathan Shook
730c3a04d5 minor typo fix 2024-11-20 18:07:07 -06:00
Jonathan Shook
827c1bce43 add docs 2024-11-20 17:51:35 -06:00
Jonathan Shook
130977fa34
many-sessions improvements, type fixes, more javadocs (#2094)
* some javadoc and type alignment improvements

* some javadoc and type alignment improvements

* example adapter

* alignment to previous changes

* improvements to many session testing

* add missing annotation
2024-11-20 15:25:30 -08:00
sahankj2000
2229f919a2
making changes (#2093) 2024-11-20 09:37:14 -06:00
Dave Fisher
6c5bc8dcc1
Remind user of precise session log (#2091) 2024-11-19 16:40:50 -08:00
dependabot[bot]
f59c4e1e17
Bump org.apache.kafka:kafka-clients in /nb-adapters/adapter-kafka (#2088)
Bumps org.apache.kafka:kafka-clients from 3.7.0 to 3.7.1.

---
updated-dependencies:
- dependency-name: org.apache.kafka:kafka-clients
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-19 13:35:22 -08:00
Dave Fisher
8a3e849ff1
Allow Plural for Types in TagFilters (#2085)
* Allow Plural for Types in TagFilters

* Moved the plural trick into flow. Add advisor output

* Previous logging of TagFilter is sufficient

* Add in Advisor
2024-11-19 13:35:01 -08:00
Dave Fisher
68b148575f
Cleanup for Deprecated ActivityType (#2079)
* Cleanup for Deprecated ActivityType

* Rename ActivtyType class

* Use StandardActivityType
2024-11-18 11:43:23 -08:00
Dave Fisher
a8ab07a1f5
Update and align dependencies (#2082)
* Update and align dependencies

* com.sun.xml.bind can be removed
2024-11-18 10:58:10 -08:00
Dave Fisher
2ebc19214d
MD5 is a deprecated encryption algorithm (#2084) 2024-11-15 12:33:52 -08:00
Dave Fisher
1330223232
Provide additional instructions when driver adapter is missing (#2083)
* Provide additional instructions when driver adapter is missing

* Include instructions on the command line option output
2024-11-15 09:58:50 -08:00
Dave Fisher
02791ec8aa
Make listings similar to command syntax (#2081)
* Make listings similar to command syntax

* OF - alignment
2024-11-15 09:58:15 -08:00
Dave Fisher
071ddbf9c2
Allow Empty Scenarios (#2078) 2024-11-15 09:23:19 -08:00
Dave Fisher
99f43db475
Add LoggerConfigData unit test (#2077) 2024-11-13 13:13:55 -08:00
Dave Fisher
6d32217e7f
Dependent Issues Workflow and minor changes (#2076) 2024-11-13 11:46:55 -08:00
Dave Fisher
94b681c514
Allow tilde for user home in path (#2075) 2024-11-13 08:14:56 -08:00
Dave Fisher
64917a2879
Handle nested parantheses in TEMPLATE processing (#2072)
* Handle nested parantheses in TEMPLATE processing

* Add more complex template to scenario

* Debugging and other advisors

* Tab cleanup

* Add double nesting fix and test
2024-11-12 13:42:07 -06:00
Dave Fisher
7a9b2237de
Add NBAdvisor Framework (#2070)
* Add NBAdvisor Framework

* Revert "Add NBAdvisor Framework"

This reverts commit f2f448ffc3.

* Reapply "Add NBAdvisor Framework"

This reverts commit 8048402b88.

* Update pom.xml

* Adjust

* Fix tabs

* Revert change including test

* Simplify toString

* Advisor is now a global option

* Added error checking

* NB Advisor runtime scaffold prototype

* fix double dispatch error

* Make NBAdvisorLevel sticky and evaluate error count

* Working towards better encapsulation

* advisor refinements

* document alignment of log levels and advisor levels

* doc updates

* Evaluation refactor and fix integration tests

* Cleanup tabs

* Rename Exception

* Use a logger for output

* Small cleanup

* Remove extraneous dependency

* OF - bug fix

* Add Advisor Exception Test

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
2024-11-11 12:08:08 -06:00
Dave Fisher
041dafa5c6
S4J does not depend on Conscrypt (#2071) 2024-11-07 07:12:00 -08:00
Jonathan Shook
722e8b53d8
jshook/nosqlbench-2068-opspaces (#2069)
* force mappers to use op-contextual space bindings

* move space de-init to owner (adapter component)

* make specific adapters use op-contextual spaces
2024-11-05 14:59:28 -08:00
Jonathan Shook
ea7fceae49
jshook/nosqlbench-2057-flattenop (#2067)
* remove ChainingOp

* typos and other minor fixes

* remove Op, ChainingOp, flatten to CycleOp, derive RunnableOp

* refactor qdrant for aligned op types

* refactor mongodb for aligned op types

* refactor cqld4 for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

add license

* fix cqld4 batch statement mapper

* fix cql base op mapper

* remove var inference

* remove emitter for runnable op
2024-11-04 14:42:05 -08:00