Commit Graph

82 Commits

Author SHA1 Message Date
Jonathan Shook
d400c81fdb disable failing validator 2025-02-18 18:19:56 -06:00
Jonathan Shook
c0093efdd3 nosqlbench-2149 Label values should not be constrained (#2150) 2025-01-16 14:08:28 -06:00
Jonathan Shook
bc759c0e81 nosqlbench-2146 verification timer should be separate from execute timer (#2147)
* nosqlbench-2146 verification timer should be separate from execute timer

* remove stale TODO
2025-01-15 14:11:48 -06:00
Dave Fisher
1784f5dcd0 Add Property File Support plus Related Workload Improvements (#2115)
* Use Property Files for Environment Vars and as AtFiles

* Keep a private property overlay over system properties

* Add properties from file and use in workload templates

* Allow access to properties and env vars is enabled

* Reorder to ease reading the code

* Insert property, yaml, and json files

* Make exceptions meaningful

* Catch all errors on error insert file type

* Some RawOpsLoader Refactoring and other Small Fixes
2024-12-18 12:01:25 -08:00
Dave Fisher
d42245a4c7 More Advisor Parameter and Configuration Tests (#2114)
* More Advisor Parameter and Configuration Tests

* Check for workload parameters not in adapter
2024-12-13 14:49:51 -08:00
Dave Fisher
b6d437dcf0 Refactor ConfigModel Construction in StandardActivity (#2104)
* Refactor ConfigModel Construction in StandardActivity

* Tracking ConfigModel Param Classes

* ActivityDef ConfigMap and default ActivityDriver

* More complete config model for ActivityDef plus other small improvements

* Add NBAdvisor to StandardActivity

* NBAdvisor for Workload Params, Tags, and Bindings

* OF: Formatting

* Improve ActivityDef ConfigModel

* Refactor NBAdvisor output adding Debug level

* NBAdvisor output using fluent method

* Slight refactor and always fail condition

* SrInterpolator uses NBAdvisorPoint and NBAdvisorOutput improvements

* Check Cmd with NBAdvisor

* Add Advisor Name and Description to Logs

* Fix review comments
2024-12-13 10:31:22 -05:00
Jonathan Shook
ca38a710c3 Jshook/verification (#2107)
* docs update

* typos

* disable noisy prom exposition dump

* fix refkey bug

* move specs into non-test namespace

* remove unimplemented rainbow ops

* docs updates

* give credit to maintainers

* update milvus module to build clean on new APIs

* remove var keyword

* API remapping

* enable new op behaviors
2024-12-10 15:41:05 -06:00
Dave Fisher
0684798f4c StandardActivityType absorbs legacy dispenser logic (#2101) 2024-11-25 14:53:40 -06:00
Dave Fisher
59d930a054 Add Protocol Resolver Chain Selection to NBIO (#2098)
* Add Protocol Selection to NBIO

* Workloads can use a protocol

* protocol errors and defaults

* Test new protocol methods

* Refactor to ResolverChain with enums

* Rename the enum to ResolverChain.Link

* OF - typo
2024-11-25 11:56:38 -06:00
Dave Fisher
86b2495aed TagFilter Error Advisor (#2097)
* TagFilter Error Advisor

* Fix comment detection bug

* Fix the pattern
2024-11-22 09:03:15 -08:00
Dave Fisher
da609d76da Refactor StrInterpolator including Skipping Comments and Adding Support for Bash Variable Substitution (#2092)
* Commented TEMPLATEs in yamls are ignored

* Templates only processed in StrInterpolator

* Improve ends with new line test

* Adjust deprecated template advisor message

* Recursively process template key-values

* Adds bash style simple templates

---------

Co-authored-by: Jonathan Shook <jshook@users.noreply.github.com>
2024-11-21 11:59:23 -06:00
Jonathan Shook
130977fa34 many-sessions improvements, type fixes, more javadocs (#2094)
* some javadoc and type alignment improvements

* some javadoc and type alignment improvements

* example adapter

* alignment to previous changes

* improvements to many session testing

* add missing annotation
2024-11-20 15:25:30 -08:00
Dave Fisher
6c5bc8dcc1 Remind user of precise session log (#2091) 2024-11-19 16:40:50 -08:00
Dave Fisher
8a3e849ff1 Allow Plural for Types in TagFilters (#2085)
* Allow Plural for Types in TagFilters

* Moved the plural trick into flow. Add advisor output

* Previous logging of TagFilter is sufficient

* Add in Advisor
2024-11-19 13:35:01 -08:00
Dave Fisher
68b148575f Cleanup for Deprecated ActivityType (#2079)
* Cleanup for Deprecated ActivityType

* Rename ActivtyType class

* Use StandardActivityType
2024-11-18 11:43:23 -08:00
Dave Fisher
1330223232 Provide additional instructions when driver adapter is missing (#2083)
* Provide additional instructions when driver adapter is missing

* Include instructions on the command line option output
2024-11-15 09:58:50 -08:00
Dave Fisher
02791ec8aa Make listings similar to command syntax (#2081)
* Make listings similar to command syntax

* OF - alignment
2024-11-15 09:58:15 -08:00
Dave Fisher
99f43db475 Add LoggerConfigData unit test (#2077) 2024-11-13 13:13:55 -08:00
Dave Fisher
64917a2879 Handle nested parantheses in TEMPLATE processing (#2072)
* Handle nested parantheses in TEMPLATE processing

* Add more complex template to scenario

* Debugging and other advisors

* Tab cleanup

* Add double nesting fix and test
2024-11-12 13:42:07 -06:00
Dave Fisher
7a9b2237de Add NBAdvisor Framework (#2070)
* Add NBAdvisor Framework

* Revert "Add NBAdvisor Framework"

This reverts commit f2f448ffc3.

* Reapply "Add NBAdvisor Framework"

This reverts commit 8048402b88.

* Update pom.xml

* Adjust

* Fix tabs

* Revert change including test

* Simplify toString

* Advisor is now a global option

* Added error checking

* NB Advisor runtime scaffold prototype

* fix double dispatch error

* Make NBAdvisorLevel sticky and evaluate error count

* Working towards better encapsulation

* advisor refinements

* document alignment of log levels and advisor levels

* doc updates

* Evaluation refactor and fix integration tests

* Cleanup tabs

* Rename Exception

* Use a logger for output

* Small cleanup

* Remove extraneous dependency

* OF - bug fix

* Add Advisor Exception Test

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
2024-11-11 12:08:08 -06:00
Jonathan Shook
722e8b53d8 jshook/nosqlbench-2068-opspaces (#2069)
* force mappers to use op-contextual space bindings

* move space de-init to owner (adapter component)

* make specific adapters use op-contextual spaces
2024-11-05 14:59:28 -08:00
Jonathan Shook
ea7fceae49 jshook/nosqlbench-2057-flattenop (#2067)
* remove ChainingOp

* typos and other minor fixes

* remove Op, ChainingOp, flatten to CycleOp, derive RunnableOp

* refactor qdrant for aligned op types

* refactor mongodb for aligned op types

* refactor cqld4 for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

add license

* fix cqld4 batch statement mapper

* fix cql base op mapper

* remove var inference

* remove emitter for runnable op
2024-11-04 14:42:05 -08:00
Jonathan Shook
9c53b4fa7c review fixes
add oom warning on index cache

more fixes
2024-10-30 18:30:40 -05:00
Jonathan Shook
f6cbd5e42b update copyright with no date 2024-10-30 16:12:21 -05:00
Jonathan Shook
5bf6a004af fixup licenses 2024-10-30 13:22:30 -05:00
Jonathan Shook
05c6b82bba refactor dryrun for type clarity 2024-10-30 13:19:41 -05:00
Jonathan Shook
7b8e9145d7 formalize space type in generics
formalize space
2024-10-30 13:19:41 -05:00
Jonathan Shook
4fa93955c0 space metrics, heap metrics 2024-10-30 13:19:33 -05:00
sahankj2000
152e5d0540 Prompush Reporter: Adding Option to pass the apikeyfile (#2058)
* making changes

* remove unwanted print statements
2024-10-29 09:59:56 -07:00
Dave Fisher
9b9f1a484b Reorder for logger setup first 2024-10-15 16:36:03 -07:00
Dave Fisher
b03d95051a OF - tabbing 2024-10-15 15:11:57 -07:00
Dave Fisher
b043d793f2 Store version in NBCLI class and display on some log messages 2024-10-15 15:01:45 -07:00
Jonathan Shook
b27177012e help system fixes 2024-10-07 16:25:16 -05:00
Jonathan Shook
10edf3977d added getenv 2024-10-07 09:22:27 -05:00
Jonathan Shook
73824aa3c6 Revert "Merge pull request #1933 from cognitree/invalid-driver"
This reverts commit d45b5c0ced, reversing
changes made to 95a31ce73d.
2024-10-02 15:31:55 -05:00
Jonathan Shook
d45b5c0ced Merge pull request #1933 from cognitree/invalid-driver
Added to check if the driver is invalid
2024-10-02 15:06:33 -05:00
Dave Fisher
1bceb00dac Use :- format. 2024-09-11 12:20:02 -07:00
Dave Fisher
2352521dfa Atfile environment variables with default values 2024-09-11 11:38:04 -07:00
Jonathan Shook
5b8457b966 Merge pull request #2010 from nosqlbench/jshook/httpmetrics
Jshook/httpmetrics
2024-08-01 15:17:29 -05:00
Jonathan Shook
4f22bf113d enable preview for all tests too 2024-07-31 14:22:08 -05:00
Jonathan Shook
638caaaf8f nosqlbench-1968 Add warning for --use-nbio-cache 2024-07-26 12:59:19 -05:00
Mike Yaacoub
64d984ea6a Merge branch 'main' into my-astra-schema-examples 2024-07-23 17:01:45 -04:00
Dave Fisher
14d26ee58f Merge branch 'main' into my-astra-schema-examples 2024-07-23 12:47:59 -07:00
Dave Fisher
38d2f09eb5 Merge branch 'main' into environment_in_atfile 2024-07-18 11:37:22 -07:00
Dave Fisher
34a3ad478a OF: Use spaces not tab 2024-07-18 11:32:03 -07:00
Dave Fisher
a8c71656f9 Correct filename 2024-07-18 11:17:02 -07:00
Dave Fisher
1ff76aebd4 Throw error when envvar is missing and provide unit tests 2024-07-18 11:07:30 -07:00
Jonathan Shook
9fd72cd967 bugfix for extension checking 2024-07-10 14:53:02 -05:00
Dave Fisher
fca6971316 Merge branch 'main' into environment_in_atfile 2024-07-10 12:07:39 -07:00
Jonathan Shook
60bf8bd631 add multi-layer recursion and path-relative recursion tests 2024-07-10 13:33:30 -05:00