Commit Graph

51 Commits

Author SHA1 Message Date
Jonathan Shook
97e7b16d77 replace ActivityDef with NBConfigurable 2025-01-02 12:15:11 -06:00
Jonathan Shook
4b14ea6f4a refactor op synthesis 2025-01-02 12:15:01 -06:00
Jonathan Shook
7312d685f7 bugfixes 2025-01-02 12:14:43 -06:00
Jonathan Shook
a8bbd9f923 specialize op template collection into a more useful type 2024-12-22 19:19:21 -06:00
Jonathan Shook
6b43b10509 this commit renames StandardActivity to Activity, as the one and only 2024-12-20 01:53:26 -06:00
Jonathan Shook
ced01b132b this commit fully replaces Activity with StandardActivity 2024-12-20 01:53:26 -06:00
Jonathan Shook
8c62576ff1 temp checkpoint 2024-12-20 01:53:26 -06:00
Jonathan Shook
7153ef6ee1 docs updates 2024-12-20 01:52:44 -06:00
Jonathan Shook
2750a9e6c4 typos 2024-12-20 01:52:44 -06:00
Jonathan Shook
532f8b8007 docs update 2024-12-20 01:52:44 -06:00
Dave Fisher
1784f5dcd0 Add Property File Support plus Related Workload Improvements (#2115)
* Use Property Files for Environment Vars and as AtFiles

* Keep a private property overlay over system properties

* Add properties from file and use in workload templates

* Allow access to properties and env vars is enabled

* Reorder to ease reading the code

* Insert property, yaml, and json files

* Make exceptions meaningful

* Catch all errors on error insert file type

* Some RawOpsLoader Refactoring and other Small Fixes
2024-12-18 12:01:25 -08:00
Dave Fisher
b6d437dcf0 Refactor ConfigModel Construction in StandardActivity (#2104)
* Refactor ConfigModel Construction in StandardActivity

* Tracking ConfigModel Param Classes

* ActivityDef ConfigMap and default ActivityDriver

* More complete config model for ActivityDef plus other small improvements

* Add NBAdvisor to StandardActivity

* NBAdvisor for Workload Params, Tags, and Bindings

* OF: Formatting

* Improve ActivityDef ConfigModel

* Refactor NBAdvisor output adding Debug level

* NBAdvisor output using fluent method

* Slight refactor and always fail condition

* SrInterpolator uses NBAdvisorPoint and NBAdvisorOutput improvements

* Check Cmd with NBAdvisor

* Add Advisor Name and Description to Logs

* Fix review comments
2024-12-13 10:31:22 -05:00
Jonathan Shook
ca38a710c3 Jshook/verification (#2107)
* docs update

* typos

* disable noisy prom exposition dump

* fix refkey bug

* move specs into non-test namespace

* remove unimplemented rainbow ops

* docs updates

* give credit to maintainers

* update milvus module to build clean on new APIs

* remove var keyword

* API remapping

* enable new op behaviors
2024-12-10 15:41:05 -06:00
Dave Fisher
59d930a054 Add Protocol Resolver Chain Selection to NBIO (#2098)
* Add Protocol Selection to NBIO

* Workloads can use a protocol

* protocol errors and defaults

* Test new protocol methods

* Refactor to ResolverChain with enums

* Rename the enum to ResolverChain.Link

* OF - typo
2024-11-25 11:56:38 -06:00
Dave Fisher
86b2495aed TagFilter Error Advisor (#2097)
* TagFilter Error Advisor

* Fix comment detection bug

* Fix the pattern
2024-11-22 09:03:15 -08:00
Dave Fisher
6e83655b57 Add bash style variable substitution types (#2096) 2024-11-21 14:36:07 -06:00
Dave Fisher
da609d76da Refactor StrInterpolator including Skipping Comments and Adding Support for Bash Variable Substitution (#2092)
* Commented TEMPLATEs in yamls are ignored

* Templates only processed in StrInterpolator

* Improve ends with new line test

* Adjust deprecated template advisor message

* Recursively process template key-values

* Adds bash style simple templates

---------

Co-authored-by: Jonathan Shook <jshook@users.noreply.github.com>
2024-11-21 11:59:23 -06:00
Jonathan Shook
130977fa34 many-sessions improvements, type fixes, more javadocs (#2094)
* some javadoc and type alignment improvements

* some javadoc and type alignment improvements

* example adapter

* alignment to previous changes

* improvements to many session testing

* add missing annotation
2024-11-20 15:25:30 -08:00
Dave Fisher
68b148575f Cleanup for Deprecated ActivityType (#2079)
* Cleanup for Deprecated ActivityType

* Rename ActivtyType class

* Use StandardActivityType
2024-11-18 11:43:23 -08:00
Dave Fisher
071ddbf9c2 Allow Empty Scenarios (#2078) 2024-11-15 09:23:19 -08:00
Dave Fisher
6d32217e7f Dependent Issues Workflow and minor changes (#2076) 2024-11-13 11:46:55 -08:00
Dave Fisher
64917a2879 Handle nested parantheses in TEMPLATE processing (#2072)
* Handle nested parantheses in TEMPLATE processing

* Add more complex template to scenario

* Debugging and other advisors

* Tab cleanup

* Add double nesting fix and test
2024-11-12 13:42:07 -06:00
Dave Fisher
7a9b2237de Add NBAdvisor Framework (#2070)
* Add NBAdvisor Framework

* Revert "Add NBAdvisor Framework"

This reverts commit f2f448ffc3.

* Reapply "Add NBAdvisor Framework"

This reverts commit 8048402b88.

* Update pom.xml

* Adjust

* Fix tabs

* Revert change including test

* Simplify toString

* Advisor is now a global option

* Added error checking

* NB Advisor runtime scaffold prototype

* fix double dispatch error

* Make NBAdvisorLevel sticky and evaluate error count

* Working towards better encapsulation

* advisor refinements

* document alignment of log levels and advisor levels

* doc updates

* Evaluation refactor and fix integration tests

* Cleanup tabs

* Rename Exception

* Use a logger for output

* Small cleanup

* Remove extraneous dependency

* OF - bug fix

* Add Advisor Exception Test

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
2024-11-11 12:08:08 -06:00
Jonathan Shook
722e8b53d8 jshook/nosqlbench-2068-opspaces (#2069)
* force mappers to use op-contextual space bindings

* move space de-init to owner (adapter component)

* make specific adapters use op-contextual spaces
2024-11-05 14:59:28 -08:00
Jonathan Shook
ea7fceae49 jshook/nosqlbench-2057-flattenop (#2067)
* remove ChainingOp

* typos and other minor fixes

* remove Op, ChainingOp, flatten to CycleOp, derive RunnableOp

* refactor qdrant for aligned op types

* refactor mongodb for aligned op types

* refactor cqld4 for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

add license

* fix cqld4 batch statement mapper

* fix cql base op mapper

* remove var inference

* remove emitter for runnable op
2024-11-04 14:42:05 -08:00
Jonathan Shook
9c53b4fa7c review fixes
add oom warning on index cache

more fixes
2024-10-30 18:30:40 -05:00
Jonathan Shook
f6cbd5e42b update copyright with no date 2024-10-30 16:12:21 -05:00
Jonathan Shook
37e570cc42 make space function adaptive to binding type 2024-10-30 13:22:30 -05:00
Jonathan Shook
5512830f31 concurrent index cache improvements
track size of concurrent indexes
2024-10-30 13:22:30 -05:00
Jonathan Shook
f47498a185 support covariance in enum mapping 2024-10-30 13:22:30 -05:00
Jonathan Shook
919a741fa8 inject adapter context into spaces 2024-10-30 13:22:30 -05:00
Jonathan Shook
b969f6927c cleanups 2024-10-30 13:22:30 -05:00
Jonathan Shook
5a737c72ef add refkey property to op template API 2024-10-30 13:22:30 -05:00
Jonathan Shook
05c6b82bba refactor dryrun for type clarity 2024-10-30 13:19:41 -05:00
Jonathan Shook
d5ec597152 add primitive int lambda for op fields 2024-10-30 13:19:41 -05:00
Jonathan Shook
7b8e9145d7 formalize space type in generics
formalize space
2024-10-30 13:19:41 -05:00
Jonathan Shook
22ff75aa98 implement concurrent index cache for spaces 2024-10-30 13:19:41 -05:00
Jonathan Shook
41b1296469 rename driver space cache for upcoming changes 2024-10-30 13:19:33 -05:00
Jonathan Shook
4fa93955c0 space metrics, heap metrics 2024-10-30 13:19:33 -05:00
Madhavan Sridharan
18e432cffd Spanner - Handle Drop DB more elegantly 2024-10-09 14:20:42 -04:00
Jonathan Shook
e338c94bec fixup types 2024-10-04 15:34:51 -05:00
Jonathan Shook
5b8457b966 Merge pull request #2010 from nosqlbench/jshook/httpmetrics
Jshook/httpmetrics
2024-08-01 15:17:29 -05:00
Dave Fisher
1cc7538763 Fix Adapter Test Broken on Mac 2024-07-27 17:10:50 -07:00
Jonathan Shook
a06b62c12d fix broken docs formatting and provide uniform method for multiple names 2024-07-26 16:57:40 -05:00
Dave Fisher
14d26ee58f Merge branch 'main' into my-astra-schema-examples 2024-07-23 12:47:59 -07:00
Jonathan Shook
c3c39886fa improve error message for bad syntax 2024-07-23 11:17:10 -05:00
Mike Yaacoub
eb1adcff5e Quick fix for nested Templates that were breaking --list-workloads 2024-06-30 21:02:23 -04:00
Madhavan Sridharan
c81968bb71 Improve ParsedOp error message 2024-05-07 19:29:12 -04:00
Madhavan Sridharan
af3928beed Fix timetout unit test running on slow machines 2024-04-12 17:11:16 -04:00
Jonathan Shook
0046230abf move neo4j from previous merge to new structure 2024-04-12 11:08:48 -05:00