Commit Graph

87 Commits

Author SHA1 Message Date
Jonathan Shook
fce03c91eb license fixes 2025-01-08 13:58:10 -06:00
Jonathan Shook
8e6a2b4f7c bugfixes 2025-01-08 13:04:55 -06:00
Jonathan Shook
a28d321aaf add dryrun options for mapper and sequence 2025-01-08 12:46:10 -06:00
Jonathan Shook
5a12392102 cleanups and formatting 2025-01-08 12:46:04 -06:00
Jonathan Shook
0756b6e9d8 ensure lifecycle ordering 2025-01-08 12:45:57 -06:00
Jonathan Shook
a0862703ec docs updates 2025-01-06 09:32:23 -06:00
Jonathan Shook
1e8bd3d044 formatting 2025-01-02 12:15:33 -06:00
Jonathan Shook
97e7b16d77 replace ActivityDef with NBConfigurable 2025-01-02 12:15:11 -06:00
Jonathan Shook
4b14ea6f4a refactor op synthesis 2025-01-02 12:15:01 -06:00
Jonathan Shook
7312d685f7 bugfixes 2025-01-02 12:14:43 -06:00
Jonathan Shook
a8bbd9f923 specialize op template collection into a more useful type 2024-12-22 19:19:21 -06:00
Jonathan Shook
6b43b10509 this commit renames StandardActivity to Activity, as the one and only 2024-12-20 01:53:26 -06:00
Jonathan Shook
ced01b132b this commit fully replaces Activity with StandardActivity 2024-12-20 01:53:26 -06:00
Jonathan Shook
862ea8fd3b this commit fully replaces SimpleActivity with StandardActivity 2024-12-20 01:53:26 -06:00
Jonathan Shook
8c62576ff1 temp checkpoint 2024-12-20 01:53:26 -06:00
Jonathan Shook
7153ef6ee1 docs updates 2024-12-20 01:52:44 -06:00
Jonathan Shook
2750a9e6c4 typos 2024-12-20 01:52:44 -06:00
Jonathan Shook
532f8b8007 docs update 2024-12-20 01:52:44 -06:00
Dave Fisher
1784f5dcd0
Add Property File Support plus Related Workload Improvements (#2115)
* Use Property Files for Environment Vars and as AtFiles

* Keep a private property overlay over system properties

* Add properties from file and use in workload templates

* Allow access to properties and env vars is enabled

* Reorder to ease reading the code

* Insert property, yaml, and json files

* Make exceptions meaningful

* Catch all errors on error insert file type

* Some RawOpsLoader Refactoring and other Small Fixes
2024-12-18 12:01:25 -08:00
Dave Fisher
d42245a4c7
More Advisor Parameter and Configuration Tests (#2114)
* More Advisor Parameter and Configuration Tests

* Check for workload parameters not in adapter
2024-12-13 14:49:51 -08:00
Dave Fisher
b6d437dcf0
Refactor ConfigModel Construction in StandardActivity (#2104)
* Refactor ConfigModel Construction in StandardActivity

* Tracking ConfigModel Param Classes

* ActivityDef ConfigMap and default ActivityDriver

* More complete config model for ActivityDef plus other small improvements

* Add NBAdvisor to StandardActivity

* NBAdvisor for Workload Params, Tags, and Bindings

* OF: Formatting

* Improve ActivityDef ConfigModel

* Refactor NBAdvisor output adding Debug level

* NBAdvisor output using fluent method

* Slight refactor and always fail condition

* SrInterpolator uses NBAdvisorPoint and NBAdvisorOutput improvements

* Check Cmd with NBAdvisor

* Add Advisor Name and Description to Logs

* Fix review comments
2024-12-13 10:31:22 -05:00
Jonathan Shook
ca38a710c3
Jshook/verification (#2107)
* docs update

* typos

* disable noisy prom exposition dump

* fix refkey bug

* move specs into non-test namespace

* remove unimplemented rainbow ops

* docs updates

* give credit to maintainers

* update milvus module to build clean on new APIs

* remove var keyword

* API remapping

* enable new op behaviors
2024-12-10 15:41:05 -06:00
Dave Fisher
59d930a054
Add Protocol Resolver Chain Selection to NBIO (#2098)
* Add Protocol Selection to NBIO

* Workloads can use a protocol

* protocol errors and defaults

* Test new protocol methods

* Refactor to ResolverChain with enums

* Rename the enum to ResolverChain.Link

* OF - typo
2024-11-25 11:56:38 -06:00
Dave Fisher
86b2495aed
TagFilter Error Advisor (#2097)
* TagFilter Error Advisor

* Fix comment detection bug

* Fix the pattern
2024-11-22 09:03:15 -08:00
Dave Fisher
6e83655b57
Add bash style variable substitution types (#2096) 2024-11-21 14:36:07 -06:00
Dave Fisher
da609d76da
Refactor StrInterpolator including Skipping Comments and Adding Support for Bash Variable Substitution (#2092)
* Commented TEMPLATEs in yamls are ignored

* Templates only processed in StrInterpolator

* Improve ends with new line test

* Adjust deprecated template advisor message

* Recursively process template key-values

* Adds bash style simple templates

---------

Co-authored-by: Jonathan Shook <jshook@users.noreply.github.com>
2024-11-21 11:59:23 -06:00
Jonathan Shook
130977fa34
many-sessions improvements, type fixes, more javadocs (#2094)
* some javadoc and type alignment improvements

* some javadoc and type alignment improvements

* example adapter

* alignment to previous changes

* improvements to many session testing

* add missing annotation
2024-11-20 15:25:30 -08:00
Dave Fisher
8a3e849ff1
Allow Plural for Types in TagFilters (#2085)
* Allow Plural for Types in TagFilters

* Moved the plural trick into flow. Add advisor output

* Previous logging of TagFilter is sufficient

* Add in Advisor
2024-11-19 13:35:01 -08:00
Dave Fisher
68b148575f
Cleanup for Deprecated ActivityType (#2079)
* Cleanup for Deprecated ActivityType

* Rename ActivtyType class

* Use StandardActivityType
2024-11-18 11:43:23 -08:00
Dave Fisher
071ddbf9c2
Allow Empty Scenarios (#2078) 2024-11-15 09:23:19 -08:00
Dave Fisher
6d32217e7f
Dependent Issues Workflow and minor changes (#2076) 2024-11-13 11:46:55 -08:00
Dave Fisher
94b681c514
Allow tilde for user home in path (#2075) 2024-11-13 08:14:56 -08:00
Dave Fisher
64917a2879
Handle nested parantheses in TEMPLATE processing (#2072)
* Handle nested parantheses in TEMPLATE processing

* Add more complex template to scenario

* Debugging and other advisors

* Tab cleanup

* Add double nesting fix and test
2024-11-12 13:42:07 -06:00
Dave Fisher
7a9b2237de
Add NBAdvisor Framework (#2070)
* Add NBAdvisor Framework

* Revert "Add NBAdvisor Framework"

This reverts commit f2f448ffc3.

* Reapply "Add NBAdvisor Framework"

This reverts commit 8048402b88.

* Update pom.xml

* Adjust

* Fix tabs

* Revert change including test

* Simplify toString

* Advisor is now a global option

* Added error checking

* NB Advisor runtime scaffold prototype

* fix double dispatch error

* Make NBAdvisorLevel sticky and evaluate error count

* Working towards better encapsulation

* advisor refinements

* document alignment of log levels and advisor levels

* doc updates

* Evaluation refactor and fix integration tests

* Cleanup tabs

* Rename Exception

* Use a logger for output

* Small cleanup

* Remove extraneous dependency

* OF - bug fix

* Add Advisor Exception Test

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
2024-11-11 12:08:08 -06:00
Jonathan Shook
722e8b53d8
jshook/nosqlbench-2068-opspaces (#2069)
* force mappers to use op-contextual space bindings

* move space de-init to owner (adapter component)

* make specific adapters use op-contextual spaces
2024-11-05 14:59:28 -08:00
Jonathan Shook
ea7fceae49
jshook/nosqlbench-2057-flattenop (#2067)
* remove ChainingOp

* typos and other minor fixes

* remove Op, ChainingOp, flatten to CycleOp, derive RunnableOp

* refactor qdrant for aligned op types

* refactor mongodb for aligned op types

* refactor cqld4 for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

add license

* fix cqld4 batch statement mapper

* fix cql base op mapper

* remove var inference

* remove emitter for runnable op
2024-11-04 14:42:05 -08:00
Jonathan Shook
9c53b4fa7c review fixes
add oom warning on index cache

more fixes
2024-10-30 18:30:40 -05:00
Jonathan Shook
f6cbd5e42b update copyright with no date 2024-10-30 16:12:21 -05:00
Jonathan Shook
37e570cc42 make space function adaptive to binding type 2024-10-30 13:22:30 -05:00
Jonathan Shook
5512830f31 concurrent index cache improvements
track size of concurrent indexes
2024-10-30 13:22:30 -05:00
Jonathan Shook
f47498a185 support covariance in enum mapping 2024-10-30 13:22:30 -05:00
Jonathan Shook
919a741fa8 inject adapter context into spaces 2024-10-30 13:22:30 -05:00
Jonathan Shook
b969f6927c cleanups 2024-10-30 13:22:30 -05:00
Jonathan Shook
5a737c72ef add refkey property to op template API 2024-10-30 13:22:30 -05:00
Jonathan Shook
05c6b82bba refactor dryrun for type clarity 2024-10-30 13:19:41 -05:00
Jonathan Shook
d5ec597152 add primitive int lambda for op fields 2024-10-30 13:19:41 -05:00
Jonathan Shook
7b8e9145d7 formalize space type in generics
formalize space
2024-10-30 13:19:41 -05:00
Jonathan Shook
22ff75aa98 implement concurrent index cache for spaces 2024-10-30 13:19:41 -05:00
Jonathan Shook
41b1296469 rename driver space cache for upcoming changes 2024-10-30 13:19:33 -05:00
Jonathan Shook
4fa93955c0 space metrics, heap metrics 2024-10-30 13:19:33 -05:00