Commit Graph

96 Commits

Author SHA1 Message Date
Jonathan Shook
1a61846ea0 review comment fix 2025-01-03 15:09:07 -06:00
Jonathan Shook
9a6a881ceb add scaffold svg 2025-01-02 16:29:10 -06:00
Jonathan Shook
13bb0cc280 devdocs 2025-01-02 16:11:47 -06:00
Jonathan Shook
1e8bd3d044 formatting 2025-01-02 12:15:33 -06:00
Jonathan Shook
97e7b16d77 replace ActivityDef with NBConfigurable 2025-01-02 12:15:11 -06:00
Jonathan Shook
3ab18635bb removing vestigial code 2025-01-02 12:15:06 -06:00
Jonathan Shook
4b14ea6f4a refactor op synthesis 2025-01-02 12:15:01 -06:00
Jonathan Shook
0574203536 field capture refinements 2025-01-02 12:14:55 -06:00
Jonathan Shook
f249d49f26 add concurrency to status indicator 2025-01-02 12:14:10 -06:00
Jonathan Shook
a8bbd9f923 specialize op template collection into a more useful type 2024-12-22 19:19:21 -06:00
Jonathan Shook
638095a82a typos and doc improvements 2024-12-22 05:11:51 -06:00
Jonathan Shook
18a607cc43 reorg Activity for clarity 2024-12-22 05:11:47 -06:00
Jonathan Shook
e9a19968d8 disable temporarily 2024-12-22 05:11:36 -06:00
Jonathan Shook
6b43b10509 this commit renames StandardActivity to Activity, as the one and only 2024-12-20 01:53:26 -06:00
Jonathan Shook
ced01b132b this commit fully replaces Activity with StandardActivity 2024-12-20 01:53:26 -06:00
Jonathan Shook
862ea8fd3b this commit fully replaces SimpleActivity with StandardActivity 2024-12-20 01:53:26 -06:00
Jonathan Shook
8c62576ff1 temp checkpoint 2024-12-20 01:53:26 -06:00
Dave Fisher
1784f5dcd0 Add Property File Support plus Related Workload Improvements (#2115)
* Use Property Files for Environment Vars and as AtFiles

* Keep a private property overlay over system properties

* Add properties from file and use in workload templates

* Allow access to properties and env vars is enabled

* Reorder to ease reading the code

* Insert property, yaml, and json files

* Make exceptions meaningful

* Catch all errors on error insert file type

* Some RawOpsLoader Refactoring and other Small Fixes
2024-12-18 12:01:25 -08:00
Dave Fisher
d42245a4c7 More Advisor Parameter and Configuration Tests (#2114)
* More Advisor Parameter and Configuration Tests

* Check for workload parameters not in adapter
2024-12-13 14:49:51 -08:00
Dave Fisher
b6d437dcf0 Refactor ConfigModel Construction in StandardActivity (#2104)
* Refactor ConfigModel Construction in StandardActivity

* Tracking ConfigModel Param Classes

* ActivityDef ConfigMap and default ActivityDriver

* More complete config model for ActivityDef plus other small improvements

* Add NBAdvisor to StandardActivity

* NBAdvisor for Workload Params, Tags, and Bindings

* OF: Formatting

* Improve ActivityDef ConfigModel

* Refactor NBAdvisor output adding Debug level

* NBAdvisor output using fluent method

* Slight refactor and always fail condition

* SrInterpolator uses NBAdvisorPoint and NBAdvisorOutput improvements

* Check Cmd with NBAdvisor

* Add Advisor Name and Description to Logs

* Fix review comments
2024-12-13 10:31:22 -05:00
Jonathan Shook
ca38a710c3 Jshook/verification (#2107)
* docs update

* typos

* disable noisy prom exposition dump

* fix refkey bug

* move specs into non-test namespace

* remove unimplemented rainbow ops

* docs updates

* give credit to maintainers

* update milvus module to build clean on new APIs

* remove var keyword

* API remapping

* enable new op behaviors
2024-12-10 15:41:05 -06:00
Dave Fisher
0684798f4c StandardActivityType absorbs legacy dispenser logic (#2101) 2024-11-25 14:53:40 -06:00
Dave Fisher
59d930a054 Add Protocol Resolver Chain Selection to NBIO (#2098)
* Add Protocol Selection to NBIO

* Workloads can use a protocol

* protocol errors and defaults

* Test new protocol methods

* Refactor to ResolverChain with enums

* Rename the enum to ResolverChain.Link

* OF - typo
2024-11-25 11:56:38 -06:00
Dave Fisher
86b2495aed TagFilter Error Advisor (#2097)
* TagFilter Error Advisor

* Fix comment detection bug

* Fix the pattern
2024-11-22 09:03:15 -08:00
Dave Fisher
da609d76da Refactor StrInterpolator including Skipping Comments and Adding Support for Bash Variable Substitution (#2092)
* Commented TEMPLATEs in yamls are ignored

* Templates only processed in StrInterpolator

* Improve ends with new line test

* Adjust deprecated template advisor message

* Recursively process template key-values

* Adds bash style simple templates

---------

Co-authored-by: Jonathan Shook <jshook@users.noreply.github.com>
2024-11-21 11:59:23 -06:00
Jonathan Shook
130977fa34 many-sessions improvements, type fixes, more javadocs (#2094)
* some javadoc and type alignment improvements

* some javadoc and type alignment improvements

* example adapter

* alignment to previous changes

* improvements to many session testing

* add missing annotation
2024-11-20 15:25:30 -08:00
Dave Fisher
6c5bc8dcc1 Remind user of precise session log (#2091) 2024-11-19 16:40:50 -08:00
Dave Fisher
8a3e849ff1 Allow Plural for Types in TagFilters (#2085)
* Allow Plural for Types in TagFilters

* Moved the plural trick into flow. Add advisor output

* Previous logging of TagFilter is sufficient

* Add in Advisor
2024-11-19 13:35:01 -08:00
Dave Fisher
68b148575f Cleanup for Deprecated ActivityType (#2079)
* Cleanup for Deprecated ActivityType

* Rename ActivtyType class

* Use StandardActivityType
2024-11-18 11:43:23 -08:00
Dave Fisher
1330223232 Provide additional instructions when driver adapter is missing (#2083)
* Provide additional instructions when driver adapter is missing

* Include instructions on the command line option output
2024-11-15 09:58:50 -08:00
Dave Fisher
02791ec8aa Make listings similar to command syntax (#2081)
* Make listings similar to command syntax

* OF - alignment
2024-11-15 09:58:15 -08:00
Dave Fisher
99f43db475 Add LoggerConfigData unit test (#2077) 2024-11-13 13:13:55 -08:00
Dave Fisher
64917a2879 Handle nested parantheses in TEMPLATE processing (#2072)
* Handle nested parantheses in TEMPLATE processing

* Add more complex template to scenario

* Debugging and other advisors

* Tab cleanup

* Add double nesting fix and test
2024-11-12 13:42:07 -06:00
Dave Fisher
7a9b2237de Add NBAdvisor Framework (#2070)
* Add NBAdvisor Framework

* Revert "Add NBAdvisor Framework"

This reverts commit f2f448ffc3.

* Reapply "Add NBAdvisor Framework"

This reverts commit 8048402b88.

* Update pom.xml

* Adjust

* Fix tabs

* Revert change including test

* Simplify toString

* Advisor is now a global option

* Added error checking

* NB Advisor runtime scaffold prototype

* fix double dispatch error

* Make NBAdvisorLevel sticky and evaluate error count

* Working towards better encapsulation

* advisor refinements

* document alignment of log levels and advisor levels

* doc updates

* Evaluation refactor and fix integration tests

* Cleanup tabs

* Rename Exception

* Use a logger for output

* Small cleanup

* Remove extraneous dependency

* OF - bug fix

* Add Advisor Exception Test

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
2024-11-11 12:08:08 -06:00
Jonathan Shook
722e8b53d8 jshook/nosqlbench-2068-opspaces (#2069)
* force mappers to use op-contextual space bindings

* move space de-init to owner (adapter component)

* make specific adapters use op-contextual spaces
2024-11-05 14:59:28 -08:00
Jonathan Shook
ea7fceae49 jshook/nosqlbench-2057-flattenop (#2067)
* remove ChainingOp

* typos and other minor fixes

* remove Op, ChainingOp, flatten to CycleOp, derive RunnableOp

* refactor qdrant for aligned op types

* refactor mongodb for aligned op types

* refactor cqld4 for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

* minor API alignment

refactor gcpspanner for aligned op types

add license

* fix cqld4 batch statement mapper

* fix cql base op mapper

* remove var inference

* remove emitter for runnable op
2024-11-04 14:42:05 -08:00
Jonathan Shook
9c53b4fa7c review fixes
add oom warning on index cache

more fixes
2024-10-30 18:30:40 -05:00
Jonathan Shook
f6cbd5e42b update copyright with no date 2024-10-30 16:12:21 -05:00
Jonathan Shook
5bf6a004af fixup licenses 2024-10-30 13:22:30 -05:00
Jonathan Shook
05c6b82bba refactor dryrun for type clarity 2024-10-30 13:19:41 -05:00
Jonathan Shook
7b8e9145d7 formalize space type in generics
formalize space
2024-10-30 13:19:41 -05:00
Jonathan Shook
4fa93955c0 space metrics, heap metrics 2024-10-30 13:19:33 -05:00
sahankj2000
152e5d0540 Prompush Reporter: Adding Option to pass the apikeyfile (#2058)
* making changes

* remove unwanted print statements
2024-10-29 09:59:56 -07:00
Dave Fisher
9b9f1a484b Reorder for logger setup first 2024-10-15 16:36:03 -07:00
Dave Fisher
b03d95051a OF - tabbing 2024-10-15 15:11:57 -07:00
Dave Fisher
b043d793f2 Store version in NBCLI class and display on some log messages 2024-10-15 15:01:45 -07:00
Jonathan Shook
b27177012e help system fixes 2024-10-07 16:25:16 -05:00
Jonathan Shook
10edf3977d added getenv 2024-10-07 09:22:27 -05:00
Jonathan Shook
73824aa3c6 Revert "Merge pull request #1933 from cognitree/invalid-driver"
This reverts commit d45b5c0ced, reversing
changes made to 95a31ce73d.
2024-10-02 15:31:55 -05:00
Jonathan Shook
d45b5c0ced Merge pull request #1933 from cognitree/invalid-driver
Added to check if the driver is invalid
2024-10-02 15:06:33 -05:00