Commit Graph
90 Commits
Author SHA1 Message Date
Jonathan Shook 22124a22ef fix jmh invocation 2026-01-21 17:34:38 +00:00
Jonathan Shook d308cddf21 New JMH benchmarking framework:
Added 9 new benchmark classes in nb-engine-core/.../sysperf/engineflow/ for measuring engine flow performance
  (stride context, op flow, space mapping, motor operations, etc.)
JMH documentation: Added devdocs/devguide/jmh_engineflow.md
Testing tags:
 POM updates: Added test profiles
 CONVENTIONS.md updates around test tags
 Test annotations: Added 2-3 lines to ~280 test files
 Split tests classes to allow one tag set per class (no mixed methods)
2026-01-20 17:23:18 +00:00
Jonathan Shook 1603afd499 Add notes on metrics updates. 2025-11-12 19:46:05 +00:00
Jonathan Shook d0560f2801 templates as exprs (#2228)
* improve exprs dryrun output and error messages

* modularize user-extensible workload exprs

* make TEMPLATE just exprs

* square up template variable syntax

* banish double angle brackets and make Dryrun enum pervasive

* template replacement cleanup

* clean up logger levels, support copy target
2025-10-17 12:10:50 -05:00
Jonathan Shook a83d83bbe8 branch reconciliation: Flatten Activity API (#2217)
update and plan true-up: Flatten Activity API
2025-09-29 13:25:37 -05:00
Jonathan Shook 827c1bce43 add docs 2024-11-20 17:51:35 -06:00
Jonathan Shook f6cbd5e42b update copyright with no date 2024-10-30 16:12:21 -05:00
Jonathan Shook c46e097e50 remove deprecated CommandTemplate 2023-12-08 19:37:06 -06:00
Jonathan Shook ae19037bce remainder of changes for scenario rework that need to be itemized 2023-12-06 14:26:53 -06:00
Jonathan Shook 957f178c4c add sibling labels restriction and some docs 2023-10-23 16:45:10 -05:00
Jonathan Shook 945f48983c scenario tests stubbed, error handling in session fixed, mvn verify works now 2023-10-23 08:42:19 -05:00
Jonathan Shook 3ec511f61f partial progress to moving instrumentation 2023-10-23 08:41:17 -05:00
yabinmeng 9a61a1f2af Remove "--docker-metrics" functionality. Update documents and scripts accordingly. 2023-09-28 14:30:18 -05:00
02ff160b3c Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook 1b82ad9478 Merge pull request #1000 from nosqlbench/add-tags-script
Add tags script
2023-02-06 15:23:38 -06:00
jeffbanks cc989c8a72 nb5 revamp for scenarios 2023-02-06 14:58:04 -06:00
Jonathan Shook ef7f35bcf4 auto substitute PROG in docs with nb5 2023-02-05 20:30:22 -06:00
Jonathan Shook fa88a3b13b simplify fenced code blocks for compatibility 2023-01-17 19:29:51 -06:00
Jonathan Shook a1cd44cb1c remove previous "nb" module, which will be replaced by the nb5 module soon 2023-01-10 16:48:33 -06:00
Jonathan Shook c316bed26a support alternate inline format to work around docs shortcodes 2022-12-22 18:23:16 -06:00
Jonathan Shook d80632773b merge fixes for: improve concurrency patterns for activity execution 2022-12-20 20:05:17 -06:00
Jonathan Shook d1d21c8e5d nosqlbench-861 Allow dry-run of op generation. 2022-12-19 15:47:03 -06:00
Jonathan Shook 2b39f3c350 Merge branch 'main' into nosqlbench-797-callable 2022-12-12 15:04:39 -06:00
Jonathan Shook 6fbbfb5d0f diagram updates 2022-12-07 15:01:11 -06:00
Jonathan Shook 97cf9a32cb add ad-hoc doc to show publishing flow 2022-12-06 20:34:31 -06:00
Jonathan Shook 86c4dfd966 partial fixes for nosqlbench-797 Race condition between exceptional activity shutdown and normal scenario shutdown. 2022-11-30 11:17:10 -06:00
Jonathan Shook 9c66d616f0 start tracking feature news in a file 2022-08-25 15:13:59 -05:00
Jonathan Shook 28a1c66657 start tracking feature news in a file 2022-08-18 14:49:54 -05:00
Jonathan Shook 5dbeff9911 docs updates 2022-06-16 15:13:17 -05:00
Jonathan Shook 11dd8f62da add LERP visualization 2021-11-18 16:48:39 -06:00
Jonathan Shook ff142fd0b2 refactor/improve stat samplers for efficiency and correctness 2021-11-18 16:35:20 -06:00
Jonathan Shook 123c41a9bc cleanups 2021-11-10 15:41:21 -06:00
Jonathan Shook 3f607e0e8d build fixes 2021-11-10 15:27:56 -06:00
Jonathan Shook e6f1707d36 post-merge fixups 2021-11-10 14:37:55 -06:00
Jonathan Shook 6a5e9616b9 minor formatting improvements 2021-11-04 16:37:30 -05:00
Jonathan Shook 36901bdaa0 doc: old docs to be sorted 2021-09-13 09:56:47 -05:00
Jonathan Shook 828ec0252d naming: use ParsedOp instead of ParsedCommand 2021-09-13 09:43:19 -05:00
Jonathan Shook a39f4e1a27 docs: update doc system framing 2021-09-13 09:43:02 -05:00
Jonathan Shook 5b41f978c7 adapter API improvements 2021-08-10 10:34:26 -05:00
Jonathan Shook 1962328e7a add guidelines on env vars 2021-07-20 18:26:50 -05:00
Jonathan Shook 59c6d281ca checkpoint save 2021-06-25 13:41:59 -05:00
Jonathan Shook beea2fdbf6 make op templates map based internally 2021-06-17 09:51:45 -05:00
Jonathan Shook 9a7a897018 typo fixes 2021-05-13 12:58:19 -05:00
Jonathan Shook 3f4cd9913f sandbox for API concepts 2021-05-13 12:58:11 -05:00
Jonathan Shook dcf1d506fb op template visualization 2021-02-04 23:15:56 -06:00
Jonathan Shook 9526208af8 update wip devguide 2021-02-04 17:47:13 -06:00
Jonathan Shook 4c726b0333 reorg stale docs 2021-02-04 17:46:58 -06:00
Jonathan Shook 9b445ef52a minor doc updates 2021-02-04 17:46:44 -06:00
Jonathan Shook 0330c18a7b add rationale and ideas on scoping 2021-02-01 23:33:31 -06:00
Jonathan Shook b6675d6c74 typos and bug fixes 2020-12-17 17:08:24 -06:00