Commit Graph

56 Commits

Author SHA1 Message Date
yabinmeng
9a61a1f2af Remove "--docker-metrics" functionality. Update documents and scripts accordingly. 2023-09-28 14:30:18 -05:00
Jeff Banks
02ff160b3c Metrics Publishing (#1234)
Included the following with core changes to allow labeled metrics for Prometheus exposition format publishing.
* javadoc updates
* remove extra types
* use NBLabeledElement instead of NBNamedElement
* contextualize NBLabeledElement for graphite/metrics
* externalize labeled ScriptContext to API
* add labels to NicerTimer
* remove partial packaging
* more progress on formatting for prom exposition format
* added metrics diagram
* resolve build issues with label params
* resolve build issues with label params
* prometheus export services
* added PromExpoFormat Tests for NBMetricMeter(Counting+Sampling) and NBMetricTimer(Counting)
* added test for Gauge Formatting
* added Gauge Formatting as well as Sampling values (count, stdev ...)
* added sketch for metrics labeling contexts
* add NBLabeledElement in all the places, retool calling paths to use it
* synchronize antlr versions after partial snyk change
* unbreak static initializer block after IntelliJ "fixed" it.
* engine-api - adapt to NBLabeledElement
* adapters-api - adapt to NBLabeledElement
* nb-api - adapt to NBLabeledElement
* engine-core - adapt to NBLabeledElement
* misc-adapters - adapt to NBLabeledElement
* streaming-adapters - adapt to NBLabeledElement
* add missing test
* initial implementation of a prom push reporter
* Resolve build issue with parseGlobalOptions
* replaced with PromPushReporter
* cleanup unused deps
* dependency removal for micrometer
* allow empty labels for tests
* change space.getName to space.getSpaceName
* cleanup poms
* graphite linearization now includes space element
* http adapter should only depend on adapters API
* http space does not create its own metric names
* import cleanups
* improved javadocs
* introduce component concepts

---------

Co-authored-by: Jonathan Shook <jshook@gmail.com>
Co-authored-by: Mike Yaacoub <mike.yaacoub@datastax.com>
2023-05-09 09:52:42 -05:00
Jonathan Shook
70408621dd nosqlbench-1071 NBIO should favor finding exactly specified file path as a short circuit 2023-02-10 10:20:45 -06:00
Jonathan Shook
31478ae591 Nosqlbench 904 version5 (#908)
* Ignore .flattened-pom.xml files from the CI-friendly flattening

* Allow newer versions to squelch version warning

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unecesary indirection in poms which break version intellisense

* * switch to CI-friendly revisions in Maven
* add flattener
* refactor version tags
* remove unnecessary indirection in poms which break version intellisense

* deleting commented code
* version dep updates
* streamline LUT trimming options
* use a more explicit regex substituion technique
* specify updated okhttp version
* update resources plugin to bugfixed version
* exclude filtering for problematic files
2023-01-12 12:48:50 -06:00
Jeff Banks
9c25ad9336 Code coverage integration (#897)
* Jacoco introduced for full reporting of test coverage.
* All modules included in scope.
* Ability to scope to module OR overall reporting.
* Ability to run in dev environment and bypass as needed w/out GHA.
2023-01-12 11:25:40 -06:00
Jonathan Shook
6731937c96 modify logger calls for computable messages via closures 2022-12-21 19:37:36 -06:00
Jonathan Shook
789cc62430 package refactoring 2022-07-14 19:01:00 -05:00
Jonathan Shook
1ea3391e76 checkpoint 2022-07-07 12:03:34 -05:00
Jonathan Shook
cb4c033a63 make all sub-app invocations act like stack calls, fix workflows 2022-06-24 15:40:28 -05:00
Jonathan Shook
52420b5f88 add aplv2 headers to engine-docker 2022-03-08 14:14:52 -06:00
Jonathan Shook
aae973c9dd spacing and typos 2021-09-13 09:43:48 -05:00
Christopher Lambert
950b31fbae fix errors found by errorprone 2021-06-17 15:03:16 +02:00
Doug Wettlaufer
a5d90b7868 Handle listing docker images without repo tags 2021-04-28 09:50:59 -05:00
Jonathan Shook
34b7bfc0b6 experimental dashboard capture 2021-01-21 15:27:33 -06:00
Jonathan Shook
bfd5d5b8cd update nb4 rc 2021-01-13 14:16:00 -06:00
Jonathan Shook
0a6bb1fa5f allow --docker-prom-retention-days with default of 183d 2020-12-15 12:37:43 -06:00
Jonathan Shook
832da18548 qualify docker image search with tags 2020-12-11 15:17:03 -06:00
Jonathan Shook
12acd07f4c parameterize docker prom tag 2020-12-09 16:27:25 -06:00
Jonathan Shook
1d107d8754 update nb4 dashboard def 2020-12-09 16:25:23 -06:00
Jonathan Shook
17ed4c1efc annotator and dashboard fixes 2020-12-08 15:46:33 -06:00
Jonathan Shook
fa78e27fc0 set NB4 to Java 15 2020-12-08 11:33:36 -06:00
Jonathan Shook
f09335755c add dashboard for nb4 2020-12-07 01:51:05 -06:00
Jonathan Shook
f1e3adf518 avoid discarding exceptions in docker helper 2020-12-07 01:50:25 -06:00
Jonathan Shook
cf008d1611 promote docker feedback to info 2020-12-07 01:50:16 -06:00
Jonathan Shook
a09efbe994 consolidate to log4j2 2020-11-16 17:30:20 -06:00
Jonathan Shook
6a8dfef109 qualify grafana docker with tag 2020-10-29 10:55:24 -05:00
Jonathan Shook
a9d70a7717 make prometheus pull latest docker by default #189 #186 #197 2020-09-08 17:47:31 -05:00
Jonathan Shook
e3f16dbcba fixed dual dashboard init issue 2020-08-12 17:20:31 -05:00
Jonathan Shook
102f60ac6f restore support for adhoc activities in docker metrics 2020-07-09 09:38:55 -05:00
Jonathan Shook
d3b3490bc7 formatting 2020-05-31 23:58:50 -05:00
Jonathan Shook
6d8443e6b8 simplify command builder 2020-05-31 23:58:43 -05:00
Jonathan Shook
42559152a8 support graphite exporter custom mappings 2020-05-31 23:58:38 -05:00
Jonathan Shook
9235a51b15 add prom label based dashboard 2020-05-31 23:58:31 -05:00
Jonathan Shook
8a37abe7f1 mark previous dashboard as deprecated 2020-05-31 23:58:24 -05:00
Jonathan Shook
b248c86684 configurable docker tags for grafana 2020-05-31 23:58:05 -05:00
Jonathan Shook
98bb5feb4c support more grafana datasources and dashboards 2020-05-31 23:57:57 -05:00
Wei Deng
442b5cbb28 fixed a docker-metrics bug that prevents grafana started by --docker-metrics on a Linux server from accessing prometheus in another docker container 2020-05-19 09:21:16 -06:00
Wei Deng
bd5b3dfd4a fixed a number of bugs with docker-metrics on Mac, including file system permissions, and error handling logic when prom/grafana config files are wiped out unexpectedly 2020-05-01 11:43:36 -06:00
Jonathan Shook
1e05c31075 partial rework of the NBIO internals for multiple results 2020-04-08 12:38:16 -05:00
Jonathan Shook
c1bf725330 package naming cleanups 2020-04-06 03:03:43 -05:00
Jonathan Shook
c66352afac NBPaths is the main path utility 2020-04-01 19:03:17 -05:00
Jonathan Shook
e2d3d3825c centralized path functions 2020-04-01 18:24:38 -05:00
Jonathan Shook
9642a2b545 partial work for search within 2020-03-27 08:43:57 -05:00
phact
a1b97a86f5 only update grafana for brand new container (no state) 2020-03-26 22:15:50 -04:00
phact
250a027647 refactor first 2020-03-26 18:12:58 -04:00
Jonathan Shook
fdb3e064a0 docker warnings are improved 2020-03-26 12:48:50 -05:00
Jonathan Shook
01d7c70636 increased docker timeout to 60s for image pulls 2020-03-26 10:11:31 -05:00
Jonathan Shook
eca3926e91 fix for grafana config 2020-03-26 01:51:10 -05:00
Jonathan Shook
95c0232eca activate console logging early, fix grafana configs 2020-03-25 18:07:31 -05:00
Jonathan Shook
2218cf373a fixed erroneous error in mkdir 2020-03-25 16:36:04 -05:00