The open source, pluggable, nosql benchmarking suite.
Go to file
2022-12-01 12:21:34 +00:00
.github Update codeql-analysis.yml 2022-11-22 22:35:33 -06:00
adapter-cqld4 fix: upgrade com.datastax.oss:java-driver-query-builder from 4.14.1 to 4.15.0 2022-12-01 12:21:34 +00:00
adapter-diag Merge branch 'main' into shutdown_hooks 2022-11-22 22:24:03 -06:00
adapter-dynamodb fix: adapter-dynamodb/pom.xml to reduce vulnerabilities 2022-11-23 03:43:06 +00:00
adapter-http [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
adapter-mongodb bump min_version 2022-11-02 09:36:49 -04:00
adapter-pulsar Fix example yaml file producer and consumer parameter names 2022-11-21 21:05:26 -06:00
adapter-stdout [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
adapter-tcp [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
adapters-api Merge branch 'main' into shutdown_hooks 2022-11-22 22:24:03 -06:00
devdocs start tracking feature news in a file 2022-08-25 15:13:59 -05:00
docsys Merge pull request #773 from nosqlbench/snyk-fix-8aa6ab863bb5432def89d1b31da171c7 2022-11-22 23:32:39 -06:00
driver-cockroachdb build(deps): bump postgresql in /driver-cockroachdb 2022-11-23 22:21:48 +00:00
driver-jdbc pom version sync 2022-08-16 00:42:43 -05:00
driver-jmx pom version sync 2022-08-16 00:42:43 -05:00
driver-kafka fix: driver-kafka/pom.xml to reduce vulnerabilities 2022-09-20 17:59:42 +00:00
driver-pulsar fix: upgrade org.apache.pulsar:pulsar-client from 2.10.1 to 2.10.2 (#796) 2022-11-23 08:34:59 -06:00
engine-api memoize retries in hot code path 2022-11-18 23:20:09 -06:00
engine-cli direct work-around for flaky test, simple improvements to logging, some improvements to consistent view of status, misc cleanups 2022-11-22 10:49:12 -06:00
engine-clients [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
engine-core minor fixes on PR 2022-11-22 18:11:43 -06:00
engine-docker [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
engine-docs [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
engine-extensions [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
engine-rest fix: upgrade io.swagger.core.v3:swagger-models from 2.2.3 to 2.2.4 (#799) 2022-11-23 15:04:25 -06:00
mvn-defaults Merge pull request #804 from nosqlbench/snyk-upgrade-4a7ee2762e595acb421d164dc872273b 2022-11-30 12:04:36 -06:00
nb - Delete unsed code "driver-jms" 2022-11-11 18:36:06 -06:00
nb5 - Delete unsed code "driver-jms" 2022-11-11 18:36:06 -06:00
nb-annotations [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
nb-api Merge branch 'main' into snyk-fix-62d2529ba6efa1321216d8e295c48e5d 2022-11-22 23:26:56 -06:00
nb-spectest [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
nbr temporarily disable test for close exception handler 2022-11-22 23:04:49 -06:00
nbr-examples Timing changes for github actions to properly perform build/test step. 2022-11-14 10:39:10 -06:00
scripts make accepting license updates easier 2022-05-20 13:57:13 -05:00
sort_docs doc: old docs to be sorted 2021-09-13 09:56:47 -05:00
virtdata-api [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
virtdata-lang fix: upgrade org.antlr:antlr4-runtime from 4.10.1 to 4.11.1 2022-10-01 19:32:30 +00:00
virtdata-lib-basics Merge pull request #769 from nosqlbench/base64 2022-11-03 13:03:23 -05:00
virtdata-lib-curves4 [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
virtdata-lib-random [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
virtdata-lib-realer [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
virtdata-realdata [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
virtdata-userlibs [maven-release-plugin] prepare for next development iteration 2022-09-30 15:58:45 +00:00
.editorconfig [issue-65] add EditorConfig configuration file 2020-03-16 13:51:41 +01:00
.gitignore ignore generated files for Apache Rat checking 2022-03-09 09:57:04 -06:00
BUILDING.md Minor fix to BUILDING.md as Java baseline is 17, not 12 (as per mvn-defaults/pom.xml) 2022-05-13 09:10:23 -07:00
CODE_OF_CONDUCT.md Update CODE_OF_CONDUCT.md 2020-03-16 15:34:50 +00:00
CONTRIBUTING.md fix broken discord links 2021-03-15 10:21:23 -05:00
cqlsstable_example.yaml added test yaml to generate data 2022-08-19 15:30:33 -07:00
deploy.xml added deploy.xml 2020-03-10 02:56:24 -05:00
Dockerfile some soft links 2022-08-24 17:20:12 -04:00
DOWNLOADS.md Fix markdown typos introduced by auto formatting 2021-09-17 13:12:56 -05:00
LICENSE.txt core project files 2020-03-16 08:41:22 -05:00
MODULES.md rename activitytype modules to driver modules 2020-05-05 11:29:30 -05:00
pom.xml Added support for 1) subscription initial position and 2) regex subscription mode 2022-11-18 18:22:04 -06:00
README.md remove stale mention of netlify 2022-09-27 09:20:26 -05:00
release.xml fix missing release file 2020-06-17 17:48:09 -05:00
RELEASENOTES.md security fixes and build diagnostics 2022-09-30 10:50:00 -05:00

NoSQLBench

The Open Source, Pluggable, NoSQL Benchmarking Suite

BRANCH STATUS

The main branch of NoSQLBench is the active development branch for the upcoming NoSQLBench 5. It requires Java 17 to build, and has a limited set of drivers available as the previous drivers are updated to the newer APIs (and features).

If you want to build or modify the current stable release, that is on nb4-maintenance, and requires Java 14 or lower to build. Stable releases contain all of the prior drivers.

To distinguish between versions, the binary and jar artifacts for nb5 (main) builds are named nb5.

Get it Here

Contribute to NoSQLBench

Read the Docs

What is NoSQLBench?

NoSQLBench is a serious performance testing tool for the NoSQL ecosystem. It brings together features and capabilities that are not found in any other tool.

  • You can run common testing workloads directly from the command line. You can start doing this within 5 minutes of reading this.
  • You can generate virtual data sets of arbitrary size, with deterministic data and statistically shaped values.
  • You can design custom workloads that emulate your application, contained in a single file, based on statement templates - no IDE or coding required.
  • You can immediately plot your results in a docker and grafana stack on Linux with a single command line option.
  • When needed, you can open the access panels and rewire the runtime behavior of NoSQLBench to do advanced testing, including a full scripting environment with Javascript.

The core machinery of NoSQLBench has been built with attention to detail. It has been battle tested within DataStax as a way to help users validate their data models, baseline system performance, and qualify system designs for scale.

In short, NoSQLBench wishes to be a programmable power tool for performance testing. However, it is somewhat generic. It doesn't know directly about a particular type of system, or protocol. It simply provides a suitable machine harness in which to put your drivers and testing logic. If you know how to build a client for a particular kind of system, it will let you load it like a plugin and control it dynamically.

Initially, NoSQLBench comes with support for CQL, but we would like to see this expanded with contributions from others.

Origins

The code in this project comes from multiple sources. The procedural data generation capability was known before as 'Virtual Data Set'. The core runtime and scripting harness was from the 'EngineBlock' project. The CQL support was previously used within DataStax. In March of 2020, DataStax and the project maintainers for these projects decided to put everything into one OSS project in order to make contributions and sharing easier for everyone. Thus, the new project name and structure was launched as nosqlbench.io. NoSQLBench is an independent project that is sponsored by DataStax.

We offer NoSQLBench as a new way of thinking about testing systems. It is not limited to testing only one type of system. It is our wish to build a community of users and practice around this project so that everyone in the NoSQL ecosystem can benefit from common concepts and understanding and reliable patterns of use.

Getting Support

In general, our goals with NoSQLBench are to make the help systems and examples wrap around the users like a suit of armor, so that they feel capable of doing most things autonomously. Please keep this in mind when looking for personal support form our community, and help us find those places where the docs are lacking. Maybe you can help us by adding some missing docs!

NoSQLBench Discord Server

We have a discord server. This is where users and developers can discuss anything about NoSQLBench and support each other. Please join us there if you are a new user of NoSQLBench!

Contributing

We are actively looking for contributors to help make NoSQLBench better. This is an ambitious project that is just finding its stride. If you want to be part of the next chapter in NoSQLBench development please look at CONTRIBUTING for ideas, and jump in where you feel comfortable.

All contributors are expected to abide by the CODE_OF_CONDUCT.

License

All of the code in this repository is licensed under the APL version 2. If you contribute to this project, then you must agree to license all of your constributions under this license.

System Compatibility

This is a Linux targeted tool, as most cloud/nosql testing is done on Linux instances. Some support for other systems is available, but more work is needed to support them fully. Here is what is supported for each:

  1. on Linux, all features are supported, for both nb.jar as well as the appimage binary nb
  2. on Mac, all features are supported, with nb.jar.
  3. On Windows, with nb.jar all features are supported, except --docker-metrics.

Thanks

DataStax This project is sponsored by DataStax -- The Open, Multi-Cloud Stack for Modern Data Apps built on Apache Cassandra™, Kubernetes *Based*, Developer *Ready* & Cloud *Delivered* and designed from the ground up to run anywhere, on any cloud, in any datacenter, and in every possible combination. DataStax delivers the ultimate hybrid and multi-cloud database.
YourKit Logo This project uses tools provided by YourKit, LLC. YourKit supports open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of YourKit Java Profiler and YourKit .NET Profiler, innovative and intelligent tools for profiling Java and .NET applications.