Commit Graph

5663 Commits

Author SHA1 Message Date
yabinmeng
8fb7446a24 JDBC enhancement PR#1624 - address Madhavan' review comments. 2023-10-16 09:08:31 -05:00
yabinmeng
179a51c20b Major NB JDBC driver updates in order to support pg-vector
- Add PreparedStatement support
- Add batch update for DML write statements
- Add client-side connection pooling (needed for thread safety)
- Address issues caused by the fact that JDBC connection and statement are not thread-safe
- Fix the issue of no Vector value returned when running Vector queries
- Add the template yaml file for NB pg vector with relevancy score verificationn
2023-10-15 23:46:48 -05:00
Jonathan Shook
d87aac58a4 add license 2023-10-15 15:58:19 -05:00
Jonathan Shook
cf528847ec update key extraction to fit returned server format 2023-10-14 22:33:40 -05:00
Jonathan Shook
588b6d6ba1 refine query to suit server based on errors 2023-10-14 22:33:38 -05:00
Jonathan Shook
f1651e29af add doc reference to data api 2023-10-14 22:33:33 -05:00
Madhavan Sridharan
55bfc9ea77 remove unwanted imports 2023-10-14 13:48:33 -04:00
snyk-bot
dfc274ce2b
fix: upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.551 to 1.12.555
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.551 to 1.12.555.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-10-14 07:58:31 +00:00
snyk-bot
beace4be89
fix: upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.551 to 1.12.555
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.551 to 1.12.555.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-dynamodb/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/db3dfb82-467b-4263-94f8-28f933540a6d?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-10-14 04:06:44 +00:00
snyk-bot
84c63b50d5
fix: upgrade io.netty:netty-handler from 4.1.97.Final to 4.1.98.Final
Snyk has created this PR to upgrade io.netty:netty-handler from 4.1.97.Final to 4.1.98.Final.

See this package in Maven Repository:
https://mvnrepository.com/artifact/io.netty/netty-handler/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/d8f400a4-82ed-4d21-b83c-a584d8df78a4?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-10-14 01:47:31 +00:00
Jonathan Shook
77ae11c925 mongodb utils to convert document fields to vector indices 2023-10-13 17:51:03 -05:00
Madhavan Sridharan
57e7eaab05 disabling strictness with stable api, workload partial updates 2023-10-13 17:12:45 -04:00
Madhavan Sridharan
5667e0570a Initial working draft 2023-10-13 12:06:25 -04:00
Mark Wolters
78ff0a3fde
Merge pull request #1619 from nosqlbench/jshook/tagsafety
basic sanity check on tags, no newlines or spaces
2023-10-12 19:50:06 -04:00
Jonathan Shook
0c043944d1
Merge pull request #1614 from nosqlbench/snyk-upgrade-520d55dad79b2d2609d8744848c5bd16
[Snyk] Upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.550 to 1.12.551
2023-10-12 17:50:53 -05:00
Jonathan Shook
6e8ad6b549
Merge pull request #1615 from nosqlbench/snyk-upgrade-0f4305bfaaa3a8ed35b498a5c838ad5b
[Snyk] Upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.547 to 1.12.551
2023-10-12 17:50:43 -05:00
Jonathan Shook
116f48b2ba basic sanity check on tags, no newlines or spaces 2023-10-12 16:49:15 -05:00
Shaunak Das
7ae60286ac
Merge pull request #1601 from nosqlbench/client_metrics
#1537: Sanity checking on client side load should be included into core metrics and async warnings
2023-10-12 13:49:04 -07:00
Mark Wolters
23e4c5431c
Merge pull request #1616 from nosqlbench/update-pgvector
Fleshing out pgvector adapter
2023-10-11 07:17:33 -04:00
ShaunakDas88
cd1ab9c540 address draft PR comments 2023-10-10 22:37:43 -07:00
ShaunakDas88
bce0f9b297 style changes 2023-10-10 13:29:08 -07:00
ShaunakDas88
4502a5ec61 register client system metrics in NBCLI 2023-10-10 13:29:08 -07:00
ShaunakDas88
e7d876a8fb add client system metrics checker 2023-10-10 13:29:08 -07:00
ShaunakDas88
730000bec6 add /proc/{meminfo,diskstats,loadavg,stat} and /proc/net/dev parsers for linux 2023-10-10 13:29:08 -07:00
Mark Wolters
fd388b9ffc Fleshing out pgvector adapter 2023-10-10 09:51:20 -04:00
Jonathan Shook
aed2ee8d58 include updated functions in relevancy computations 2023-10-09 11:22:00 -05:00
snyk-bot
e19fcb357d
fix: upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.547 to 1.12.551
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-dynamodb from 1.12.547 to 1.12.551.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-dynamodb/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/db3dfb82-467b-4263-94f8-28f933540a6d?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-10-07 19:25:17 +00:00
snyk-bot
a45721cb66
fix: upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.550 to 1.12.551
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.550 to 1.12.551.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-10-07 18:06:11 +00:00
Jonathan Shook
c6b69bfa58
Merge pull request #1607 from nosqlbench/snyk-upgrade-d0ce14ee93eab8e885ebfbb8f6eef15d
[Snyk] Upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.547 to 1.12.550
2023-10-06 14:31:49 -05:00
Jonathan Shook
fa9478b2bd
Merge pull request #1608 from nosqlbench/snyk-upgrade-7889ea850674f95bbd05c3262e82cc34
[Snyk] Upgrade org.apache.groovy:groovy from 4.0.14 to 4.0.15
2023-10-06 14:31:40 -05:00
snyk-bot
bb10b8dce2
fix: upgrade org.apache.groovy:groovy from 4.0.14 to 4.0.15
Snyk has created this PR to upgrade org.apache.groovy:groovy from 4.0.14 to 4.0.15.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.apache.groovy/groovy/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/79ea2278-c4a8-4336-ba93-333db70b8c13?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-10-06 16:36:58 +00:00
snyk-bot
6951e5fdb8
fix: upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.547 to 1.12.550
Snyk has created this PR to upgrade com.amazonaws:aws-java-sdk-s3 from 1.12.547 to 1.12.550.

See this package in Maven Repository:
https://mvnrepository.com/artifact/com.amazonaws/aws-java-sdk-s3/

See this project in Snyk:
https://app.snyk.io/org/nosqlbench/project/024e32ec-7f80-485c-b7bf-f69d45f933ce?utm_source=github&utm_medium=referral&page=upgrade-pr
2023-10-06 16:27:05 +00:00
Jonathan Shook
9f005ac9b5
Merge pull request #1606 from nosqlbench/remove-hdfloader
removing hdf-loader module that has no relation to nb/nb5
2023-10-06 09:12:55 -05:00
Mark Wolters
dab3c91362 removing hdf-loader module that has no relation to nb/nb5 2023-10-06 09:43:59 -04:00
Jonathan Shook
39db0bb4cb
Update preview.yml
disable container tests until they are fixed
2023-10-05 22:04:34 -05:00
Jonathan Shook
bc79383d18 remove extraneous file 2023-10-05 21:17:03 -05:00
Jonathan Shook
442ad10bc5
Merge pull request #1605 from nosqlbench/jshook/nosqlbench-1604-blocktags
removed doc name prepending on block tag names
2023-10-05 20:40:32 -05:00
Jonathan Shook
71b39fa95a modify historic format testing to accomodate design change 2023-10-05 20:38:15 -05:00
Jonathan Shook
36a233eaa1 removed doc name prepending on block tag names 2023-10-05 20:05:03 -05:00
Jonathan Shook
2b2e969fa6 minor version bump 2023-10-05 18:27:27 -05:00
Jonathan Shook
17fb1f54c3 build fixes 2023-10-05 18:23:27 -05:00
Jonathan Shook
469985de6e update recall relevant set 2023-10-05 18:23:27 -05:00
Jonathan Shook
aa88c22a2c
Merge pull request #1602 from yabinmeng/rm-docker-metrics
Update the built-in cql-vector workload file
2023-10-05 18:08:27 -05:00
yabinmeng
e2d81071d0
Merge branch 'nosqlbench:main' into rm-docker-metrics 2023-10-05 10:29:45 -05:00
Jonathan Shook
4a6aa4790a
Merge pull request #1599 from nosqlbench/snyk-fix-b6ed9d795258fd7503c145ad5d50b6df
[Snyk] Security upgrade org.apache.kafka:kafka-clients from 3.5.1 to 3.6.0
2023-10-05 09:47:17 -05:00
Mark Wolters
afed0cbb0f
Merge pull request #1603 from nosqlbench/minor-yaml-fix
removing sensitive info from config
2023-10-05 10:37:56 -04:00
Mark Wolters
f9e4b22b8c removing sensitive info from config 2023-10-05 08:31:30 -04:00
yabinmeng
47c87c64eb Fix a possible NPE situation caused by unregisterMetrics() if registerMetrics() fails to execute somehow (e.g. CLI input parameter problem such as cycle number < stride number) 2023-10-04 21:49:28 -05:00
yabinmeng
2213676cef Change vector_value binding generation from ListSized to ListSizedHashed. This makes sure the generated embedding values are not the same. 2023-10-04 21:22:55 -05:00
yabinmeng
b7dd97cbfb Update the built-in cql-vector workload and fix an issue of not correctly setting the cycle count to the stride count if the cycle count is not specified explicitly. 2023-10-04 20:34:05 -05:00