Commit Graph
100 Commits
Author SHA1 Message Date
Mark Wolters 3099e0afeb added option to disable endpoint identification and TLS validation (#2184) 2025-06-17 12:41:38 -05:00
Mark WoltersandJonathan Shook 346cc2216a fix for large fvec/ivec files (#2172)
* fix for large fvec/ivec files

* make fvec ivec threadsafe

* adding fvec reader test

* license

* fixed fvec reader test, updated fvec and ivec readers to close properly

* copyright added

---------

Co-authored-by: Jonathan Shook <jshook@users.noreply.github.com>
2025-05-02 14:00:03 -05:00
Mark Wolters 55bec2d65f Mwolters/metadata (#2166)
* add processing of data type metadata

* switching internal classes to nbvector lib

* cleanup and adding comments
2025-03-11 08:34:36 -05:00
Mark Wolters 30aa883c8b fixed comment on short int possible values 2025-03-04 11:56:32 -05:00
Mark Wolters 9b3bb6d161 adding documentation for predicate processing protocol 2025-03-04 11:00:36 -05:00
Mark Wolters 10366420cd Merge pull request #2164 from nosqlbench/binpred
Binpred
2025-02-28 12:32:44 -04:00
Mark Wolters 8af6b338ab remove BinString proc and bump to latest jhdf 2025-02-28 09:30:45 -05:00
Mark Wolters cdc5d7e2ae print dataset attributes on open 2025-02-27 16:21:25 -05:00
Mark Wolters 0a0fb2ffd4 bringing nbdata library in line with other repo 2025-02-27 16:12:03 -05:00
Mark Wolters 2e5df7516a adding copyright statements 2025-02-27 15:15:54 -05:00
Mark Wolters 4f11826dda handle bin protocol 2025-02-27 13:38:56 -05:00
Mark Wolters 937653debe adding versioning 2025-02-27 07:35:18 -05:00
Mark Wolters 38cbdc5a0d initial commit 2025-02-26 16:12:57 -05:00
Mark Wolters d617796f99 Mwolters/pred enhancements (#2159)
* adding new binding for single array int types

* new binding for var length int arrays

* new binding for var length int arrays cleanup

* add embedding to convert int array to string

* add script for hdf5 generation

* list version of var length int embedding

* updating target byte code for groovy scripts

* adding pytorch version

* removing datagen files to put them in tools repo

* make IntArrayToString threadsafe
2025-02-08 05:05:49 -06:00
Mark Wolters cacd39231f updating target byte code for Groovy (#2157) 2025-01-27 17:11:49 -06:00
Mark Wolters a2d74775eb spanner version 6.74->6.76 and updated copyright date 2024-10-01 13:52:29 -04:00
Mark Wolters bad242f577 rename to simply spanner,added check for service account file 2024-10-01 13:29:42 -04:00
Mark Wolters eb33818ce0 Initial implementation of gcp spanner adapter
reverting jdbc changes for pr

renames and cleanup
2024-10-01 12:27:15 -04:00
Mark Wolters ffd6c22e6a Merge branch 'main' into spanner 2024-09-24 16:23:16 -04:00
Mark Wolters 9d5824b650 add ops for dml and ddl support 2024-09-24 16:16:09 -04:00
Mark Wolters 0cb84c27c3 changes to allow for spanner 2024-09-20 13:44:52 -04:00
Mark Wolters 38970a6f23 checkpoint 2024-09-17 15:29:05 -04:00
Mark Wolters b3144751e4 compilation fix 2024-09-16 17:24:34 -04:00
Mark Wolters 18bb966284 Merge pull request #2014 from nosqlbench/adapters/vespa
utility method for extracting ids from vespa results
2024-08-16 14:06:48 -04:00
Mark Wolters 52e9a1a14f adding pgvector-specific documentation 2024-06-28 15:41:47 -04:00
Mark Wolters e29f3d8719 add check for download too large for filesystem 2024-06-26 17:16:48 -04:00
Mark Wolters aa262d2b07 Merge pull request #1955 from nosqlbench/mwolters/sqlite
Mwolters/sqlite
2024-06-24 15:38:37 -04:00
Mark Wolters 23a1c3a207 Merge branch 'main' into mwolters/sqlite 2024-06-24 15:32:00 -04:00
Mark Wolters 12d4c8f6d6 fixed issue with new parameters 2024-06-17 16:27:01 -04:00
Mark Wolters 3f2a304b83 finished administrative function ops 2024-06-14 15:52:43 -04:00
Mark Wolters f1ef3a24c1 adding administrative function ops 2024-06-14 15:17:11 -04:00
Mark Wolters f772af9d0e adding full set of create collection options 2024-06-13 11:28:54 -04:00
Mark Wolters 4618f4d405 impl of delete all and create collection with class 2024-06-12 16:57:27 -04:00
Mark Wolters 70cd4a0dd4 impl of replace ops 2024-06-12 11:51:30 -04:00
Mark Wolters 92f96f6bb4 Find Distinct op 2024-06-12 10:48:08 -04:00
Mark Wolters c5f74e688c update many op impl 2024-06-12 09:38:05 -04:00
Mark Wolters 1aa8d9ec37 update one op impl 2024-06-12 08:57:52 -04:00
Mark Wolters f37796b8a0 updated FindOptions to include all possible options 2024-06-11 13:18:02 -04:00
Mark Wolters 93dfaec743 new DataApiFindById op type 2024-06-11 12:56:32 -04:00
Mark Wolters 37cd2f7bb4 add timeout to InsertManyOptions configuration 2024-06-10 19:20:13 -04:00
Mark Wolters dac6c09dd6 Merge branch 'main' into mwolters/sqlite 2024-06-06 09:04:34 -04:00
Mark Wolters 6f768fc42d Merge branch 'main' into mwolters/sqlite 2024-05-30 10:40:41 -04:00
Mark Wolters c566aa493f report id applies to PIT 2024-05-30 08:11:50 -04:00
Mark Wolters 1eba54e3ce first working version 2024-05-30 08:09:54 -04:00
Mark Wolters 4e9c369304 initial commit 2024-05-29 18:46:50 -04:00
Mark Wolters 118b6d16db fix for findmax early exit bug 2024-05-28 17:00:29 -04:00
Mark Wolters 0740f8c202 adjusting default findmax values 2024-05-20 10:17:58 -04:00
Mark Wolters a249016a56 templating findmax vars for vector workload 2024-05-17 10:02:45 -04:00
Mark Wolters 031fd5fc59 bug fix for similarity function 2024-05-10 18:48:44 -04:00
Mark Wolters 101e9d93fa adding vector find ops 2024-05-10 18:22:01 -04:00
Mark Wolters e6d2c35f5a fixed condition when find options consist of vector only 2024-05-10 18:00:13 -04:00
Mark Wolters d5a96e81c4 vectorizing find one op 2024-05-10 17:49:20 -04:00
Mark Wolters 6799c196d1 more example yamls 2024-05-10 15:48:48 -04:00
Mark Wolters 8b332fbed8 filling yamls 2024-05-10 15:10:40 -04:00
Mark Wolters 455a938bc8 adding example yamls 2024-05-10 11:36:01 -04:00
Mark Wolters d9d728eadd implementing options behaviors 2024-05-09 17:42:29 -04:00
Mark Wolters 464b6a8df3 find and insert ops 2024-05-09 10:55:59 -04:00
Mark Wolters 8702aec522 adding examples 2024-04-17 19:23:35 -04:00
Mark Wolters 7cf6dab367 added start threads option to optimo 2024-04-17 14:56:55 -04:00
Mark Wolters 3fab415c6d added min_frames and contra_base_value params 2024-04-17 09:56:55 -04:00
Mark Wolters 3dbbc133cb addig documentation for nbio caching 2024-04-16 08:44:42 -04:00
Mark Wolters efc82f03f8 Merge pull request #1925 from nosqlbench/mwolters/nbiocache_enhancements
progress monitor
2024-04-12 15:16:21 -04:00
Mark Wolters 72e7a1e772 added progress monitoring for downloads and cache cleanup in failure scenarios 2024-04-12 13:46:15 -04:00
Mark Wolters 3ee54432d0 strip control characters from checksums 2024-04-11 20:27:11 -05:00
Mark Wolters 26bb89f2be moved checksum path generation to separate method 2024-04-11 20:27:11 -05:00
Mark Wolters aa6326ffd8 Updated code to simply append .sha256 to complete filename or url 2024-04-11 20:27:11 -05:00
Mark Wolters 5021a00fb4 fixed file download code 2024-04-11 20:27:11 -05:00
Mark Wolters a96fa4e486 fixed bug on checksum check 2024-04-11 20:27:11 -05:00
Mark Wolters 17a206f613 removed breaking test 2024-04-11 20:27:11 -05:00
Mark Wolters 59b2502e11 reorganized logic around main resolver conditions 2024-04-11 20:27:11 -05:00
Mark Wolters ddb8d4d550 javadoc 2024-04-11 20:27:11 -05:00
Mark Wolters e8e67bcdd6 added command line configuration options 2024-04-11 20:27:11 -05:00
Mark Wolters 45ac75b90b added command line option to use nbio cache 2024-04-11 20:27:11 -05:00
Mark Wolters 3845fd8256 fixed issue returning dirs 2024-04-11 20:27:11 -05:00
Mark Wolters e14761bb08 added resolver for nbio cache into flow, resolved download issues 2024-04-11 20:27:11 -05:00
Mark Wolters dcd4b0fe72 checkpoint checkin 2024-04-11 20:27:11 -05:00
Mark Wolters 2692a86273 checking in code for handling locally cached file 2024-04-11 20:27:11 -05:00
Mark Wolters 99213b4556 adding resolver for NBIO cache 2024-04-11 20:27:11 -05:00
Mark Wolters a94b0dc21a cleanup 2024-04-01 14:01:16 -05:00
Mark Wolters bf34f58af3 made listeners static 2024-04-01 14:01:16 -05:00
Mark Wolters 6e96c9c7aa moving creation logic to NBCreators 2024-04-01 14:01:16 -05:00
Mark Wolters 8abb35b818 adding closeable hooks 2024-04-01 14:01:16 -05:00
Mark Wolters 5df093942a adding closeable hook 2024-04-01 14:01:16 -05:00
Mark Wolters b744fe880f initial commit 2024-04-01 14:01:16 -05:00
Mark Wolters 52863ff38c fixed error message 2024-04-01 14:00:47 -05:00
Mark Wolters 7edf6fb85c converted config to a record type and changed frame step results to something more lucid 2024-04-01 14:00:47 -05:00
Mark Wolters 7d961cb351 finished generification 2024-04-01 14:00:47 -05:00
Mark Wolters 08bd1ca029 generifying 2024-04-01 14:00:47 -05:00
Mark Wolters 361f441530 adding threads option 2024-04-01 14:00:47 -05:00
Mark Wolters fc574eceb2 cleanup 2024-04-01 14:00:47 -05:00
Mark Wolters 33483ad2d7 minfun complete 2024-04-01 14:00:47 -05:00
Mark Wolters ff079c04bc EOD checkin - not ready for use 2024-04-01 14:00:47 -05:00
Mark Wolters 689494c6a1 initial commit very much WIP and not ready to test 2024-04-01 14:00:47 -05:00
Mark Wolters 099a638856 updates to generate runnable cql statements 2024-03-12 15:11:21 -04:00
Mark Wolters d8962d510a restoring accidentally deleted configurations 2024-03-08 11:03:27 -04:00
Mark Wolters b49ecc6087 made type of serializer configurable in ctor 2024-03-08 10:15:15 -04:00
Mark Wolters 20da396c17 use spi service loader for serdes impl 2024-03-07 17:08:17 -04:00
Mark Wolters c42d5c5d4e adding binding for json to cql predicates 2024-03-07 16:37:54 -04:00
Mark Wolters 3a292e8f14 more code cleanup 2024-03-07 11:42:34 -04:00
Mark Wolters 93895a5e58 more code cleanup 2024-03-07 11:23:43 -04:00