Commit Graph

1735 Commits

Author SHA1 Message Date
Herbert Wolverson
15e16fa981 Actually prevent Insight from sending if it hasn't been enabled. 2024-12-17 09:11:18 -06:00
Herbert Wolverson
8329a5e404 This *should* fixup the async snafu preventing the web UI from working with the inline Insight client. 2024-12-17 08:57:49 -06:00
Herbert Wolverson
2882085dec This *should* fixup the async snafu preventing the web UI from working with the inline Insight client. 2024-12-17 08:55:43 -06:00
Herbert Wolverson
88a961b8b9 Update to match the actual data schema. 2024-12-16 15:55:58 -06:00
Herbert Wolverson
3ad62825a1 TEST COMMIT: Tracing the segfault. I mean it about the branch name at this point. 2024-12-16 14:42:49 -06:00
Herbert Wolverson
ac1bd84af2 UISP emits a "graph.dot" file for plotting to better understand full network layout. 2024-12-13 11:00:52 -06:00
Herbert Wolverson
88b87e2c5c Hotfix: big cleanup for the build_dpkg.sh script.
It includes remove_pinned_maps, the default dashboard. Rearranges the build to help the Python LDD fix. Removes some files that shouldn't have been listed. Puts shell scripts in the correct order.
2024-12-13 10:31:30 -06:00
Herbert Wolverson
048af8cfcc Hotfix: UISP capacities greater than 2gbps. 2024-12-13 09:23:14 -06:00
Herbert Wolverson
6b7bdcb4ff Fix retransmit scaling on the tree 2024-12-10 13:12:19 -06:00
Herbert "TheBracket" Wolverson
b659268687 Merge pull request #574 from LibreQoE/uisp_site_squash
* Add a new configuration item to the `[uisp_integration]` tree, `squ…
2024-12-10 12:46:35 -06:00
Herbert "TheBracket" Wolverson
1a082bbfd6 Merge pull request #583 from LibreQoE/is_is_isnt_isis
Allow IS-IS packets to pass unmolested
2024-12-10 12:45:43 -06:00
Herbert "TheBracket" Wolverson
0e0ee5daf7 Lts2 client (#594)
# 1.5 Beta 4 Changes

* MASSIVE reduction in memory usage, and no more explosive RAM growth over time.  
* Significant reduction in CPU usage for the UI and analysis threads.  
* Documentation improvements.  
* Netflow:  
  * Timestamps were invalid, causing UISP to reject the input.  
  * Move to a lock-free collection system, eliminating delays and lowering CPU usage.  
* Fixed automatic provisioning of Long-Term Stats subscribers.  
* User Interface:  
  * “Top X” tables in the UI are now buffered for smoother output.  
  * Improvements to graph consistency in UI.  
  * Network panel on customers now buffers and fades entries out, so it’s possible to read rather than continually jumping.  
  * TCP Retransmits are now displayed as a percentage of TCP packets, giving a much better *relative* scale of where issues are occurring.  
  * Up/Down is now labeled on packet counts.  
  * Improved output scaling on numbers trims “.0”  
  * IPv6 prefix detection is *much* better and won’t cause UI errors.  
  * Configuration editor now handles floats vs ints correctly.  
  * Fixed a login error if no authentication cookie is set.  
  * Improved Sankey redaction.  
  * Fixed an occasional error that would make the “sponsor us” toast appear incorrectly.  
  * Sankey coloration fixes.  
* Geo.bin file now won’t self-update very often (it tracks ASN data), and only if it has changed on the server-side.  
* LTS2: If you’re invited to help us test it, we’re starting early alpha testing. This version includes the client to make that possible. LTS1 will continue to function/gather data.
2024-12-10 12:45:00 -06:00
Herbert Wolverson
78894e7888 This should allow IS-IS packets to pass. 2024-11-18 09:19:43 -06:00
Herbert Wolverson
0ce2c9ba6d Make geotable only load once. 2024-11-09 10:18:27 -06:00
Herbert Wolverson
b062dfc7a7 * Add a new configuration item to the [uisp_integration] tree, squash_sites = ["site1", "site2"]. It's optional, so it's ok to not have it.
* Modify UISP integration so that sites in this list - when the system is in Full strategy - will be promoted to directly parent off the root.

This should be useful for CPU management when you have a hierarchy that concentrates too much load in one place.

It's an interim fix until the next full version after this one that adds "virtual node" support.
2024-11-06 09:54:49 -06:00
Robert Chacón
11c8a25c1c Update lib.rs 2024-10-31 20:26:09 -06:00
Robert Chacón
37396958e2 Merge branch 'ui_stability' into fix_merge_ui_stability 2024-10-31 12:51:38 -07:00
Herbert "TheBracket" Wolverson
15e7c0ecdb Merge branch 'develop' into ui_stability 2024-10-31 13:59:42 -05:00
Herbert Wolverson
9c2c3cda1a Remove warning 2024-10-31 12:40:45 -05:00
Herbert Wolverson
2633971191 FIXES #563 - Default globe for "unknown" flag. 2024-10-31 12:39:53 -05:00
Herbert Wolverson
f3ae8443c4 FIXES #562 - Display download/upload rather than download/download. 2024-10-31 12:28:28 -05:00
Herbert Wolverson
dcd8e68486 Set PIP_BREAK_SYSTEM_PACKAGES=1 instead of using --break-system-packages - it should fix the install issues for older versions of Ubuntu. 2024-10-31 12:26:04 -05:00
Herbert Wolverson
f3ea4a269b Merge fix for spylnx integration enable checking back from lts2_client 2024-10-31 12:24:21 -05:00
Herbert Wolverson
de264bd200 EBPF garbage collector: hourly remove throughput entries that haven't been seen recently. Runs in a background thread, so iteration time should be a non-issue. 2024-10-31 10:55:41 -05:00
Robert Chacón
0c399615d9 Add files via upload 2024-10-30 10:51:40 -07:00
Robert Chacón
27bfd83903 Add files via upload 2024-10-30 10:47:31 -07:00
Herbert Wolverson
0d6c9d38fd WIP: Remove diagnostic prints. 2024-10-29 12:53:30 -05:00
Herbert Wolverson
d8f7c0e6db WIP: (Has far too much diagnostic output) but no longer deadlocks... 2024-10-29 12:38:54 -05:00
Herbert Wolverson
1d69f33806 Experiment branch: move Config inside an Arc (and an ArcSwap), so it isn't repeatedly cloned. 2024-10-29 12:04:26 -05:00
Herbert Wolverson
dca983b757 Experiment: removing shrink_to_fit calls to avoid reallocation. 2024-10-28 16:11:33 -05:00
Herbert Wolverson
3f39be9590 Experiment: switch out memory allocator to use MiMalloc, which provides some diagnostics that may help me. 2024-10-28 08:31:48 -05:00
Herbert Wolverson
22979e02a1 Small improvement in how the config path is determined (idiomatic code) 2024-10-25 11:21:18 -05:00
Herbert Wolverson
1b17e0c2e0 Back-port changing the UI title from the lts2_client branch. 2024-10-25 10:56:42 -05:00
Herbert Wolverson
7fdc6c9116 Change the QUEUE_STRUCTURE to an ArcSwap, further reducing locking. 2024-10-25 10:53:26 -05:00
Herbert Wolverson
4192183616 Changing shaped devices to an ArcSwap from a RwLock, since it is only ever replaced in-total. This eliminates a HUGE number of locks. 2024-10-25 10:38:47 -05:00
Herbert Wolverson
ea80139311 Add explicit cleanup to the queue tracker to remove any queues that were once seen but have gone 2024-10-25 10:14:29 -05:00
Herbert Wolverson
3db42b1845 Fixup some login the flow tracking - wrong nesting meant one branch was impossible! 2024-10-25 09:54:22 -05:00
Herbert Wolverson
4b36abf0bb Replace DashSet in the network json tree with HashSet. 2024-10-25 09:44:13 -05:00
Herbert Wolverson
bb49a3cb83 Revert "Stop using Dashmap for the raw data. Go with a simple approach."
This reverts commit aed23f85fe.
2024-10-25 09:36:27 -05:00
Herbert Wolverson
5f5c45626b Revert "Test raw_data retention."
This reverts commit c74dcb5c86.
2024-10-25 09:36:27 -05:00
Herbert Wolverson
c02f6e58f1 Revert "That was a BAD idea. Revert."
This reverts commit 96a26b1c18.
2024-10-25 09:36:27 -05:00
Herbert Wolverson
96a26b1c18 That was a BAD idea. Revert. 2024-10-25 09:23:47 -05:00
Herbert Wolverson
c74dcb5c86 Test raw_data retention. 2024-10-25 09:10:42 -05:00
Herbert Wolverson
aed23f85fe Stop using Dashmap for the raw data. Go with a simple approach. 2024-10-24 14:01:40 -05:00
Herbert Wolverson
f53dac3424 Add an explicit dashmap shrink to fit 2024-10-24 13:36:38 -05:00
Herbert Wolverson
4ebf531f58 Stale comment cleanup 2024-10-24 13:15:14 -05:00
Herbert Wolverson
a0b5edca89 FlowbeeData is also trivially copyable. 2024-10-24 12:40:18 -05:00
Herbert Wolverson
7e3e5c0355 Mark a couple of types as being copy-friendly. 2024-10-24 12:39:32 -05:00
Herbert Wolverson
c46ce7ccd9 Experiment: exclude one-way flows (failed connections) from analysis. 2024-10-24 12:28:58 -05:00
Herbert Wolverson
691816745d Larger arena for flows. 2024-10-24 12:03:43 -05:00