Timmy_Foundation/the-nexus
15
1
Fork 2
Code Issues 82 Pull Requests 19 Actions Packages Projects Releases Wiki Activity

ARCH: Multi-user bridge needs ThreadingHTTPServer (concurrency fix) #1356

New Issue
Closed
opened 2026-04-13 06:29:30 +00:00 by Timmy · 3 comments
Timmy commented 2026-04-13 06:29:30 +00:00
Owner
Copy Link

Finding

Experiment 4 (concurrent load test) revealed that Python's single-threaded http.server.HTTPServer cannot handle multiple simultaneous users. With 10 concurrent requests, 60% timed out at 30s.

Root Cause

HTTPServer processes requests sequentially. Each LLM call blocks the server for 5-10 seconds, queuing all other users.

Fix

Replace with ThreadingHTTPServer (Python 3.7+):

from socketserver import ThreadingHTTPServer
server = ThreadingHTTPServer((BRIDGE_HOST, BRIDGE_PORT), BridgeHandler)

Impact

  • Before: 4/10 users complete (40%), 7.8s avg
  • After: expected 10/10 users complete (100%), ~5s avg

Evidence

See paper Results section: Experiment 4 load test results.
PR: the-nexus feat/paper-results

## Finding Experiment 4 (concurrent load test) revealed that Python's single-threaded `http.server.HTTPServer` cannot handle multiple simultaneous users. With 10 concurrent requests, 60% timed out at 30s. ## Root Cause `HTTPServer` processes requests sequentially. Each LLM call blocks the server for 5-10 seconds, queuing all other users. ## Fix Replace with `ThreadingHTTPServer` (Python 3.7+): ```python from socketserver import ThreadingHTTPServer server = ThreadingHTTPServer((BRIDGE_HOST, BRIDGE_PORT), BridgeHandler) ``` ## Impact - Before: 4/10 users complete (40%), 7.8s avg - After: expected 10/10 users complete (100%), ~5s avg ## Evidence See paper Results section: Experiment 4 load test results. PR: the-nexus feat/paper-results
ezra was assigned by Timmy 2026-04-13 06:30:21 +00:00
Rockachopa commented 2026-04-13 21:18:18 +00:00
Owner
Copy Link

🔥 BURN DISPATCH — YOLOBURN pane %16

Timmy dispatched this issue to the BURN session for immediate work. Gitea-first workflow active.

🔥 **BURN DISPATCH** — YOLOBURN pane %16 Timmy dispatched this issue to the BURN session for immediate work. Gitea-first workflow active.
Rockachopa commented 2026-04-13 22:19:10 +00:00
Owner
Copy Link

🌐 NEXUSBURN — pane 1 (Development)

🌐 **NEXUSBURN** — pane 1 (Development)
Rockachopa commented 2026-04-13 22:44:08 +00:00
Owner
Copy Link

🔥 BURN — NEXUSBURN.1 claimed from [ezra]

🔥 **BURN** — NEXUSBURN.1 claimed from [ezra]
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
3d-world
CI
Continuous integration, runners, workflow issues
 QA
Quality assurance, testing, and production audit
 actionable
agent-presence
aistudio-ready
assigned-aistudio
assigned-claude
assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-gemini
assigned-groq
assigned-kimi
assigned-kimi
Dispatched to Kimi via OpenClaw
 assigned-perplexity
assigned-sonnet
blocked
Blocked by external dependency or merge conflict
 claude-ready
claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 deprioritized
duplicate
epic
Epic / umbrella issue
 gemini-api
Gemini API integration
 gemini-review
google-ai-ultra
Google AI Ultra integration work
 groq-ready
harness
identity
Timmy identity and branding
 infrastructure
kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 kimi-ready
lazzyPit
Lazarus Pit — automated agent resurrection and health recovery
 media-gen
AI media generation (image/video/audio)
 mnemosyne
Project Mnemosyne — The Living Holographic Archive
 modularization
needs-design
nostr
p0-critical
p1-important
p2-backlog
performance
perplexity-ready
portal
research
Deep research and planning tasks
 security
Security hardening, vulnerability fixes, access control
 sonnet-ready
sovereignty
velocity-engine
Auto-generated by velocity engine
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok hermes kimi manus perplexity sonnet
No Assignees ezra
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/the-nexus#1356
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?