* feat(auth): add same-provider credential pools and rotation UX Add same-provider credential pooling so Hermes can rotate across multiple credentials for a single provider, recover from exhausted credentials without jumping providers immediately, and configure that behavior directly in hermes setup. - agent/credential_pool.py: persisted per-provider credential pools - hermes auth add/list/remove/reset CLI commands - 429/402/401 recovery with pool rotation in run_agent.py - Setup wizard integration for pool strategy configuration - Auto-seeding from env vars and existing OAuth state Co-authored-by: kshitijk4poor <82637225+kshitijk4poor@users.noreply.github.com> Salvaged from PR #2647 * fix(tests): prevent pool auto-seeding from host env in credential pool tests Tests for non-pool Anthropic paths and auth remove were failing when host env vars (ANTHROPIC_API_KEY) or file-backed OAuth credentials were present. The pool auto-seeding picked these up, causing unexpected pool entries in tests. - Mock _select_pool_entry in auxiliary_client OAuth flag tests - Clear Anthropic env vars and mock _seed_from_singletons in auth remove test * feat(auth): add thread safety, least_used strategy, and request counting - Add threading.Lock to CredentialPool for gateway thread safety (concurrent requests from multiple gateway sessions could race on pool state mutations without this) - Add 'least_used' rotation strategy that selects the credential with the lowest request_count, distributing load more evenly - Add request_count field to PooledCredential for usage tracking - Add mark_used() method to increment per-credential request counts - Wrap select(), mark_exhausted_and_rotate(), and try_refresh_current() with lock acquisition - Add tests: least_used selection, mark_used counting, concurrent thread safety (4 threads × 20 selects with no corruption) * feat(auth): add interactive mode for bare 'hermes auth' command When 'hermes auth' is called without a subcommand, it now launches an interactive wizard that: 1. Shows full credential pool status across all providers 2. Offers a menu: add, remove, reset cooldowns, set strategy 3. For OAuth-capable providers (anthropic, nous, openai-codex), the add flow explicitly asks 'API key or OAuth login?' — making it clear that both auth types are supported for the same provider 4. Strategy picker shows all 4 options (fill_first, round_robin, least_used, random) with the current selection marked 5. Remove flow shows entries with indices for easy selection The subcommand paths (hermes auth add/list/remove/reset) still work exactly as before for scripted/non-interactive use. * fix(tests): update runtime_provider tests for config.yaml source of truth (#4165) Tests were using OPENAI_BASE_URL env var which is no longer consulted after #4165. Updated to use model config (provider, base_url, api_key) which is the new single source of truth for custom endpoint URLs. * feat(auth): support custom endpoint credential pools keyed by provider name Custom OpenAI-compatible endpoints all share provider='custom', making the provider-keyed pool useless. Now pools for custom endpoints are keyed by 'custom:<normalized_name>' where the name comes from the custom_providers config list (auto-generated from URL hostname). - Pool key format: 'custom:together.ai', 'custom:local-(localhost:8080)' - load_pool('custom:name') seeds from custom_providers api_key AND model.api_key when base_url matches - hermes auth add/list now shows custom endpoints alongside registry providers - _resolve_openrouter_runtime and _resolve_named_custom_runtime check pool before falling back to single config key - 6 new tests covering custom pool keying, seeding, and listing * docs: add Excalidraw diagram of full credential pool flow Comprehensive architecture diagram showing: - Credential sources (env vars, auth.json OAuth, config.yaml, CLI) - Pool storage and auto-seeding - Runtime resolution paths (registry, custom, OpenRouter) - Error recovery (429 retry-then-rotate, 402 immediate, 401 refresh) - CLI management commands and strategy configuration Open at: https://excalidraw.com/#json=2Ycqhqpi6f12E_3ITyiwh,c7u9jSt5BwrmiVzHGbm87g * fix(tests): update setup wizard pool tests for unified select_provider_and_model flow The setup wizard now delegates to select_provider_and_model() instead of using its own prompt_choice-based provider picker. Tests needed: - Mock select_provider_and_model as no-op (provider pre-written to config) - Call _stub_tts BEFORE custom prompt_choice mock (it overwrites it) - Pre-write model.provider to config so the pool step is reached * docs: add comprehensive credential pool documentation - New page: website/docs/user-guide/features/credential-pools.md Full guide covering quick start, CLI commands, rotation strategies, error recovery, custom endpoint pools, auto-discovery, thread safety, architecture, and storage format. - Updated fallback-providers.md to reference credential pools as the first layer of resilience (same-provider rotation before cross-provider) - Added hermes auth to CLI commands reference with usage examples - Added credential_pool_strategies to configuration guide * chore: remove excalidraw diagram from repo (external link only) * refactor: simplify credential pool code — extract helpers, collapse extras, dedup patterns - _load_config_safe(): replace 4 identical try/except/import blocks - _iter_custom_providers(): shared generator for custom provider iteration - PooledCredential.extra dict: collapse 11 round-trip-only fields (token_type, scope, client_id, portal_base_url, obtained_at, expires_in, agent_key_id, agent_key_expires_in, agent_key_reused, agent_key_obtained_at, tls) into a single extra dict with __getattr__ for backward-compatible access - _available_entries(): shared exhaustion-check between select and peek - Dedup anthropic OAuth seeding (hermes_pkce + claude_code identical) - SimpleNamespace replaces class _Args boilerplate in auth_commands - _try_resolve_from_custom_pool(): shared pool-check in runtime_provider Net -17 lines. All 383 targeted tests pass. --------- Co-authored-by: kshitijk4poor <82637225+kshitijk4poor@users.noreply.github.com>
471 lines
16 KiB
Python
471 lines
16 KiB
Python
"""Credential-pool auth subcommands."""
|
|
|
|
from __future__ import annotations
|
|
|
|
from getpass import getpass
|
|
import math
|
|
import time
|
|
from types import SimpleNamespace
|
|
import uuid
|
|
|
|
from agent.credential_pool import (
|
|
AUTH_TYPE_API_KEY,
|
|
AUTH_TYPE_OAUTH,
|
|
CUSTOM_POOL_PREFIX,
|
|
SOURCE_MANUAL,
|
|
STATUS_EXHAUSTED,
|
|
STRATEGY_FILL_FIRST,
|
|
STRATEGY_ROUND_ROBIN,
|
|
STRATEGY_RANDOM,
|
|
STRATEGY_LEAST_USED,
|
|
SUPPORTED_POOL_STRATEGIES,
|
|
PooledCredential,
|
|
_normalize_custom_pool_name,
|
|
get_pool_strategy,
|
|
label_from_token,
|
|
list_custom_pool_providers,
|
|
load_pool,
|
|
_exhausted_ttl,
|
|
)
|
|
import hermes_cli.auth as auth_mod
|
|
from hermes_cli.auth import PROVIDER_REGISTRY
|
|
from hermes_constants import OPENROUTER_BASE_URL
|
|
|
|
|
|
# Providers that support OAuth login in addition to API keys.
|
|
_OAUTH_CAPABLE_PROVIDERS = {"anthropic", "nous", "openai-codex"}
|
|
|
|
|
|
def _get_custom_provider_names() -> list:
|
|
"""Return list of (display_name, pool_key) tuples for custom_providers in config."""
|
|
try:
|
|
from hermes_cli.config import load_config
|
|
|
|
config = load_config()
|
|
except Exception:
|
|
return []
|
|
custom_providers = config.get("custom_providers")
|
|
if not isinstance(custom_providers, list):
|
|
return []
|
|
result = []
|
|
for entry in custom_providers:
|
|
if not isinstance(entry, dict):
|
|
continue
|
|
name = entry.get("name")
|
|
if not isinstance(name, str) or not name.strip():
|
|
continue
|
|
pool_key = f"{CUSTOM_POOL_PREFIX}{_normalize_custom_pool_name(name)}"
|
|
result.append((name.strip(), pool_key))
|
|
return result
|
|
|
|
|
|
def _resolve_custom_provider_input(raw: str) -> str | None:
|
|
"""If raw input matches a custom_providers entry name (case-insensitive), return its pool key."""
|
|
normalized = (raw or "").strip().lower().replace(" ", "-")
|
|
if not normalized:
|
|
return None
|
|
# Direct match on 'custom:name' format
|
|
if normalized.startswith(CUSTOM_POOL_PREFIX):
|
|
return normalized
|
|
for display_name, pool_key in _get_custom_provider_names():
|
|
if _normalize_custom_pool_name(display_name) == normalized:
|
|
return pool_key
|
|
return None
|
|
|
|
|
|
def _normalize_provider(provider: str) -> str:
|
|
normalized = (provider or "").strip().lower()
|
|
if normalized in {"or", "open-router"}:
|
|
return "openrouter"
|
|
# Check if it matches a custom provider name
|
|
custom_key = _resolve_custom_provider_input(normalized)
|
|
if custom_key:
|
|
return custom_key
|
|
return normalized
|
|
|
|
|
|
def _provider_base_url(provider: str) -> str:
|
|
if provider == "openrouter":
|
|
return OPENROUTER_BASE_URL
|
|
if provider.startswith(CUSTOM_POOL_PREFIX):
|
|
from agent.credential_pool import _get_custom_provider_config
|
|
|
|
cp_config = _get_custom_provider_config(provider)
|
|
if cp_config:
|
|
return str(cp_config.get("base_url") or "").strip()
|
|
return ""
|
|
pconfig = PROVIDER_REGISTRY.get(provider)
|
|
return pconfig.inference_base_url if pconfig else ""
|
|
|
|
|
|
def _oauth_default_label(provider: str, count: int) -> str:
|
|
return f"{provider}-oauth-{count}"
|
|
|
|
|
|
def _api_key_default_label(count: int) -> str:
|
|
return f"api-key-{count}"
|
|
|
|
|
|
def _display_source(source: str) -> str:
|
|
return source.split(":", 1)[1] if source.startswith("manual:") else source
|
|
|
|
|
|
def _format_exhausted_status(entry) -> str:
|
|
if entry.last_status != STATUS_EXHAUSTED:
|
|
return ""
|
|
code = f" ({entry.last_error_code})" if entry.last_error_code else ""
|
|
if not entry.last_status_at:
|
|
return f" exhausted{code}"
|
|
remaining = max(0, int(math.ceil((entry.last_status_at + _exhausted_ttl(entry.last_error_code)) - time.time())))
|
|
if remaining <= 0:
|
|
return f" exhausted{code} (ready to retry)"
|
|
minutes, seconds = divmod(remaining, 60)
|
|
hours, minutes = divmod(minutes, 60)
|
|
if hours:
|
|
wait = f"{hours}h {minutes}m"
|
|
elif minutes:
|
|
wait = f"{minutes}m {seconds}s"
|
|
else:
|
|
wait = f"{seconds}s"
|
|
return f" exhausted{code} ({wait} left)"
|
|
|
|
|
|
def auth_add_command(args) -> None:
|
|
provider = _normalize_provider(getattr(args, "provider", ""))
|
|
if provider not in PROVIDER_REGISTRY and provider != "openrouter" and not provider.startswith(CUSTOM_POOL_PREFIX):
|
|
raise SystemExit(f"Unknown provider: {provider}")
|
|
|
|
requested_type = str(getattr(args, "auth_type", "") or "").strip().lower()
|
|
if requested_type in {AUTH_TYPE_API_KEY, "api-key"}:
|
|
requested_type = AUTH_TYPE_API_KEY
|
|
if not requested_type:
|
|
if provider.startswith(CUSTOM_POOL_PREFIX):
|
|
requested_type = AUTH_TYPE_API_KEY
|
|
else:
|
|
requested_type = AUTH_TYPE_OAUTH if provider in {"anthropic", "nous", "openai-codex"} else AUTH_TYPE_API_KEY
|
|
|
|
pool = load_pool(provider)
|
|
|
|
if requested_type == AUTH_TYPE_API_KEY:
|
|
token = (getattr(args, "api_key", None) or "").strip()
|
|
if not token:
|
|
token = getpass("Paste your API key: ").strip()
|
|
if not token:
|
|
raise SystemExit("No API key provided.")
|
|
default_label = _api_key_default_label(len(pool.entries()) + 1)
|
|
label = (getattr(args, "label", None) or "").strip()
|
|
if not label:
|
|
label = input(f"Label (optional, default: {default_label}): ").strip() or default_label
|
|
entry = PooledCredential(
|
|
provider=provider,
|
|
id=uuid.uuid4().hex[:6],
|
|
label=label,
|
|
auth_type=AUTH_TYPE_API_KEY,
|
|
priority=0,
|
|
source=SOURCE_MANUAL,
|
|
access_token=token,
|
|
base_url=_provider_base_url(provider),
|
|
)
|
|
pool.add_entry(entry)
|
|
print(f'Added {provider} credential #{len(pool.entries())}: "{label}"')
|
|
return
|
|
|
|
if provider == "anthropic":
|
|
from agent import anthropic_adapter as anthropic_mod
|
|
|
|
creds = anthropic_mod.run_hermes_oauth_login_pure()
|
|
if not creds:
|
|
raise SystemExit("Anthropic OAuth login did not return credentials.")
|
|
label = (getattr(args, "label", None) or "").strip() or label_from_token(
|
|
creds["access_token"],
|
|
_oauth_default_label(provider, len(pool.entries()) + 1),
|
|
)
|
|
entry = PooledCredential(
|
|
provider=provider,
|
|
id=uuid.uuid4().hex[:6],
|
|
label=label,
|
|
auth_type=AUTH_TYPE_OAUTH,
|
|
priority=0,
|
|
source=f"{SOURCE_MANUAL}:hermes_pkce",
|
|
access_token=creds["access_token"],
|
|
refresh_token=creds.get("refresh_token"),
|
|
expires_at_ms=creds.get("expires_at_ms"),
|
|
base_url=_provider_base_url(provider),
|
|
)
|
|
pool.add_entry(entry)
|
|
print(f'Added {provider} OAuth credential #{len(pool.entries())}: "{entry.label}"')
|
|
return
|
|
|
|
if provider == "nous":
|
|
creds = auth_mod._nous_device_code_login(
|
|
portal_base_url=getattr(args, "portal_url", None),
|
|
inference_base_url=getattr(args, "inference_url", None),
|
|
client_id=getattr(args, "client_id", None),
|
|
scope=getattr(args, "scope", None),
|
|
open_browser=not getattr(args, "no_browser", False),
|
|
timeout_seconds=getattr(args, "timeout", None) or 15.0,
|
|
insecure=bool(getattr(args, "insecure", False)),
|
|
ca_bundle=getattr(args, "ca_bundle", None),
|
|
min_key_ttl_seconds=max(60, int(getattr(args, "min_key_ttl_seconds", 5 * 60))),
|
|
)
|
|
label = (getattr(args, "label", None) or "").strip() or label_from_token(
|
|
creds.get("access_token", ""),
|
|
_oauth_default_label(provider, len(pool.entries()) + 1),
|
|
)
|
|
entry = PooledCredential.from_dict(provider, {
|
|
**creds,
|
|
"label": label,
|
|
"auth_type": AUTH_TYPE_OAUTH,
|
|
"source": f"{SOURCE_MANUAL}:device_code",
|
|
"base_url": creds.get("inference_base_url"),
|
|
})
|
|
pool.add_entry(entry)
|
|
print(f'Added {provider} OAuth credential #{len(pool.entries())}: "{entry.label}"')
|
|
return
|
|
|
|
if provider == "openai-codex":
|
|
creds = auth_mod._codex_device_code_login()
|
|
label = (getattr(args, "label", None) or "").strip() or label_from_token(
|
|
creds["tokens"]["access_token"],
|
|
_oauth_default_label(provider, len(pool.entries()) + 1),
|
|
)
|
|
entry = PooledCredential(
|
|
provider=provider,
|
|
id=uuid.uuid4().hex[:6],
|
|
label=label,
|
|
auth_type=AUTH_TYPE_OAUTH,
|
|
priority=0,
|
|
source=f"{SOURCE_MANUAL}:device_code",
|
|
access_token=creds["tokens"]["access_token"],
|
|
refresh_token=creds["tokens"].get("refresh_token"),
|
|
base_url=creds.get("base_url"),
|
|
last_refresh=creds.get("last_refresh"),
|
|
)
|
|
pool.add_entry(entry)
|
|
print(f'Added {provider} OAuth credential #{len(pool.entries())}: "{entry.label}"')
|
|
return
|
|
|
|
raise SystemExit(f"`hermes auth add {provider}` is not implemented for auth type {requested_type} yet.")
|
|
|
|
|
|
def auth_list_command(args) -> None:
|
|
provider_filter = _normalize_provider(getattr(args, "provider", "") or "")
|
|
if provider_filter:
|
|
providers = [provider_filter]
|
|
else:
|
|
providers = sorted({
|
|
*PROVIDER_REGISTRY.keys(),
|
|
"openrouter",
|
|
*list_custom_pool_providers(),
|
|
})
|
|
for provider in providers:
|
|
pool = load_pool(provider)
|
|
entries = pool.entries()
|
|
if not entries:
|
|
continue
|
|
current = pool.peek()
|
|
print(f"{provider} ({len(entries)} credentials):")
|
|
for idx, entry in enumerate(entries, start=1):
|
|
marker = " "
|
|
if current is not None and entry.id == current.id:
|
|
marker = "← "
|
|
status = _format_exhausted_status(entry)
|
|
source = _display_source(entry.source)
|
|
print(f" #{idx} {entry.label:<20} {entry.auth_type:<7} {source}{status} {marker}".rstrip())
|
|
print()
|
|
|
|
|
|
def auth_remove_command(args) -> None:
|
|
provider = _normalize_provider(getattr(args, "provider", ""))
|
|
index = int(getattr(args, "index"))
|
|
pool = load_pool(provider)
|
|
removed = pool.remove_index(index)
|
|
if removed is None:
|
|
raise SystemExit(f"No credential #{index} for provider {provider}.")
|
|
print(f"Removed {provider} credential #{index} ({removed.label})")
|
|
|
|
|
|
def auth_reset_command(args) -> None:
|
|
provider = _normalize_provider(getattr(args, "provider", ""))
|
|
pool = load_pool(provider)
|
|
count = pool.reset_statuses()
|
|
print(f"Reset status on {count} {provider} credentials")
|
|
|
|
|
|
def _interactive_auth() -> None:
|
|
"""Interactive credential pool management when `hermes auth` is called bare."""
|
|
# Show current pool status first
|
|
print("Credential Pool Status")
|
|
print("=" * 50)
|
|
|
|
auth_list_command(SimpleNamespace(provider=None))
|
|
print()
|
|
|
|
# Main menu
|
|
choices = [
|
|
"Add a credential",
|
|
"Remove a credential",
|
|
"Reset cooldowns for a provider",
|
|
"Set rotation strategy for a provider",
|
|
"Exit",
|
|
]
|
|
print("What would you like to do?")
|
|
for i, choice in enumerate(choices, 1):
|
|
print(f" {i}. {choice}")
|
|
|
|
try:
|
|
raw = input("\nChoice: ").strip()
|
|
except (EOFError, KeyboardInterrupt):
|
|
return
|
|
|
|
if not raw or raw == str(len(choices)):
|
|
return
|
|
|
|
if raw == "1":
|
|
_interactive_add()
|
|
elif raw == "2":
|
|
_interactive_remove()
|
|
elif raw == "3":
|
|
_interactive_reset()
|
|
elif raw == "4":
|
|
_interactive_strategy()
|
|
|
|
|
|
def _pick_provider(prompt: str = "Provider") -> str:
|
|
"""Prompt for a provider name with auto-complete hints."""
|
|
known = sorted(set(list(PROVIDER_REGISTRY.keys()) + ["openrouter"]))
|
|
custom_names = _get_custom_provider_names()
|
|
if custom_names:
|
|
custom_display = [name for name, _key in custom_names]
|
|
print(f"\nKnown providers: {', '.join(known)}")
|
|
print(f"Custom endpoints: {', '.join(custom_display)}")
|
|
else:
|
|
print(f"\nKnown providers: {', '.join(known)}")
|
|
try:
|
|
raw = input(f"{prompt}: ").strip()
|
|
except (EOFError, KeyboardInterrupt):
|
|
raise SystemExit()
|
|
return _normalize_provider(raw)
|
|
|
|
|
|
def _interactive_add() -> None:
|
|
provider = _pick_provider("Provider to add credential for")
|
|
if provider not in PROVIDER_REGISTRY and provider != "openrouter" and not provider.startswith(CUSTOM_POOL_PREFIX):
|
|
raise SystemExit(f"Unknown provider: {provider}")
|
|
|
|
# For OAuth-capable providers, ask which type
|
|
if provider in _OAUTH_CAPABLE_PROVIDERS:
|
|
print(f"\n{provider} supports both API keys and OAuth login.")
|
|
print(" 1. API key (paste a key from the provider dashboard)")
|
|
print(" 2. OAuth login (authenticate via browser)")
|
|
try:
|
|
type_choice = input("Type [1/2]: ").strip()
|
|
except (EOFError, KeyboardInterrupt):
|
|
return
|
|
if type_choice == "2":
|
|
auth_type = "oauth"
|
|
else:
|
|
auth_type = "api_key"
|
|
else:
|
|
auth_type = "api_key"
|
|
|
|
auth_add_command(SimpleNamespace(
|
|
provider=provider, auth_type=auth_type, label=None, api_key=None,
|
|
portal_url=None, inference_url=None, client_id=None, scope=None,
|
|
no_browser=False, timeout=None, insecure=False, ca_bundle=None,
|
|
))
|
|
|
|
|
|
def _interactive_remove() -> None:
|
|
provider = _pick_provider("Provider to remove credential from")
|
|
pool = load_pool(provider)
|
|
if not pool.has_credentials():
|
|
print(f"No credentials for {provider}.")
|
|
return
|
|
|
|
# Show entries with indices
|
|
for i, e in enumerate(pool.entries(), 1):
|
|
exhausted = _format_exhausted_status(e)
|
|
print(f" #{i} {e.label:25s} {e.auth_type:10s} {e.source}{exhausted}")
|
|
|
|
try:
|
|
raw = input("Remove # (or blank to cancel): ").strip()
|
|
except (EOFError, KeyboardInterrupt):
|
|
return
|
|
if not raw:
|
|
return
|
|
|
|
try:
|
|
index = int(raw)
|
|
except ValueError:
|
|
print("Invalid number.")
|
|
return
|
|
|
|
auth_remove_command(SimpleNamespace(provider=provider, index=index))
|
|
|
|
|
|
def _interactive_reset() -> None:
|
|
provider = _pick_provider("Provider to reset cooldowns for")
|
|
|
|
auth_reset_command(SimpleNamespace(provider=provider))
|
|
|
|
|
|
def _interactive_strategy() -> None:
|
|
provider = _pick_provider("Provider to set strategy for")
|
|
current = get_pool_strategy(provider)
|
|
strategies = [STRATEGY_FILL_FIRST, STRATEGY_ROUND_ROBIN, STRATEGY_LEAST_USED, STRATEGY_RANDOM]
|
|
|
|
print(f"\nCurrent strategy for {provider}: {current}")
|
|
print()
|
|
descriptions = {
|
|
STRATEGY_FILL_FIRST: "Use first key until exhausted, then next",
|
|
STRATEGY_ROUND_ROBIN: "Cycle through keys evenly",
|
|
STRATEGY_LEAST_USED: "Always pick the least-used key",
|
|
STRATEGY_RANDOM: "Random selection",
|
|
}
|
|
for i, s in enumerate(strategies, 1):
|
|
marker = " ←" if s == current else ""
|
|
print(f" {i}. {s:15s} — {descriptions.get(s, '')}{marker}")
|
|
|
|
try:
|
|
raw = input("\nStrategy [1-4]: ").strip()
|
|
except (EOFError, KeyboardInterrupt):
|
|
return
|
|
if not raw:
|
|
return
|
|
|
|
try:
|
|
idx = int(raw) - 1
|
|
strategy = strategies[idx]
|
|
except (ValueError, IndexError):
|
|
print("Invalid choice.")
|
|
return
|
|
|
|
from hermes_cli.config import load_config, save_config
|
|
cfg = load_config()
|
|
pool_strategies = cfg.get("credential_pool_strategies") or {}
|
|
if not isinstance(pool_strategies, dict):
|
|
pool_strategies = {}
|
|
pool_strategies[provider] = strategy
|
|
cfg["credential_pool_strategies"] = pool_strategies
|
|
save_config(cfg)
|
|
print(f"Set {provider} strategy to: {strategy}")
|
|
|
|
|
|
def auth_command(args) -> None:
|
|
action = getattr(args, "auth_action", "")
|
|
if action == "add":
|
|
auth_add_command(args)
|
|
return
|
|
if action == "list":
|
|
auth_list_command(args)
|
|
return
|
|
if action == "remove":
|
|
auth_remove_command(args)
|
|
return
|
|
if action == "reset":
|
|
auth_reset_command(args)
|
|
return
|
|
# No subcommand — launch interactive mode
|
|
_interactive_auth()
|