+ ~j1*f^RIHt^RIt^RIt^RIt^RIHt^RIHt^RIH t H t H t ^RI H t Ht^RIHt^RIHtHtHtHt^R IHt^R IHtHtHt^R IHtHt]!^]P>R 7t ]!R R44t!]!RR44t"!RR]] R,,4t#!RR]4t$R#)) annotationsN) AsyncIterable) dataclass)AnyClassVarLiteral)APIConnectionErrorAPIError)logger)DEFAULT_API_CONNECT_OPTIONS NOT_GIVENAPIConnectOptions NotGivenOr) ChatContext)LLM ChatChunk LLMStream)Tool ToolChoice) max_retrytimeoutc,]tRt^t$R]R&R]R&RtR#) _LLMStatusbool availablezasyncio.Task[None] | Nonerecovering_taskN__name__ __module__ __qualname____firstlineno____annotations____static_attributes__rx/Users/mitch_tango/dev/rabbit-r1-livekit/agent/.venv/lib/python3.14/site-packages/livekit/agents/llm/fallback_adapter.pyrrs O..r%rc,]tRt^t$R]R&R]R&RtR#)AvailabilityChangedEventrllmrrrNrrr%r&r(r(s HOr%r(c a]tRt^"tRtRRR^RRRR/R V3R lllt]R R l4t]R Rl4tRRR] R] R] R] /RRllt RRlt RRlt RtV;t#)FallbackAdapterzxAgent Fallback Adapter for LLM. Manages multiple STT instances with automatic fallback when the primary provider fails. attempt_timeoutg@max_retry_per_llmretry_intervalg?retry_on_chunk_sentFc 0V^8dQhRRRRRRRRRR R R /#) r)z list[LLM]r,floatr-intr.r/rreturnNoner)formats"r& __annotate__FallbackAdapter.__annotate__)sN(M(M (M (M  (M(M"(M (Mr%c V<\V4^8d \R4h\SV` 4WnW nW0nW@nWPnVPUu.uFp\RRR7NK upVn VPFpVPRVP4K! R#uupi)aFallbackAdapter is an LLM that can fallback to a different LLM if the current LLM fails. Args: llm (list[LLM]): List of LLM instances to fallback to. attempt_timeout (float, optional): Timeout for each LLM attempt. Defaults to 5.0. max_retry_per_llm (int, optional): Internal retries per LLM. Defaults to 0, which means no internal retries, the failed LLM will be skipped and the next LLM will be used. retry_interval (float, optional): Interval between retries. Defaults to 0.5. retry_on_chunk_sent (bool, optional): Whether to retry when a LLM failed after chunks are sent. Defaults to False. Raises: ValueError: If no LLM instances are provided. z+at least one LLM instance must be provided.TN)rrmetrics_collected) len ValueErrorsuper__init___llm_instances_attempt_timeout_max_retry_per_llm_retry_interval_retry_on_chunk_sentr_statuson_on_metrics_collected) selfr)r,r-r.r/_ llm_instance __class__s &&$$$$ r&r>FallbackAdapter.__init__)s0 s8a<JK K ! /"3-$7!GKFYFY FYJt propertyrQrV$DEFAULT_FALLBACK_API_CONNECT_OPTIONSr rdrkrFr$ __classcell__rJs@r&r+r+"s(M"% (M "# (M!$(M%*(M(MT!! $(  +O  1:  /8 4= (N88r%r+llm_availability_changedca]tRt^wt$RtR]R&R]R]R]/RV3Rlllt]R R l4t ]R R l4t R R/RRllt RRlt RRlt RRltRtV;t#)rcllm_fallback_adapterz ClassVar[str]_llm_request_span_namerZr[r\c8V^8dQhRRRRRRRRR R R R R RRR/#)r1r)r+r^rrX list[Tool]rYrrZr_r[r`r\rar4r5r)r6s"r&r7FallbackLLMStream.__annotate__zsZ66 6 6  6 ( 6.6,616 6r%c h<\SV`WW4R7WnWPnW`nWpnRVnR#))r^rXrYN)r=r>_fallback_adapter_parallel_tool_calls _tool_choice _extra_kwargs_current_stream) rGr)r^rXrYrZr[r\rJs &&$$$$$$r&r>FallbackLLMStream.__init__zs7 uX!$$7!')15r%cV^8dQhRR/#)r1r4rr)r6s"r&r7r~s--+-r%c bVPf VP#VPP#N)r _chat_ctxr^rPs&r&r^FallbackLLMStream.chat_ctxs*    '>> !##,,,r%cV^8dQhRR/#)r1r4r}r)r6s"r&r7r~s**z*r%c bVPf VP#VPP#r)r_toolsrXrPs&r&rXFallbackLLMStream.toolss*    ';; ##)))r%check_recoveryFc$V^8dQhRRRRRR/#)r1r)rrrr4AsyncIterable[ChatChunk]r)r6s"r&r7r~s)BBB+/B !Br%c "VPVPVPVPVPVP \ P!VPVPPVPPVPPR7R7;_uu_4GRjxL pV'*pVRjxL pV'd RpW0n V5xK!L.LDRRR4GRjxL R# +GRjxL 'giR#;i \PdRT'd%\ P"!TP$ R24h\ P"!TP$ R24h\&dZpT'd'\ P"!TP$ R2TR7h\ P"!TP$ R 2TR7hRp?i\(dRT'd%\ P*!TP$ R 24h\ P*!TP$ R 24hi;i5i) a7 Try to generate with the given LLM. Args: llm: The LLM instance to generate with check_recovery: When True, indicates this is a background recovery check and the result will not be used. Recovery checks verify if a previously failed LLM has become available again. )rrr.)r^rXrZr[r\rYNFz recovery timed outz! timed out, switching to next LLMz recovery failed)exc_infoz failed, switching to next LLMz recovery unexpected errorz( unexpected error, switching to next LLM)rdrrrrr dataclassesreplace _conn_optionsrrAr@rBrasyncio TimeoutErrorr warninglabelr Exception exception)rGr)rstreamshould_set_currentchunkes&$$ r& _try_generateFallbackLLMStream._try_generates6 xxkk$($=$= --!//(00&&"44GG 22CC#'#9#9#I#I     )7%7"#)  %)-2*/5,K%  6      (## #)),?@A NN99+>?   yyk!12 NN99+;<     yyk!;<   99+EF   sIB3D7C&8D; C>C* C( C* C>&D(C**C>+ D6C97D<I>D D D D DIDH=8AH= H= AG H=+H=4A H==Ic V^8dQhRRRR/#r1r)rr4r5r)r6s"r&r7r~sUUUUr%c @aaSPPSPPPV4,oSPe!SPP 4'd.RVV3Rllp\ P!V!V44SnR#R#)Nc V^8dQhRRRR/#rr)r6s"r&r75FallbackLLMStream._try_recovery..__annotate__s  S T r%c<"SPVRR7RjxL pK LDRSn\P!RTP R24SP P R\TRR74R# \dR#i;i5i)Tr)rNzllm.FallbackAdapter, z recoveredrxr)r) rrr inforrrqr(r)r)rH llm_statusrGs& r&_recover_llm_task:FallbackLLMStream._try_recovery.._recover_llm_tasks #'#5#5#d#5#Sa#S,0J(KK"7 {* MN**//20SDI!sCB A;&$&A;&AA;9B ; B B  B  B )rrDr?indexrdoner create_task)rGr)rrsf& @r& _try_recoveryFallbackLLMStream._try_recoverys++33  " " 1 1 7 7 <   % % -1K1K1P1P1R1R  *1)<)<=Ns=S)TJ &!2Sr%cV^8dQhRR/#rgr)r6s"r&r7r~s2 2 D2 r%c "\P!4p\;QJd0RVPP4F 'dK RM% RM!!RVPP44pV'd\P !R4\ VPP4EFwr4VPPV,pVP'g V'dRp.pVPVRR7RjxL pVP'dqVPP'dWhPP, pVPPFp VPV P4K VPP!V4KVP/V4EK \1RVPPUu.uFqDP*NK up R\P!4V, R24hELEDR# \"dTP'd/RTnTPP%R\'TRR74T'g T'dnR TR T/p TPP('g'\P !TP* R 2T R 7h\P,!TP* R 2T R 7ELBi;iuupi5i)c3B"TFqP'*xK R#5ir)r).0rs& r& )FallbackLLMStream._run..scDbj1111DbsFTz$all LLMs are unavailable, retrying..rNrxr text_senttool_calls_sentzy failed after sending chunk, skip retrying. Set `retry_on_chunk_sent` to `True` to enable retrying after chunks are sent.)extraz' failed after sending chunk, retrying..zall LLMs failed (z) after z seconds)timeallrrDr error enumerater?rrdeltacontent tool_callsappendname _event_ch send_nowaitrrqr(rCrrrr ) rG start_time all_failedir)rrrresult tool_callrs & r&_runFallbackLLMStream._runscYY[ ScDDZDZDbDbcSSScDDZDZDbDbcc  LL? @ 6 6 E EFFA//77:J###z!# -/ (,(:(:sSX(:(Y;;f!<<<%||333 )\\-A-A A -3\\-D-D / 6 6y~~ F.E226:4   s #OGR!d6L6L6[6[ \6[s6[ \]]efjfofofqt~f~e@H I  G;(Y !+++/4 ,..3364N !O!,i9JO \#55JJJ"LL#&99+.p!p&+ ""yyk)PQ"'%4!]sAK: 0K:A1H&/4K:#K5 7'K:H!!H&#K:&K25K29K2!K2#A K2.K:1K22K:c V^8dQhRRRR/#)r1 event_aiterrr4r5r)r6s"r&r7r~'s7OTXr%c "R#5irr)rGrs&&r&_metrics_monitor_task'FallbackLLMStream._metrics_monitor_task'ss)rrrrr)rr r!r"r{r#r r>rtr^rXrrrrr$rvrws@r&rcrcws,BMB61:6/864=66&-- ** B27BHU,2 hr%rc)% __future__rrrrcollections.abcrrtypingrrr _exceptionsr r logr typesr r rr chat_contextrr)rrr tool_contextrrrrurr(r+rcrr%r&rs" )!))6YY%***'84<<($  // /    R8*+,R8jq qr%