+ ~jf^RIHt^RIHt^RIHt^RIt^RIHt^RI H t H t H t H t HtHtHt^RIHtHtHt^RIHt^R IHtHt^R IHtHt^R IHtHtH t H!t!H"t"H#t#^R I$H%t%H&t&^R I'H(t(H)t)^RI*H+t+H,t,^RI-H.t.^RI/H0t0^RI1H2t2^RI3H4t4^RI5H6t6^RI7H8t8RR.t9!RR]4t:!RR]4t;!RR4t<!RR4t=!RR4t>!RR 4t?R#)!) annotations)Optional)LiteralN)_legacy_response)BodyOmitQueryHeadersNotGivenomit not_given) path_templatemaybe_transformasync_maybe_transform)cached_property)SyncAPIResourceAsyncAPIResource)to_streamed_response_wrapper"async_to_streamed_response_wrapper) OutputItemsAsyncOutputItemsOutputItemsWithRawResponseAsyncOutputItemsWithRawResponse OutputItemsWithStreamingResponse%AsyncOutputItemsWithStreamingResponse)SyncCursorPageAsyncCursorPage)run_list_paramsrun_create_params)AsyncPaginatormake_request_options)Metadata)RunListResponse)RunCancelResponse)RunCreateResponse)RunDeleteResponse)RunRetrieveResponseRuns AsyncRunsc]tRt^%tRt]RRl4t]RRl4t]RRl4tR] R ] R R R R R R R] /RRllt R R R R R R R] /RRllt R] R] R] R] R R R R R R R] /RRllt R R R R R R R] /RRlltR R R R R R R] /RRlltRtR #)r(,Manage and run evals in the OpenAI platform.cV^8dQhRR/#)returnr)formats"u/Users/mitch_tango/dev/rabbit-r1-livekit/agent/.venv/lib/python3.14/site-packages/openai/resources/evals/runs/runs.py __annotate__Runs.__annotate__)s))k)c ,\VP4#r+)r_clientselfs&r1 output_itemsRuns.output_items(s4<<((r4cV^8dQhRR/#)r-r.RunsWithRawResponser/)r0s"r1r2r3.s))#6)r4c \V4#z This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content. For more information, see https://www.github.com/openai/openai-python#accessing-raw-response-data-eg-headers )r=r8s&r1with_raw_responseRuns.with_raw_response-s#4((r4cV^8dQhRR/#)r-r.RunsWithStreamingResponser/)r0s"r1r2r38s//)B/r4c \V4#z An alternative to `.with_raw_response` that doesn't eagerly read the response body. For more information, see https://www.github.com/openai/openai-python#with_streaming_response )rCr8s&r1with_streaming_responseRuns.with_streaming_response7s)..r4metadataname extra_headersN extra_query extra_bodytimeoutc<V^8dQhRRRRRRRRR R R R R RRRRR/ #r-eval_idstr data_sourcezrun_create_params.DataSourcerHzOptional[Metadata] | OmitrI str | OmitrJHeaders | NonerK Query | NonerL Body | NonerM'float | httpx.Timeout | None | NotGivenr.r%r/)r0s"r1r2r3@d; ; ; 2 ; , ;  ; &; ";  ; 9;  ; r4c  V'g\RV: 24hVP\RVR7\RVRVRV/\P 4\ VVVVRR/R 7\R 7#)  Kicks off a new run for a given evaluation, specifying the data source, and what model configuration to use to test. The datasource will be validated against the schema specified in the config of the evaluation. Args: data_source: Details about the run's data source. metadata: Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters. name: The name of the run. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds 6Expected a non-empty value for `eval_id` but received /evals/{eval_id}/runsrPrRrHrI bearer_authTrJrKrLrMsecuritybodyoptionscast_to) ValueError_postrrrRunCreateParamsr!r% r9rPrRrHrIrJrKrLrMs &&$$$$$$$r1create Runs.create@sNUV]U`ab bzz 17 C !;D "11 )+'%'. &#  r4c4V^8dQhRRRRRRRRRR R R R R /#r-run_idrQrPrJrTrKrUrLrVrMrWr.r'r/)r0s"r1r2r3}P& & &  & && "&  & 9&  & r4c  V'g\RV: 24hV'g\RV: 24hVP\RW!R7\VVVVRR/R7\R7#)  Get an evaluation run by ID. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds r[5Expected a non-empty value for `run_id` but received /evals/{eval_id}/runs/{run_id}rPrmr^Tr_rcrdre_getrr!r'r9rmrPrJrKrLrMs&&$$$$$r1retrieve Runs.retrieve}sv0UV]U`ab bTU[T^_` `yy :G [(+'%'. (  r4afterlimitorderstatusc@V^8dQhRRRRRRRRR R R R R RRRRRRR/ #)r-rPrQrzrSr{ int | Omitr|Literal['asc', 'desc'] | Omitr}JLiteral['queued', 'in_progress', 'completed', 'canceled', 'failed'] | OmitrJrTrKrUrLrVrMrWr.zSyncCursorPage[RunListResponse]r/)r0s"r1r2r3so; ; ;  ;  ; - ; [; &; ";  ; 9;  ); r4c V'g\RV: 24hVP\RVR7\\,\ VVVV \ RVRVRVRV/\P4RR /R 7\R 7# a Get a list of runs for an evaluation. Args: after: Identifier for the last run from the previous pagination request. limit: Number of runs to retrieve. order: Sort order for runs by timestamp. Use `asc` for ascending order or `desc` for descending order. Defaults to `asc`. status: Filter runs by status. One of `queued` | `in_progress` | `failed` | `completed` | `canceled`. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds r[r\r]rzr{r|r}r^T)rJrKrLrMqueryr`)pagercmodel) re _get_api_listrrr#r!rr RunListParams r9rPrzr{r|r}rJrKrLrMs &&$$$$$$$$r1list Runs.listsJUV]U`ab b!! 17 C0(+'%% &  $11(. "'"  r4c4V^8dQhRRRRRRRRRR R R R R /#r-rmrQrPrJrTrKrUrLrVrMrWr.r&r/)r0s"r1r2r3P& & &  & && "&  & 9&  & r4c  V'g\RV: 24hV'g\RV: 24hVP\RW!R7\VVVVRR/R7\R7#)  Delete an eval run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds r[rqrrrsr^Tr_rtre_deleterr!r&rws&&$$$$$r1delete Runs.deletesv0UV]U`ab bTU[T^_` `|| :G [(+'%'. &  r4c4V^8dQhRRRRRRRRRR R R R R /#r-rmrQrPrJrTrKrUrLrVrMrWr.r$r/)r0s"r1r2r3 rr4c  V'g\RV: 24hV'g\RV: 24hVP\RW!R7\VVVVRR/R7\R7#)  Cancel an ongoing evaluation run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds r[rqrrrsr^Tr_rtrerfrr!r$rws&&$$$$$r1cancel Runs.cancel sv0UV]U`ab bTU[T^_` `zz :G [(+'%'. &  r4r/__name__ __module__ __qualname____firstlineno____doc__rr:r@rFr r rirxrrr__static_attributes__r/r4r1r(r(%sl6))))//; /3 ;  ; )-; %); #'; 8B>Bc4V^8dQhRRRRRRRRRR R R R R /#rlr/)r0s"r1r2rrnr4c "V'g\RV: 24hV'g\RV: 24hVP\RW!R7\VVVVRR/R7\R7GR jxL #L5i) rpr[rqrrrsr^Tr_rtNrurws&&$$$$$r1rxAsyncRuns.retrieves0UV]U`ab bTU[T^_` `YY :G [(+'%'. (    A.AA.'A,(A.rzr{r|r}c@V^8dQhRRRRRRRRR R R R R RRRRRRR/ #)r-rPrQrzrSr{rr|rr}rrJrTrKrUrLrVrMrWr.zAAsyncPaginator[RunListResponse, AsyncCursorPage[RunListResponse]]r/)r0s"r1r2rsp; ; ;  ;  ; - ; [; &; ";  ; 9;  K; r4c V'g\RV: 24hVP\RVR7\\,\ VVVV \ RVRVRVRV/\P4RR /R 7\R 7#r) rerrrr#r!rrrrs &&$$$$$$$$r1rAsyncRuns.listsJUV]U`ab b!! 17 C 1(+'%% &  $11(. "'"  r4c4V^8dQhRRRRRRRRRR R R R R /#rr/)r0s"r1r2rrr4c "V'g\RV: 24hV'g\RV: 24hVP\RW!R7\VVVVRR/R7\R7GR jxL #L5i) rr[rqrrrsr^Tr_rtNrrws&&$$$$$r1rAsyncRuns.deletes0UV]U`ab bTU[T^_` `\\ :G [(+'%'. &"    rc4V^8dQhRRRRRRRRRR R R R R /#rr/)r0s"r1r2rrr4c "V'g\RV: 24hV'g\RV: 24hVP\RW!R7\VVVVRR/R7\R7GR jxL #L5i) rr[rqrrrsr^Tr_rtNrrws&&$$$$$r1rAsyncRuns.cancels0UV]U`ab bTU[T^_` `ZZ :G [(+'%'. &    rr/rr/r4r1r)r)3sl6....44; /3 ;  ; )-; %); #'; > KK  )@@ MM  %<< II  '>> KK  '>> KK  r4cV^8dQhRR/#)r-r.rr/)r0s"r1r2rVsCC8Cr4c @\VPP4#r6)rrr:r8s&r1r: RunsWithRawResponse.output_itemsUs*$***A*ABBr4rrrirrrxNrrrrrrr:rr/r4r1r=r=As &CCr4r=c8]tRtRtRRlt]RRl4tRtR#)ri[c V^8dQhRRRR/#r-rr)r.rr/)r0s"r1r2%AsyncRunsWithRawResponse.__annotate__\  Y 4 r4c Wn\P!VP4Vn\P!VP4Vn\P!VP 4Vn\P!VP 4Vn\P!VP4VnR#r)rrasync_to_raw_response_wrapperrirxrrrrs&&r1r!AsyncRunsWithRawResponse.__init__\s &DD KK  )FF MM  %BB II  'DD KK  'DD KK  r4cV^8dQhRR/#)r-r.rr/)r0s"r1r2rpsHH=Hr4c @\VPP4#r6)rrr:r8s&r1r:%AsyncRunsWithRawResponse.output_itemsos/tzz/F/FGGr4rNrr/r4r1rr[s &HHr4rc8]tRtRtRRlt]RRl4tRtR#)rCiuc V^8dQhRRRR/#rr/)r0s"r1r2&RunsWithStreamingResponse.__annotate__vrr4c Wn\VP4Vn\VP4Vn\VP4Vn\VP 4Vn\VP 4VnR#r)rrrirxrrrrs&&r1r"RunsWithStreamingResponse.__init__vsn 2 KK  5 MM  1 II  3 KK  3 KK  r4cV^8dQhRR/#)r-r.rr/)r0s"r1r2rsII>Ir4c @\VPP4#r6)rrr:r8s&r1r:&RunsWithStreamingResponse.output_itemss0 0G0GHHr4rNrr/r4r1rCrCus &IIr4rCc8]tRtRtRRlt]RRl4tRtR#)ric V^8dQhRRRR/#rr/)r0s"r1r2+AsyncRunsWithStreamingResponse.__annotate__rr4c Wn\VP4Vn\VP4Vn\VP4Vn\VP 4Vn\VP 4VnR#r)rrrirxrrrrs&&r1r'AsyncRunsWithStreamingResponse.__init__sn 8 KK  ; MM  7 II  9 KK  9 KK  r4cV^8dQhRR/#)r-r.rr/)r0s"r1r2rsNNCNr4c @\VPP4#r6)rrr:r8s&r1r:+AsyncRunsWithStreamingResponse.output_itemss5TZZ5L5LMMr4rNrr/r4r1rrs &NNr4r)@ __future__rtypingrtyping_extensionsrhttpxr_typesrrr r r r r _utilsrrr_compatr _resourcerr _responserrr:rrrrrr paginationrr types.evalsrr _base_clientr r!types.shared_params.metadatar"types.evals.run_list_responser#types.evals.run_cancel_responser$types.evals.run_create_responser%types.evals.run_delete_responser&!types.evals.run_retrieve_responser'__all__r(r)r=rrCrr/r4r1rs#% !LLLLL';Z;>A5=AAAE ; K ?K \K  K \CC4HH4II4NNr4