Files

 main

/

cookbook

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

ishaan-jaff

(cookbook) load test litellm router

Feb 8, 2024

c59021d · Feb 8, 2024

History

History

This branch is 14494 commits behind BerriAI/litellm:main.

/

cookbook

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
benchmark		benchmark
codellama-server		codellama-server
community-resources		community-resources
litellm-ollama-docker-image		litellm-ollama-docker-image
litellm_router		litellm_router
litellm_router_load_test		litellm_router_load_test
logging_observability		logging_observability
misc		misc
proxy-server		proxy-server
Benchmarking_LLMs_by_use_case.ipynb		Benchmarking_LLMs_by_use_case.ipynb
Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb		Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb
Evaluating_LLMs.ipynb		Evaluating_LLMs.ipynb
LiteLLM_Azure_and_OpenAI_example.ipynb		LiteLLM_Azure_and_OpenAI_example.ipynb
LiteLLM_Bedrock.ipynb		LiteLLM_Bedrock.ipynb
LiteLLM_Comparing_LLMs.ipynb		LiteLLM_Comparing_LLMs.ipynb
LiteLLM_Completion_Cost.ipynb		LiteLLM_Completion_Cost.ipynb
LiteLLM_HuggingFace.ipynb		LiteLLM_HuggingFace.ipynb
LiteLLM_OpenRouter.ipynb		LiteLLM_OpenRouter.ipynb
LiteLLM_Petals.ipynb		LiteLLM_Petals.ipynb
LiteLLM_PromptLayer.ipynb		LiteLLM_PromptLayer.ipynb
LiteLLM_User_Based_Rate_Limits.ipynb		LiteLLM_User_Based_Rate_Limits.ipynb
LiteLLM_batch_completion.ipynb		LiteLLM_batch_completion.ipynb
Parallel_function_calling.ipynb		Parallel_function_calling.ipynb
TogetherAI_liteLLM.ipynb		TogetherAI_liteLLM.ipynb
Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb		Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb
VLLM_Model_Testing.ipynb		VLLM_Model_Testing.ipynb
liteLLM_A121_Jurrasic_example.ipynb		liteLLM_A121_Jurrasic_example.ipynb
liteLLM_Baseten.ipynb		liteLLM_Baseten.ipynb
liteLLM_Getting_Started.ipynb		liteLLM_Getting_Started.ipynb
liteLLM_Langchain_Demo.ipynb		liteLLM_Langchain_Demo.ipynb
liteLLM_Ollama.ipynb		liteLLM_Ollama.ipynb
liteLLM_Replicate_Demo.ipynb		liteLLM_Replicate_Demo.ipynb
liteLLM_Streaming_Demo.ipynb		liteLLM_Streaming_Demo.ipynb
liteLLM_VertextAI_Example.ipynb		liteLLM_VertextAI_Example.ipynb
liteLLM_function_calling.ipynb		liteLLM_function_calling.ipynb
litellm_Test_Multiple_Providers.ipynb		litellm_Test_Multiple_Providers.ipynb
litellm_model_fallback.ipynb		litellm_model_fallback.ipynb
litellm_test_multiple_llm_demo.ipynb		litellm_test_multiple_llm_demo.ipynb
result.html		result.html
View all files