2,226 tools found
Configure a Mac mini as a reliable local LLM server with remote access, observability, and power-safe operation. Use when building an always-on private AI inference server on Apple Silicon.
Curated upstream guidance for Longbridge Research; use when the workflow matches the user goal.
Curated upstream guidance for Longbridge Quant; use when the workflow matches the user goal.
Curated upstream guidance for Longbridge Derivatives; use when the workflow matches the user goal.
Configure Grafana Loki for log aggregation and analysis.
Configure load balancers and traffic distribution. Implement health checks and SSL termination. Use when distributing traffic across servers.
Build production LLMOps platforms with CI/CD, model promotion workflows, evaluation gates, rollback, and governance across cloud and self-hosted inference.
Auto-scale LLM inference clusters on Kubernetes using KEDA, custom GPU metrics, and horizontal pod autoscaling.
Deploy an API gateway for LLM traffic with load balancing, rate limiting, key management, semantic caching, fallback routing, and cost tracking.
Set up infrastructure for fine-tuning LLMs with QLoRA, LoRA, and full fine-tuning using Hugging Face TRL, Axolotl, and distributed training with DeepSpeed or FSDP.
Implement multi-layer LLM caching with exact match, semantic similarity, and provider-side prompt caching.
Secure LLM-powered applications with input validation, output controls, tenant isolation, and abuse prevention.
