cloud.killer social

#llm

In the cloud.killer community.

Members can post here. Sign in with pit.world: the one account for every *.pit.world site.

@denezhelev.bsky.social network
Moravec announced the news of the human brain’s upcoming demotion in his book Mind Children, published in 1988. Though it was published by Harvard University Press and reviewed well in The New Yorker, hardly anybody took Mind Children that seriously - nymag.com/intelligence... #llm #ai #tech
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/prompt-caching-cost-calculator-anthropic-vs-openai-deepseek.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app · a reply
@tokenmargin.dev network
Prompt Caching Cost Calculator: Anthropic vs OpenAI vs DeepSeek

Calculate exact monthly API savings from 50%–90% prompt cache hit rates across Claude 3.7 Sonnet (90% read discount), GPT-4.1/4o (75% discount), and DeepSeek V3 ($0.07/1M cached reads). 🧵👇

#AI #LLM #DevTools #SaaS #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@trynoguard.bsky.social network
Most AI models trade safety filters for utility. We don't. From reverse-engineering binary to unfiltered adult creative writing, see where Aether beats ChatGPT and where it doesn't. The honest breakdown on capacity vs. capability.

#LLM #AI

https://aethersky.ai/learn/chatgpt-vs-aether
1 image (open on the network to see)
From the AT Protocol network, via jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network, atproto.africa · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/litellm-supply-chain-compromise-alternative-zero-dependency-llm-router.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app · a reply
@modelindex.ai network
🆕 River is now on ModelIndex: 4 models, from $0.12/MTok input. Compare every provider, price & measured speed. #LLM #AI
From the AT Protocol network, via jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network, atproto.africa · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/qwen-qwq-32b-coder-cloud-pricing-cheapest-gpu-api-providers.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network, atproto.africa · view on bsky.app · a reply
@tokenmargin.dev network
Qwen QwQ-32B & Qwen 2.5 Coder 32B Cloud Pricing & Cheapest Providers

Compare cloud pricing and cheapest serverless GPU providers for Qwen QwQ-32B (Reasoning) and Qwen 2.5 Coder 32B Instruct across DeepInfra, Fireworks AI, Groq, OpenRouter, and self-hosted RunPod vLLM. 🧵👇

#AI #LLM #DevTools #S...
From the AT Protocol network, via jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network, atproto.africa · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/self-hosted-gpu-vllm-vs-serverless-api-break-even-calculator.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network, atproto.africa · view on bsky.app · a reply
@aipulse-synestesia.bsky.social network
🤖 Meta's Muse Ember model leads in AI efficiency

The announcement is framed around routine work: calling tools, coding small tasks, routing requests, extracting data from long documents. The number is a score of 36 on the Artificial Analysis...

#MetaAI #EnterpriseAI #LLM #AI #AIPulse
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/cursor-windsurf-cline-api-key-cost-calculator-byok-routing.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app · a reply
@tokenmargin.dev network
Cursor, Windsurf & Cline BYOK API Key Cost Calculator: Claude 3.7 Sonnet vs DeepSeek V3

How to stop $50/day Cline and Roo Code API bills by enabling 90% Anthropic prompt caching and routing planning/search steps to DeepSeek V3 ($0.24/1M) or Qwen 2.5 Coder 32B ($0.07/1M). 🧵👇

#AI #LLM #DevTools...
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/zero-dependency-llm-router-vs-litellm-openrouter-fallback.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app · a reply
@tokenmargin.dev network
Zero-Dependency SDK Fallback Routing vs LiteLLM & OpenRouter JSON

How to eliminate supply-chain risk and cut blended LLM API bills by 68% using native OpenRouter provider routing JSON or zero-dependency TypeScript/Python fallback wrappers. 🧵👇

#AI #LLM #DevTools #SaaS #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/multi-turn-agent-loop-token-bloat-cost-calculator.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream1.us-west.bsky.network, jetstream2.us-east.bsky.network · view on bsky.app · a reply
@tokenmargin.dev network
Autonomous AI Agent Loop Cost Calculator: Modeling 10–30 Turn Context Bloat

Why a 15-turn coding or browser agent consumes 12x more input tokens than a single-turn chat—and how rolling context truncation + prompt caching cuts agent loop bills by 78%. 🧵👇

#AI #LLM #DevTools #SaaS #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/openrouter-vs-deepinfra-vs-fireworks-ai-serverless-gpu-pricing-2026.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app · a reply
@tokenmargin.dev network
OpenRouter vs DeepInfra vs Fireworks AI vs Together AI: 2026 Serverless LLM Pricing Audit

Side-by-side price per 1M tokens, throughput speed (tok/s), and Zero Data Retention (ZDR) comparison across OpenRouter, DeepInfra, Fireworks AI, Together AI, Groq, and RunPod. 🧵👇

#AI #LLM #DevTools #SaaS...
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@programmerhumor-io.bsky.social network
Deep Seeking Gone Wrong

#programming #machinelearning #Ai #Deepseek #Llm

https://programmerhumor.io/ai-memes/deep-seeking-gone-wrong-m66y
1 image (open on the network to see)
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/ai-saas-gross-margin-calculator-per-seat-pricing-stress-test.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app · a reply
@tokenmargin.dev network
AI SaaS Gross Margin Calculator: Stress-Testing $20/mo Seat Pricing Against Power Users

Model how P95 power users (4.5x average token consumption) and multi-turn context bloat erode AI SaaS gross margins—and how hybrid routing restores 80%+ software margins. 🧵👇

#AI #LLM #DevTools #SaaS #Build...
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
did:plc:bkxyodq6v2in4hjt… network
I both love (for its well-crafted catchiness) and hate (for its sad truth) this AI-built "#LGTM" music video beautifully illustrating the insanity of migrating too much agency for updating & deploying application code from #software engineers to #LLM #AI bots: www.youtube.com/watch?v=3TNp... 🤖🤖🤖🎶
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/openai-batch-api-vs-anthropic-message-batches-50-percent-discount.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app · a reply
@tokenmargin.dev network
OpenAI Batch API vs Anthropic Message Batches: 50% Discount FinOps Calculator

How to split asynchronous workloads (evals, document extraction, nightly summaries) onto 24-hour Batch APIs to slash GPT-4.1, o3-mini, and Claude 3.7 Sonnet costs by 50%. 🧵👇

#AI #LLM #DevTools #SaaS #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@tokenmargin.dev network
3/ Run your own workload parameters & interactive FinOps stress test in our full engineering guide:
https://tokenmargin.dev/guides/deepseek-v3-r1-off-peak-utc-discount-batch-scheduler-guide.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream1.us-west.bsky.network, jetstream2.us-east.bsky.network · view on bsky.app · a reply
@tokenmargin.dev network
DeepSeek V3 & R1 Off-Peak UTC Window Calculator (50%–75% Batch API Savings)

Schedule non-urgent RAG indexing, batch classification, and synthetic data jobs during 16:30–00:30 UTC (12:30 PM–8:30 PM EST) to capture DeepSeek off-peak pricing discounts. 🧵👇

#AI #LLM #DevTools #SaaS #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app
@tokenmargin.dev network
3/ Compare all cloud GPU & serverless endpoints hosting DeepSeek R1 (671B Reasoning) (<400ms TTFT SLA) on our live calculator:
https://tokenmargin.dev/models/deepseek-r1-pricing-calculator.html?ref=bsky #AI #LLM #FinOps #DevTools #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app · a reply
@tokenmargin.dev network
DeepSeek R1 (671B Reasoning) Cloud Pricing & Cheapest Providers (2026):

What does DeepSeek R1 (671B Reasoning) actually cost in production across input, output & prompt caching? 🧵👇

#AI #LLM #DevTools #SaaS #BuildInPublic
From the AT Protocol network, via atproto.africa, jetstream2.us-east.bsky.network, jetstream1.us-west.bsky.network · view on bsky.app

Older