Ecosystem
The AI Application Layer
Hardware only becomes useful once the software stack is in place: inference servers, orchestration, retrieval and the frameworks applications are built with.
Layers in the landscape
- Inference serving – Serve models at scale.
- Orchestration – Schedule and scale GPU workloads.
- Retrieval and vector search – Ground models in your own data.
- Agent frameworks – Build tool-using AI applications.
- MLOps – Track, package and deploy models.
- Vendor software stacks – Drivers, libraries and runtimes.
- Agent platform – Our own platform for AI agents, built and offered by Embedica. Explore it.
How Embedica helps
- Designing infrastructure around the serving and orchestration stack you plan to run
- Deploying and integrating GPU drivers, runtimes and schedulers
- Building retrieval and agent environments on your own data
- Performance tuning from application down to hardware
Company, product and model names are trademarks of their respective owners and are listed for information only. Embedica is not affiliated with, sponsored or endorsed by them unless stated. Details change quickly, so we confirm current specifications and terms with you before any purchase.
Model providers and token costs
Inference cost per user depends on the model you call. Compare current versions and prices.
- LLM models and token costs Compare providers, versions and prices side by side.
- OpenAI models GPT-6, 6.1 and 6.2: Astra, Sol, Terra and Luna.
- Anthropic Claude models Fable, Opus, Sonnet and Haiku, with retirement dates.
- OpenRouter One API across hundreds of models, with fees and rankings.
- Hugging Face Open models, Inference Providers and endpoint costs.
Where this fits in the stack
Common questions
Do you have a relationship with the companies listed?
Listings are informational and imply no affiliation, sponsorship or endorsement unless stated.
Why does this guide cover more than hardware?
Hardware only pays off when memory, software, models and hosting decisions line up with it, so we advise across the whole stack.
Next steps
Related: NVIDIA Data Centre GPUs · AI and GPU Computing Systems · Open-Source AI Models · AI Infrastructure Consulting
Planning the software stack for your AI platform?
