# Siam Inference

> Siam Inference is a Thai community for AI inference: running and serving LLMs, GPUs and accelerators, vLLM, quantization and Thai-language models.

ภาษาไทย: Siam Inference คือชุมชนคนทำ AI Inference ในประเทศไทย แลกเปลี่ยนเรื่องการรันโมเดล AI และ LLM ทั้ง GPU เอนจินอย่าง vLLM การทำ quantization และโมเดลภาษาไทย

The website is in Thai at https://siaminference.ai/ and in English at https://siaminference.ai/en/.

AI inference is the moment a trained AI model is put to work. Every chatbot reply, every summarised document and every image a model reads is AI inference.

Siam Inference’s own channel is coming soon. For now, follow the vLLM Bangkok and Cerebras Thailand pages on Facebook.

## Pages

- [Siam Inference, Thai page as Markdown](https://siaminference.ai/index.md): the full Thai page. HTML: https://siaminference.ai/
- [Siam Inference, English page as Markdown](https://siaminference.ai/en/index.md): the full English page. HTML: https://siaminference.ai/en/

## Topics

- Compute (Where models run): Compute is the machine an AI model runs on: a GPU, a purpose-built accelerator, a server in your own building (on-premises) or the cloud. Each choice trades speed, price and upkeep differently.
- Inference engines (What makes it fast): An inference engine is the software that loads a model and serves it to users; vLLM is one example. Techniques such as batching requests, shrinking the model (quantization) and managing memory let the same machine answer sooner and serve more people.
- Community (The people who build): Knowledge about AI inference lives with the people doing the work: measuring in a way others can compare (benchmarking), using models for Thai-language tasks, and the lessons from putting a system into production.

## Network

Siam Inference is in the same network as these sites. Each one has its own content and its own focus.

- [vLLM Bangkok](https://vllmbangkok.com/en/): The Thai community around vLLM, the open-source engine that serves large models fast, for the people who build AI inference and infrastructure.
- [Cerebras Thailand](https://cerebras.siaminference.ai/en/): A community for Cerebras users and developers in Thailand.
- [AGICAFET](https://agicafet.com/): A Thailand-based company that sets up private AI that works where you are: Local AI that runs in your office, Hybrid AI that adds the cloud when you choose, and Physical AI inside machines and robots.
- [PreMize](https://premize.agicafet.com/): AGICAFET’s product: private AI in one box, a ready-to-run AI system on NVIDIA DGX Spark.

## Follow

- [vLLM Bangkok on Facebook](https://www.facebook.com/vllmbangkok)
- [Cerebras Thailand on Facebook](https://www.facebook.com/cerebrasthailand)

## Optional

- [Sitemap](https://siaminference.ai/sitemap.xml)

vLLM, NVIDIA, Cerebras and other names are trademarks of their respective owners.