For the complete documentation index, see llms.txt. This page is also available as Markdown.

Architecture and Connection Modes

DeGirumJS offers flexible connection modes to cater to various AI inference needs, whether you're running models locally on an AI Server, entirely in the cloud, or a hybrid approach.

Connection Modes

DeGirumJS offers three easy ways to connect for AI inference:

Local Server

Inference runs on your own AI Server (e.g., on your machine or LAN). No internet needed, but you do need your own model zoo ready.

const dg = new dg_sdk();
const zoo = await dg.connect('localhost:8779'); // IP/Port of an AI Server on your network
const models = await zoo.listModels();
console.log('Local models:', Object.keys(models));

Hybrid (Local + Cloud Models)

Inference still runs on your local AI Server, but models are loaded from the DeGirum Cloud Zoo.

const dg = new dg_sdk();
const zoo = await dg.connect(
  'localhost:8779',                         // IP/Port of an AI Server on your network
  'https://cs.degirum.com/degirum/public', // or another Cloud Zoo URL from AI Hub
  'YOUR_TOKEN'                              // your AI Hub access token
);
const models = await zoo.listModels();
console.log('Cloud models via local server:', Object.keys(models));

Cloud Only

Everything runs in the DeGirum Cloud - ideal for scalable, managed inference.


For more information on setting up your AI Server, refer to the AI Server documentation

Last updated

Was this helpful?