Copyright DeGirum Corp. 2022-2023
The DeGirum AI Inference Software Development Kit, PySDK, is a Python package which provides APIs to perform inference on ML models. There are three main concepts in PySDK: the AI inference engine, the AI model zoo, and the AI model. The AI inference engines perform inferences of AI models, while AI model zoos are places where these models are stored.
AI Inference Types
PySDK supports the following AI inference types:
- Local inference: when the client application uses PySDK to directly communicate with the AI hardware accelerator installed on the same computer where this application runs.
- AI server inference: when the AI hardware accelerator is controlled by the DeGirum AI Server software stack, and the client application communicates with that AI Server to perform AI inferences. The client application and the AI server can run on the same computer or on two different computers connected to the same local network.
- Cloud inference: when the client application communicates with the DeGirum Cloud Platform software over the Internet to perform AI inferences on the DeGirum Cloud Farm devices.
AI Model Zoo Types
PySDK supports the following AI model zoo types:
Local model zoo: when the set of AI models is located in some local directory on the computer with AI hardware accelerator. In the case of the local inference, the local model zoo is located on the computer where you run your application. In the case of AI server inference, the local model zoo is located on the computer on which the AI Server is launched.
Cloud model zoo: when the set of AI models is located on the DeGirum Cloud Platform. You can create and maintain cloud model zoos using DeGirum Cloud Platform web GUI. There are two types of cloud model zoos: public and private. A public model zoo is visible to all registers cloud users, while a private model zoo is visible only to the the members of your organization.