DeGirum PySDK
Copyright DeGirum Corp. 2022-2023
The DeGirum AI Inference Software Development Kit, PySDK, is a Python package which provides APIs to perform inference on ML models. There are three main concepts in PySDK: the AI inference engine, the AI model zoo, and the AI model. The AI inference engines perform inferences of AI models, while AI model zoos are places where these models are stored.
AI Inference Types
PySDK supports the following AI inference types:
- Local inference: when the client application uses PySDK to directly communicate with the AI hardware accelerator installed on the same computer where this application runs.
- AI server inference: when the AI hardware accelerator is controlled by the DeGirum AI Server software stack, and the client application communicates with that AI Server to perform AI inferences. The client application and the AI server can run on the same computer or on two different computers connected to the same local network.
- Remote inference: when the client application communicates with the DeGirum AI Hub software over the Internet to perform AI inferences on the DeGirum Device Farm devices.
AI Model Zoo Types
PySDK supports the following AI model zoo types:
-
Local model zoo: when the set of AI models is located in some local directory on the computer with AI hardware accelerator. In the case of the local inference, the local model zoo is located on the computer where you run your application. In the case of AI server inference, the local model zoo is located on the computer on which the AI Server is launched.
-
AI Hub model zoo: when the set of AI models is located on the DeGirum AI Hub. You can create and maintain model zoos using the DeGirum AI Hub web GUI. There are two types of model zoos: public and private. A public model zoo is visible to all registered AI Hub users, while a private model zoo is visible only to the members of your organization.