How-To: Deploy AI model

Deploying an AI model to LatticaAI involves consultation, registration, submission, and homomorhic-ready model preparation. This guide walks you through the process.

Important: Contact LatticaAI First

Before starting the deployment process, contact LatticaAI to discuss your model’s parameters. This consultation ensures that your AI model is compatible with encrypted data processing and can be successfully prepared as a homomorphic-ready model.

Once compatibility is confirmed, proceed with the following steps.

Diagram of the AI Model deployment process

1

Register the Model

Before deployment, the AI model must be registered in the system to receive a unique identifier (modelId).

1. Use the Management Client via Python SDK to register the model.

2. Provide the required details during registration:

   • Model Name: This is a mandatory field and must be unique across the system.

   • Optional Parameters: You can include additional metadata, such as:

   • Description

   • Input type

   • Output type

3. After registration, a unique model ID will be generated and provided.

Model Management: Once the model is registered, you can manage its settings (e.g., activate/deactivate, modify parameters) through the web console or Python SDK.

2

Submit the AI Model LatticaAI Backend

Using the Management Client or our Console, submit the AI model associated with the registered modelId.

3

Build the Homomorphic-Ready Model

After the AI model is submitted, LatticaAI prepares the model to process encrypted data securely.

1. Mastery builds the Homomorphic Pipeline Model from the submitted AI model.

2. During this process, the model status will remain "Pending Pipeline".

3. Once the model is ready, its status will update to "Active", and Mastery will notify you.

Tracking: You can monitor the model's status in the web console.

Currently, building a Homomorphic Pipeline requires the Help Desk Service assistance.

Future Feature: Automatic homomorphic-ready model creation from AI provider models will be supported in future releases.

---

🌐Console

1. Open the Models Dashboard

   • Click Add Model on the main dashboard. This opens a sidebar where you’ll enter your new model’s details.

2. Provide Model Details

   • Name (required): Must be unique within your account.

   • Description (optional): Briefly explain what your model does.

   • Input/Output Types (optional): Specify whether your model uses images, audio, text, or vectors.

   • Model Visibility (currently private only): Future versions will allow public sharing.

   • Auto Restart (always On): A future release will offer manual restarts.

3. Upload the AI Model File

   • While not mandatory during initial registration, the model file must be provided before any queries can run (so it can be translated into a homomorphic-ready version).

   • If you have the file, click Choose your Model here. A placeholder diagram confirms the upload.

4. Save Your Model

   • Nothing is saved until you click “Add.” Changes, including file uploads, are only committed after pressing Add and seeing a success message.

Even if you receive a success message after providing all details, the model is not immediately ready for queries. We first need to build the homomorphic pipeline from your model, which can take additional time depending on its complexity. Once the homomorphic version is created and deployed, the model status changes to Active. For more information on model statuses, see our “Model Settings” documentation.

🧊Python SDK

# Create Plain Model
import LatticaManagement

# Authenticate
lattica = LatticaManagement("your_license_from_lattica_console")

# Register a new model...
model_id = lattica.create_model("model_name")

# Upload model...
with open("MyModel.pth", 'rb') as model_file:
    lattica.upload_plain_model_file(model_file, model_id)