Docker Command
--gpus flag to specify the GPU ID to use. The full GPU container also requires 4GB shared memory, which is set via the --shm-size flag. For the text-only GPU container the shared memory flag is not necessary:
Docker Command
GPU_ID accordingly. You can get the GPU_ID using the nvidia-smi command if you have access to runner. You can find more information regarding using GPUs with docker here.
For private or public cloud deployment, please see Deployment and the Kubernetes Setup Guide.
crprivateaiprod.azurecr.io is intended for image distribution only. For production use, it is strongly recommended to set up a container registry inside your own compute environment to host the image.Apple Silicon
It is possible to run the Limina container on Apple Silicon-based Macs, such as the M1 Macbook Pro, even though it is not officially supported. To do this, please make sure you use Docker Desktop 4.25 or later and enable Rosetta2 support. During our testing we didn’t encounter issues with M1 Macs but did encounter some container startup issues on M2 Macs. If this occurs, please try disabling Rosetta2 support. Due to the need to emulate x86 instructions, performance is significantly lower than x86-based machines, let alone GPU-equipped machines. On a M1 Macbook Pro, our tests revealed a throughput of approximately 250 words per second.Authentication and External Communications
The container makes external communications to Limina’s servers for authentication and usage reporting. To this end, please make sure that the following are reachable:https://verify1.private-ai.com:443/license-verification/license_statushttps://verify2.private-ai.com:443/license-verification/license_statushttps://app.amberflo.io:443/ingest/
URI-Based File Support
Running the container with the above commands allows for base64-encoded files to be processed with/process/files/base64. However, to utilize the /process/files/uri route, a volume where input files are stored and PAI_OUTPUT_FILE_DIR must be provided. Note that PAI_OUTPUT_FILE_DIR must reside inside the mounted volume.
Docker Command
Docker Command