User Tools

Site Tools


tech:linux

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
tech:linux [2026/06/15 02:00] – [2. Install the NVIDIA Container Toolkit] glongtech:linux [2026/06/15 18:53] (current) glong
Line 2: Line 2:
  
 Ubunut 24.04 Ubunut 24.04
 +
 +[[:tech:Linux:AI Setup]] \\
  
 ====== Install all drivers needed for using V100 on Ubuntu 24.04 LTS ====== ====== Install all drivers needed for using V100 on Ubuntu 24.04 LTS ======
Line 239: Line 241:
  
 <code> <code>
-sudo docker run --rm --gpus all ubuntu nvidia-smi+docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi
 </code> </code>
  
Line 254: Line 256:
 If you plan to deploy enterprise-grade AI workloads, you can also authenticate your Docker client to the NVIDIA NGC Container Registry using an API key. This gives you direct access to fine-tuned, GPU-optimized AI models and microservices. If you plan to deploy enterprise-grade AI workloads, you can also authenticate your Docker client to the NVIDIA NGC Container Registry using an API key. This gives you direct access to fine-tuned, GPU-optimized AI models and microservices.
  
 +
 +====== Installing LM Studio on Ubuntu 24.04 ======
 +
 +To install LM Studio on Ubuntu 24.04 LTS, you have two primary options: the **headless lms daemon** (ideal for servers, command-line usage, or API orchestration) or the **AppImage** (for the full graphical interface).
 +
 +---
 +
 +===== Option 1: Headless Daemon (lms) =====
 +If you intend to use LM Studio for backend services, API hosting, or CI/CD, the ''lms'' daemon is the official, recommended approach.
 +
 +==== 1. Install the Daemon ====
 +Run the following command in your terminal to download and execute the official installer:
 +<code>
 +curl -fsSL https://lmstudio.ai/install.sh | bash
 +</code>
 +
 +==== 2. Usage ====
 +Once the installation script completes, you can interact with the service directly using the ''lms'' CLI.
 +
 +To start the background service:
 +<code>
 +lms daemon up
 +</code>
 +
 +**Note:** If you encounter an "Illegal instruction" error upon execution, ensure your system's ''libc'' and environment variables are fully updated. This can sometimes occur on bleeding-edge hardware configurations.
 +
 +---
 +
 +===== Option 2: Graphical AppImage (Full GUI) =====
 +If you require the standard LM Studio desktop interface, you must download the AppImage. Note that Ubuntu 24.04 enforces strict sandboxing rules that require manual adjustment.
 +
 +==== 1. Download and Make Executable ====
 +Download the latest Linux AppImage from the official LM Studio website, then give it execution permissions:
 +<code>
 +chmod +x LM_Studio-*.AppImage
 +</code>
 +
 +==== 2. Extract and Configure Sandbox ====
 +The application will likely fail to launch unless you fix the ''chrome-sandbox'' permissions. Extract the AppImage and update the owner permissions:
 +<code>
 +# Extract the AppImage
 +./LM_Studio-*.AppImage --appimage-extract
 +
 +# Navigate to the extracted folder
 +cd squashfs-root
 +
 +# Fix sandbox permissions
 +sudo chown root:root chrome-sandbox
 +sudo chmod 4755 chrome-sandbox
 +</code>
 +
 +==== 3. Launch the Application ====
 +You can now run the application from within the extracted directory:
 +<code>
 +./lm-studio
 +</code>
 +
 +If you still encounter sandboxing issues and prefer to bypass it, you can launch with the ''--no-sandbox'' flag (use with caution):
 +<code>
 +./lm-studio --no-sandbox
 +</code>
 +
 +---
 +
 +===== Troubleshooting & Performance =====
 +^ Issue ^ Resolution ^
 +| **Missing Dependencies** | Install base libraries: \\ <code>sudo apt install libatk1.0-0 libatk-bridge2.0-0 libcups2 libgdk-pixbuf2.0-0 libgtk-3-0 libpango-1.0-0 libcairo2 libxcomposite1 libxdamage1 libasound2t64 libatspi2.0-0</code> |
 +| **Hardware Acceleration** | For integrated or discrete GPUs, ensure your drivers (such as ''intel-media-va-driver-non-free'' for Intel setups) are properly configured via ''mesa'' to ensure local model inference acceleration. |
  
tech/linux.1781488810.txt.gz · Last modified: by glong

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki