# NVIDIA AI Workbench

A single pane of glass to develop, customize, and prototype AI applications on your GPUs.

[Download Now](#starting-options)

[Solution Overview](https://resources.nvidia.com/en-us-workstation/proviz-ai-workbench-ai-workstation?lx=57iDsa&ncid=no-ncid)  |  [Demo](https://www.youtube.com/watch?v=usnXmiBuUjc)  |  [For Developers](https://docs.nvidia.com/ai-workbench/user-guide/latest/overview/introduction.html)

### Overview

## AI and ML on Your Terms and Your Machines

NVIDIA AI Workbench is a free development environment manager for data scientists and developers to create, customize, and collaborate on AI applications on GPU systems. Focus on execution and let AI Workbench manage your containers, environment, and configurations.

### Breaking Barriers: How NVIDIA AI Workbench Makes AI Accessible to All

Learn how to achieve maximum flexibility for experimentation, prototyping, and proof of concepts with NVIDIA AI Workbench. Explore pre-built projects from NVIDIA to chat with your documents using retrieval-augmented generation (RAG), generate custom images, and customize large language models (LLMs) at scale.

[Watch Webinar](https://www.insight.com/en_US/content-and-resources/webinars/how-nvidia-ai-workbench-makes-ai-accessible-to-all.html?srsltid=AfmBOopi3-smMJAyz3I4pihi6roCYXNA16b_xdpT7xzI6LN-M5BDf6BD)

### Demo

## See NVIDIA AI Workbench in Action

![YouTube Video](https://img.youtube.com/vi_webp/ntMRzPzSvM4/maxresdefault.webp)

Consent for Optional Cookies

(googleCookiePolicyLink)YouTube sets performance, advertising, and other optional cookies(/googleCookiePolicyLink) when you watch embedded videos. To watch this video, you need to turn on optional cookies for the site. By clicking “Accept and Play Video,” you will automatically turn on advertising and other optional cookies for the site and accept our (nvidiaTermsOfServiceLink)Terms of Service(/nvidiaTermsOfServiceLink) (which contains important waivers). Please see our (nvidiaPrivacyPolicyLink)Privacy Policy(/nvidiaPrivacyPolicyLink) and (nvidiaCookiePolicyLink)Cookie Policy(/nvidiaCookiePolicyLink) for more information.

Cancel

Accept and Play Video

Alternatively, you can (youtubeLink)watch this video on YouTube(/youtubeLink).

[Watch Demo](https://www.youtube.com/watch?v=ntMRzPzSvM4&t=3s)

### Benefits

## The Enterprise Developer’s AI Workbench

AI Workbench is built for AI and ML development, rapid prototyping, and providing speed and agility to get up and running with different SDKs, environments, and toolkits on whatever system you need to use.

### Streamlined Setup

User-friendly install and configuration standardized across laptops, workstations, servers, and the cloud. Ready to use in minutes.

[Learn More](https://docs.nvidia.com/ai-workbench/user-guide/latest/overview/introduction.html)

### Run Projects Anywhere

Easily move workloads and applications across GPUs. Ensure consistency while optimizing for performance, costs, and scale.

[Learn More](https://docs.nvidia.com/ai-workbench/user-guide/latest/locations/locations.html)

### Collaboration Made Easy

Develop locally or remotely with streamlined Git, container, and GPU management.

[Learn More](https://docs.nvidia.com/ai-workbench/user-guide/latest/integrations/integrations.html)

### Manage Your Experience

Unified control plane to work across hybrid, decentralized environments. No service-based offering required.

[Learn More](https://docs.nvidia.com/ai-workbench/user-guide/latest/installation/overview.html)

### Use Cases

## How NVIDIA AI Workbench Is Being Used

See some examples of NVIDIA AI Workbench accelerating developer workflows in the real world.

1. AI Chatbot
2. Model Fine-Tuning
3. Custom Image Generation

## AI Chatbot With RAG

Easily create, use, and distribute RAG-powered AI chatbots with AI Workbench. Check out:

* [Hybrid-RAG](https://github.com/NVIDIA/workbench-example-hybrid-rag) for rapid prototyping: Run embedding locally and inference locally or in the cloud with NVIDIA NIM™ or an NVIDIA API.
* [Agentic RAG](https://github.com/NVIDIA/workbench-example-agentic-rag) for improved response quality: Use AI agents for dynamic information retrieval across documents and web search. Run inference in the cloud with NVIDIA NIM or an NVIDIA API.
* [NIM-Anywhere](https://github.com/NVIDIA/nim-anywhere) to get started today: Implement native RAG and build your own AI-powered tools with NVIDIA NIM.

[Create Your Own AI Chatbots](https://github.com/NVIDIA?q=ai+workbench+rag&type=all&language=&sort=)

## Fine-Tuning LLMs At Any Scale

Customize LLMs and tailor to specific domains. Choose from a variety of models, frameworks, and fine-tuning methods,and fine-tune with custom datasets to increase domain-specific knowledge.

Simplify environment setup and container configuration across local and remote deployments with AI Workbench.

Get started with AI Workbench example projects available on NVIDIA’s GitHub to customize Llama 3, Mistral, Phi 3, and more.

[View All Fine-Tuning AI Workbench Projects](https://github.com/NVIDIA?q=ai+workbench+finetune&type=all&language=&sort=)

## Custom Image Generation With Stable Diffusion XL (SDXL)

AI Workbench simplifies local deployment of Stable Diffusion XL models. It manages environment setup, model acquisition, and container configuration. AI Workbench also supports remote workstations for running Jupyter Notebooks and allows fine-tuning of models for specific subjects, enhancing image generation results.

[Try SDXL AI Workbench Project](https://github.com/NVIDIA/workbench-example-sdxl-customization)

### Starting Options

## Ways to Get Started With NVIDIA AI Workbench

Use the right tools and technologies to create, customize, and collaborate on AI applications across different GPU systems.

### Download

Use AI Workbench for free. Support is available with an [NVIDIA AI Enterprise license](https://www.nvidia.com/en-us/data-center/products/ai-enterprise.md).

By downloading, installing, or using the NVIDIA AI Workbench software, you agree to the terms of the [NVIDIA AI Enterprise End User License Agreement](https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement.md).

If you do not agree to the terms of the EULA, you are not authorized to download, install, or use the software.

Before downloading and using NVIDIA AI Workbench, please read our [Shared Security Model](https://docs.nvidia.com/ai-workbench/user-guide/latest/overview/security-model.html).

[Other Operating Systems](#download)

### Learn

Check out the official AI Workbench documentation to learn more on how to get started for your use case.

[Learn More](https://docs.nvidia.com/ai-workbench/user-guide/latest/overview/introduction.html)

### Experience

Access NVIDIA-hosted infrastructure and a guided hands-on lab for AI Workbench that includes step-by-step instructions and examples, available for free on NVIDIA LaunchPad.

[Access Hands-On Lab](https://www.nvidia.com/en-us/launchpad/data-science/ai-workbench.md)

## Flexible Development From Local to Cloud

### Cost-Effective Scalability

AI Workbench is a cost-effective solution for working with GPUs and AI models. Start on your local mobile or desktop workstation and scale out to cloud or data center when more compute is required. You can now optimize your development and computational work to fit the scale, costs, and availability you have to work with.

[Learn More About NVIDIA RTX-Powered AI Workstations](https://www.nvidia.com/en-us/ai-data-science/workstations.md)

### Resources

## The Latest in NVIDIA AI Workbench Resources

1. Blogs
2. Sessions
3. Training
4. Videos

[View All Blogs](https://developer.nvidia.com/blog/search-posts/?faceted_search_products_str=AI+Workbench)

[View All Sessions](https://www.nvidia.com/en-us/on-demand/playlist/playList-6ee39157-d4af-4c22-b4d2-40248c1f577d/)

### Breaking Barriers: How NVIDIA AI Workbench Makes AI Accessible to All

Watch this webinar on how to achieve maximum flexibility for experimentation, prototyping, and proof of concepts from Insight, Lenovo, and NVIDIA.

[Watch Now](https://www.insight.com/en_US/content-and-resources/webinars/how-nvidia-ai-workbench-makes-ai-accessible-to-all.html?srsltid=AfmBOopi3-smMJAyz3I4pihi6roCYXNA16b_xdpT7xzI6LN-M5BDf6BD)

### Setting Up a RAG Demo on NVIDIA AI Workbench

Walk through a complete start-to-finish installation of a generative AI RAG system with Lee Bushen, solutions architect at NVIDIA.

[Watch Now](https://youtu.be/UXNyf88xI8w?feature=shared)

### Getting the Most From NVIDIA AI Workbench for Gen AI Workflows

Learn how to use NVIDIA AI Workbench as the focal point in generative AI workflows. We'll explain how other elements of NVIDIA AI Enterprise interoperate with AI Workbench.

[Watch On-Demand Session](https://www.nvidia.com/en-us/on-demand/session/gtc24-dlit61929/)

### NVIDIA's NEW AI Workbench for AI Engineers

This tutorial shows how NVIDIA AI Workbench streamlines development by eliminating tedious tasks, allowing AI engineers to focus on core innovation while simplifying environment management and deployments.

[Watch Now](https://www.youtube.com/watch?v=DcrFL_zNRKM)

### NVIDIA AI Workbench | Fine-Tuning Generative AI

NVIDIA AI Workbench allows users to create or clone AI projects locally and easily scale them to the cloud or data centers. This demo showcases SDXL and Llama 2, which can be cloned from GitHub for customization.

[Watch Now](https://www.youtube.com/watch?v=ntMRzPzSvM4)

### NVIDIA AI Workbench: Create and Deploy Generative AI Models, RAG, and LLMs Locally

The demo provides an insightful overview of NVIDIA AI Workbench in action, showcasing its powerful capabilities and illustrating why it’s a must-have for AI enthusiasts.

[Watch Now](https://www.youtube.com/watch?v=4mfJIkXkQVk)

[View All Videos](https://www.youtube.com/results?search_query=%22nvidia+ai+workbench%22)

### Get Started

## For Developers

Explore everything you need to start developing with NVIDIA AI Workbench, including the latest documentation, tutorials, and more.

[Start Learning Now](https://docs.nvidia.com/ai-workbench/user-guide/latest/overview/introduction.html)

### Join the Community

Have a question? Get answers from experts, share your experience, become a part of the conversation today.

[Join the Discussion](https://forums.developer.nvidia.com/c/ai-data-science/nvidia-ai-workbench/671)

### Get in Touch

Talk to an NVIDIA product specialist about moving from pilot to production with the security, API stability, and support of [NVIDIA AI Enterprise.](https://www.nvidia.com/en-us/data-center/products/ai-enterprise.md)

[Contact Us](https://www.nvidia.com/en-us/data-center/products/ai-enterprise/contact-sales.md)

Welcome back.
Not you? Log Out

Welcome
back. Not you? Clear form

[Download for Windows](https://workbench.download.nvidia.com/stable/workbench-desktop/latest/NVIDIA-AI-Workbench-Setup.exe)

Windows 11 and Windows 10 Build 19044 or higher

[Install on Ubuntu](https://docs.nvidia.com/ai-workbench/user-guide/latest/install/desktop-app-install.html#install-on-ubuntu-desktop)

Ubuntu 24.04 and 22.04

[Download for macOS](https://workbench.download.nvidia.com/stable/workbench-desktop/latest/NVIDIA-AI-Workbench.dmg)

macOS 14 or higher

[NVIDIA AI Workbench User Guide](https://docs.nvidia.com/ai-workbench/user-guide/latest/overview/introduction.html)

[Instructions for Remote Installation](https://docs.nvidia.com/ai-workbench/user-guide/latest/installation/ubuntu-remote.html)

By downloading, installing, or using the NVIDIA AI Workbench software, you agree to the terms of the [NVIDIA AI Enterprise End User License Agreement (EULA)](https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products.md). If you do not agree to the terms of the EULA, you are not authorized to download, install, or use the software.  
 Before downloading and using NVIDIA AI Workbench, please read our [Shared Security Model](https://docs.nvidia.com/ai-workbench/user-guide/latest/overview/security-model.html).