AI on your desktop is about to become the norm

Local models and easy workflows changed my mind.

Share
AI on your desktop is about to become the norm
Photo Credit: Karen Wong.

The team at Nvidia asked for my thoughts about the DGX Station at GTC in Taipei. Here's why I think having AI on your desktop will soon be the norm.

Useful AI

If you'd asked me 12 months ago about having an AI supercomputer on your desk, I would have dismissed you outright. What's the point when cloud-based AI LLMs are so much better and more convenient to use?

My opinion has since changed, for a few reasons. AI is a lot more useful for many tasks now. New AI workflows are easy to set up. And the local models you can run today are 2024's frontier models. As the models get even better, expect the use cases to soar.

New ways to use AI

For early adopters and developers, this means the time to figure out new ways to use AI is now. So how might AI on the desktop be used?

I have a few nascent ideas. The first is smart home control by voice. The second is an always-on private secretary. The third is running Open Claw or its variants locally. And the fourth is powering AI coding with local models.

As local devices become more powerful and AI models continue to improve, I expect a lot more will be possible from your desk or home. What are you building with AI today?

  • Check out my video posted by Nvidia here.
  • Here's my initial thoughts about Asus's DGX Spark here.