Member Login — Talk to Sam

Artificial Intelligence

S.A.M.

Smart Ass Machine

I have for over 30 years imagined having a machine assistant that I could discuss project details with and have automate certain things around the home and workshop. With today’s technology where it is at, it is finally a viable option. However, I do not care for cloud computing or storage, so I wanted to make my own locally hosted artificial Intelligence. The biggest benefits to this is, 1. I can hopefully set it up so all data stays mine and not for others to use to data mine me and 2. You can learn to use prebuilt commercial AI or build your own, which is going to look better on a resume if it ever becomes necessary.

So, I want to build my own locally hosted LLM artificial Intelligence and call it Sam. The intent of this is for general automation, coding and image generation. I started by gathering what equipment I already had and bought some other stuff. The breakdown of what I am using is:

  1. Machine that currently hosts my web-server will also pull double duty by being the UI Node for the local AI

  2. PC Core i7-11700F RTX 3060 12GB 32GB RAM 1TB SSD + 4TB HDD which will be the GPU node and back bone and hopefully make animations

  3. 5 HP ProDesk 600 G3 Mini i5-7500T 2.7GHz 16GB RAM 512GB NVMe SSD which will be 3 light duty LLM, STT and TTS functions, Orchestrator and Retrieval Nodes

  4. Raspberry Pi’s set up around the house as voice assistants some with screens to show videos, recipes, Hot to fix this car thingy, or watch movie/utube on

  5. And a 16TB NAS for half AI storage and half media streaming, media being movies, music, PDF documents

What I hope I can accomplish:

  1. Local hosted LLM that is actually helpful

  2. Use it to improve my website and link it to the website so it can be shared

  3. Persistence of projects, I may work on one project today and not return to it for months, the LLM need to remember for me

  4. I would like for it to develop some personality and for it to earn its name

  5. For coding, website and document management rival commercial cloud offering

  6. Be adequate for imaging generation to spice up reports, website or X responses

  7. Improve my home assistant automations and house control

From some articles I have read I would like to stay from the llama AI if possible for best chatting, coding(working with VS Studio (C Sharp) and VS Code programs and imaging that my hardware can support with memory and attitude.