How do you use Harbor?

[av]

It's a complete mystery how most of the people are using Harbor. I'm mostly optimising it for what I see as a "general local LLM use", but I'm sure I'm missing a lot of detail.

If you have some time - please describe below:

• how you're using Harbor
• what works well, what doesn't
• what you'd want to see

Thanks!

[av]

Example from me:

• I'm using Harbor for running LLMs and related projects locally, mostly to experiment with local models, new tools, sometimes build something small to help automate the workflows. Often to experiment with custom reasoning/self-correction workflows
• I like that most of the time I can avoid thinking about service internals and just up service, down service, logs service, etc. I don't like that things move and shift all the time, so less common tools/services get broken without me doing anything. I'm ok with Docker disk usage, but still wish CUDA distirbutions were smaller
• I'd want to see a native and more portable CLI as well as easier way to bring external projects to the Harbor, possibly automatically

[ColumbusAI]

I'm not utilizing agents yet however I plan to utilize soon to help with my storage organization. I have a cluster that needs to be organized into folders, categories etc. I could use an agent that looks at the .exe for metadata, searches online to find its description, then builds an organizational system with that and a database where I can go type in something I'm looking for 'I need an app that shuts down my pc at a certain time' and then the index pulls up all apps that I have in my personal archive that match that description.

I know these are all available with tools in Harbor, e.g. Langchain, N8N, NexaAI.

[BradKML]

Will there be pipeline support for Harbor? Thinking how an AI agent can build pipelines

• Pinokio's specialty other than a unified UX https://pinokio.co/docs/#/?id=script-1
• ComfyUI using agents to build pipelines https://github.com/AIDC-AI/ComfyUI-Copilot
• Another "tool of tools" https://github.com/LykosAI/StabilityMatrix